Python aiohttp解析

Question

我想用iohttp解析很多链接，但它不能实时工作，轮流解析每个链接。我怎样才能连续地解析每一个呢？

import aiohttp
import asyncio


list = ['value1', 'value2', 'value3', ..... 'value6000']

async def main():
    async with aiohttp.ClientSession() as session:
        while True:
            for i in list:
                async with session.get(f"https://example.com/{i}") as response:
                    print(response.json())

loop = asyncio.get_event_loop()
loop.run_until_complete(main())

Answer 1

如果你正在寻找处理一个列表，你应该检查asyncio.gather()。

用法示例：

import asyncio
import os

from aiohttp import ClientSession, ClientError, TCPConnector
from asyncio import TimeoutError, gather



async def asyncmain(your_list):

    async with ClientSession(
        connector=TCPConnector(limit_per_host=SESSION_LIMIT_PER_HOST)
    ) as session:
        tasks = (your_async_call(session, title) for title in your_list)

        return await gather(*tasks)