ConnectionResetError: WinError 10054现有连接被远程主机强制关闭
在从urllib.request导入urlopen作为uReq读取以下代码时,我收到了此错误
from bs4 import BeautifulSoup as soup
myurl = 'https://www.amazon.in/s?k=graphics+card&ref=nb_sb_noss_2'
uClient =uReq(myurl)发布于 2020-06-19 05:23:39
传递useragent头似乎解决了这个问题。
试着做这样的事情:
from urllib.request import urlopen as uReq, Request
from bs4 import BeautifulSoup as soup
headers = {"User-Agent": "Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/41.0.2228.0 Safari/537.3"}
my_url = 'https://www.amazon.in/s?k=graphics+card&ref=nb_sb_noss_2'
uClient = uReq(Request(url=my_url, headers=headers))但是要知道,如果您尝试刮的数据是动态的,bs4就不会有多大帮助。考虑使用pyppeteer或selenium等。就为了这个。
https://stackoverflow.com/questions/62462946
复制相似问题