因此,我使用Charles的外部代理设置和puppeteer,问题是当我将代理服务器放在puppeteer中作为本地主机时
"--proxy-server=127.0.0.1:8888"一切正常,但当我关闭Charles并使用另一个经过身份验证的代理时,服务器返回状态302并重定向我,我检查了本地主机的标头,当我更改我的代理时两者都是相同的
我将其用作标头
await page.setExtraHTTPHeaders({
"Host": "www.supremenewyork.com",
"Connection": "keep-alive",
"User-Agent":"Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/88.0.4324.182 Safari/537.36",
'Accept':"text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.9",
"Sec-Fetch-Site": "same-origin",
"Sec-Fetch-Mode": "cors",
"Sec-Fetch-Dest": "empty",
"Accept": "application/json",
"Sec-Fetch-User": "1",
"Sec-Fetch-Dest": "document",
"referer" :`https://www.supremenewyork.com/mobile/`,
"Accept-Encoding": " gzip, deflate, br",
"Accept-Language": " en-GB,en-US;q=0.9,en;q=0.8",
"Cookie": `${set_cookie}`,
"dnt": "1",
"sec-fetch-site" : "same-origin"
},
)发布于 2021-03-05 16:36:42
由于某种原因,这个问题是因为代理身份验证,我使用了代理链,它解决了XD
https://stackoverflow.com/questions/66385164
复制相似问题