下载所有从纳斯达克上市的链接到json文件

Question

我一直试图下载的文件与代码，但至今没有成功，希望有人能帮助。

该单元格持续加载数小时，除非中断(浏览器加载以秒为单位)，否则不会有结果。

死刑就会被永远搁置在get请求下..。

import requests
url = "https://api.nasdaq.com/api/screener/stocks?tableonly=true&limit=25&offset=0&download=true"
data = requests.get(url)

Answer 1

nasdaq.api已经采取了一些措施来防止网络刮擦。您需要设置额外的头信息，以便能够按照推荐的here.访问数据。

请尝试以下代码：

import pandas as pd

import requests
url = \
    'https://api.nasdaq.com/api/screener/stocks?tableonly=true&limit=25&offset=0&download=true'
headers = {'Accept-Language': 'en-US,en;q=0.9',
           'Accept-Encoding': 'gzip, deflate, br',
           'User-Agent': 'Java-http-client/'}

response = requests.get(url, headers=headers)

# get json response
json = response.json()

# extract relevant keys
df = pd.DataFrame(json['data']['rows'])
df

输出：

    symbol  name    lastsale    netchange   pctchange   volume  marketCap   country ipoyear industry    sector  url
0   A   Agilent Technologies Inc. Common Stock  $135.71 -0.70   -0.513% 1403731 40728386393.00  United States   1999    Electrical Products Capital Goods   /market-activity/stocks/a
1   AA  Alcoa Corporation Common Stock  $91.96  -3.10   -3.261% 6036063 16959331342.00      2016    Metal Fabrications  Basic Industries    /market-activity/stocks/aa
2   AAC Ares Acquisition Corporation Class A Ordinary ...   $9.78   -0.01   -0.102% 3176    1222500000.00       2021    Business Services   Finance /market-activity/stocks/aac