BeautifulSoup网络抓取错误/无代码运行

Question

我试着运行这段代码来做一些web-scraping，但是它不想工作:( -使用windows10- Pycharm编辑器-(在pycharm python控制台thingo中运行代码)

代码：

import requests
from bs4 import BeautifulSoup

URL = 'https://www.danmurphys.com.au/current-offers?filters=variety(beer)&size=120'
page = requests.get(URL)

soup = BeautifulSoup(page.content, 'html.parser')
results = soup.find(id='ResultsContainer')
print(results.prettify())

错误：

Traceback (most recent call last):
  File "C:\Program Files\JetBrains\PyCharm Community Edition 2019.3.3\plugins\python-ce\helpers\pydev\pydevd.py", line 2127, in <module>
    main()
  File "C:\Program Files\JetBrains\PyCharm Community Edition 2019.3.3\plugins\python-ce\helpers\pydev\pydevd.py", line 1961, in main
    setup = process_command_line(sys.argv)
  File "C:\Program Files\JetBrains\PyCharm Community Edition 2019.3.3\plugins\python-ce\helpers\pydev\_pydevd_bundle\pydevd_command_line_handling.py", line 136, in process_command_line
    setup['file'] = argv[i]
IndexError: list index out of range

Process finished with exit code 1

Answer 1

如果"soup“不是空的，很可能页面中没有这样的元素，或者它是由javascript加载的。