我知道我想做的是最简单的事情,但这让我震惊。我希望使用https://partner.microsoft.com/en-us/membership/application-development-competency从HTML页面( BeautifulSoup )中提取数据。为此,我想我需要使用.find()函数。不知道该怎么做了。感谢一切形式的帮助。下面是我正在使用的HTML :在这里输入图像描述1:https://i.stack.imgur.com/sHAMF.png
import requests
from bs4 import BeautifulSoup
url = 'https://partner.microsoft.com/en-us/membership/application-development-competency'
res = requests.get(url)
html_page = res.content
soup = BeautifulSoup(html_page, 'html.parser')
text = soup.find("div",{"class":"col-md4[2]"})
output = ''
blacklist = [
'style',
'head',
'meta',
'col-md4[0]',
'col-md4[1]',
]
for t in text:
if t.parent.name not in blacklist:
output += '{} '.format(t)
sheet = '<html><body>' + text + '</body></html>';
file_object = open("record.html", "w+");
file_object.write(sheet);
file_object.close();
在这里输入图像描述1:https://i.stack.imgur.com/sHAMF.png
发布于 2021-12-17 09:31:47
您可以这样做,但是对于这个站点,我认为最好使用XPath
import requests
from bs4 import BeautifulSoup
url = 'https://partner.microsoft.com/en-us/membership/application-development-competency'
response = requests.get(url)
soup = BeautifulSoup(response.text, features="lxml")
cols = soup.find_all("div", class_="col-md-4")
print(cols[6].getText())https://stackoverflow.com/questions/70390691
复制相似问题