我对bs4for来说还挺新的,但是我试着从一个站点上抓取一小块信息:但是它一直在打印“无”,好像标题或任何标签(如果我替换它)都不存在一样。
该项目由两部分组成:
我试图循环遍历一个URL数组,并从wordpress-plugins列表中抓取下面的数据。看我下面的循环-
from bs4 import BeautifulSoup
import requests
#array of URLs to loop through, will be larger once I get the loop working correctly
plugins = ['https://wordpress.org/plugins/wp-job-manager', 'https://wordpress.org/plugins/ninja-forms']该项目:关于状态列表-数据的wordpress-插件:-大约50个插件是感兴趣的!
https://wordpress.org/plugins/wp-job-manager
https://wordpress.org/plugins/ninja-forms
https://wordpress.org/plugins/participants-database ....and so on and so forth.解析器-部分:,所以这是我使用漂亮汤的方法-来提取标签中的字符串?
import bs4
from urllib.request import urlopen as uReq
from bs4 import BeautifulSoup as soup
my_url = "https://wordpress.org/plugins/participants-database/"
uClient = uReq(my_url)
page_html = uClient.read()
uClient.close()
page_soup = soup(page_html, "html.parser")
ttt = page_soup.find("div", {"class":#post-15991 > div.entry-meta > div.widget.plugin-meta"})
item = ttt.a.text
print(item)后台:希望从此页面获取以下数据:
https://wordpress.org/plugins/participants-database/
我需要以下三行的数据-在上面提到的例子中
Version: <strong>1.29.3</strong>
Active installations: <strong>100,000+</strong>
Tested up to: <strong>4.9.4</strong>请参阅我在这里找到的xpath:
//*[@id="post-15991"]/div[4]/div[1]
//*[@id="post-15991"]/div[4]/div[1]/ul/li[1]
//*[@id="post-15991"]/div[4]/div[1]/ul/li[2]
//*[@id="post-15991"]/div[4]/div[1]/ul/li[3]
//*[@id="post-15991"]/div[4]/div[1]/ul/li[4]
//*[@id="post-15991"]/div[4]/div[1]/ul/li[5]
//*[@id="post-15991"]/div[4]/div[1]/ul/li[6]发布于 2018-02-20 19:08:27
您可以获得所需的值,只需:
ttt = page_soup.find("div", {"class":"plugin-meta"})
text_nodes = [node.text.strip() for node in ttt.ul.findChildren('li')[:-1:2]]text_nodes输出
['Version: 1.7.7.7', 'Active installations: 10,000+', 'Tested up to: 4.9.4']https://stackoverflow.com/questions/48892305
复制相似问题