Bs4抓取表指定

Question

我希望你们永远健康

我想用BS4抓取一个更具体的表。这是我的代码：

from bs4 import BeautifulSoup
import requests


url = 'test.com'
page = requests.get(url)
soup = BeautifulSoup(page.text, 'lxml')

for row in soup.select('tbody tr'):
    row_text = [x.text for x in row.find_all('td')]
    print (row_text)

如何获得这样的结果：

    Number, Name, address, telp, komoditi
1, "ABON JUARA" JUARA FOOD INDUSTRY, Jl. Jend Sudirman 339, Salatiga, Jawa Tengah, 0298-324060, Abon Sapi Dan Ayam

并保存在CSV中

Answer 1

import requests
from bs4 import BeautifulSoup
import csv


def main(url):
    r = requests.get(url)
    soup = BeautifulSoup(r.content, 'html.parser')
    target = soup.select_one("table#newspaper-a").select("tr[valign=top]")
    with open("data.csv", 'w', newline="") as f:
        writer = csv.writer(f)
        writer.writerow(["No", "Name", "Address", "Tel", "Komoditi"])
        for item in target:
            item = list(item.stripped_strings)
            item[3] = item[3][6:]
            writer.writerow(item)


main("https://kemenperin.go.id/direktori-perusahaan?what=&prov=&hal=1")

输出：view-online

​

​