我是Python新手,所以如果这是一个简单的问题,请原谅我。
我正在网上使用Selenium从Linkedin上抓取整个体验部分。以下是我的相关代码:
from time import sleep
from selenium import webdriver
ChromeOptions = webdriver.ChromeOptions()
driver = webdriver.Chrome('/Users/jones/Downloads/chromedriver')
driver.get('https://www.linkedin.com/in/pauljgarner/')
##writing 'Name' to excel
writer = csv.writer(open(parameters.file_name, 'w', encoding='utf8'))
writer.writerow(['Name'])
name = sel.xpath('normalize-space(//li[@class="inline t-24 t-black t-normal break-words"])').extract_first()
writer.writerow([name])
##scraping the entire work experience section:
experience = driver.find_elements_by_xpath('//section[@id = "experience-section"]/ul//li')
for item in experience:
print(item.text)
print("")我从“体验”部分获得的输出是如下所示的文本列表:
Freelance Python Developer
Company Name
Depop
Dates Employed
Jun 2015 – Present
Employment Duration
4 yrs 11 mos
Location
London, United Kingdom
Python development using: Django, PostgreSQL, ElasticSearch, TensorFlow, Redis, gevent, Mongodb, Django REST Framework我想把这个输出写到我用来捕获'Name‘的excel表中。
我要寻找的excel格式如下:
Name Title CompanyName DatesEmployed EmploymentDuration Location Description
Paul Freel.. Depop Jun 2015 – P.. 4 yrs 11 mos London Python Dev..问题是,我不知道如何将我从experience部分中抓取的文本列表转换为我前面用特定元素(带有'Names')定义的同一个Excel表。
发布于 2020-04-02 03:56:48
尝试如下:
from selenium import webdriver
ChromeOptions = webdriver.ChromeOptions()
driver = webdriver.Chrome('/home/shubham/Downloads/chromedriver')
driver.get('https://www.linkedin.com/in/pauljgarner/')
rows = []
name = sel.xpath('normalize-space(//li[@class="inline t-24 t-black t-normal break-words"])').extract_first()
experience = driver.find_elements_by_xpath('//section[@id = "experience-section"]/ul//li')
rows.append([name])
for item in experience:
rows[0].append(item)
print(item.text)
print("")
with open(parameters.file_name, 'w', encoding='utf8') as file:
writer = csv.writer(file)
writer.writerows(rows)https://stackoverflow.com/questions/60983670
复制相似问题