用BeautifulSoup抓取图片

Question

我正在尝试使用BeautifulSoup从一个网站上抓取和下载图片。我已经抓取了存储在imgVal中的链接列表，然后代码可以创建一个新的目录来存储图像。我遇到的问题是代码只能从链接列表中下载一张图片。我想把它们全部下载。我怎样才能做到这一点？

from bs4 import BeautifulSoup
from os.path import basename
import requests
import os

...

def writeImages():
    imgVal = getThumbnailLinks()
    imgBasename = '\n'.join(map(str, imgVal))

    pageNumber = '001'
    filename = pageNumber + '/'
    os.makedirs(os.path.dirname(filename), exist_ok=True)

    with open(filename + basename(imgBasename),"wb") as f:
        f.write(requests.get(imgBasename).content)

writeImages()

Answer 1

那么您想下载多行URL作为requests的输入吗？你不能，你必须一个一个地用循环来做。

def writeImages():
    pageNumber = '001'
    filename = pageNumber + '/'
    os.makedirs(os.path.dirname(filename), exist_ok=True)

    imgVal = getThumbnailLinks() # ['http://a.jpg', 'http://b.jpg']
    for imgBasename in imgVal:
        with open(filename + basename(imgBasename),"wb") as f:
            f.write(requests.get(imgBasename).content)

writeImages()