使用puppeteer访问web抓取返回的数组的特定索引

Question

这是我的脚本-它抓取amazon以使用puppeteer检查产品的可用性

const puppeteer = require('puppeteer');


//URL
scrape('https://www.amazon.co.uk/PlayStation-9395003-5-Console/dp/B08H95Y452/ref=sr_1_1?dchild=1&keywords=ps5&qid=1613570801&sr=8-1');

/**
 *
 * Scrape PS5
 *
 */
async function scrape(url)
{

    const browser = await puppeteer.launch();
    const page = await browser.newPage();
    await page.goto(url);

        //get availability
        const [el2] = await page.$x('//*[@id="availability"]/span');
        const txt1 = el2.getProperty('textContent');
        const rawTxt1 = (await txt1)._remoteObject.value;

        //log data
        console.log({rawTxt1});

        //close browser
        browser.close();

}

在我登录后，它会将其返回到控制台

​

​

我希望它只返回“当前不可用”。

Answer 1

尝尝这个

async function scrape(url)
{

    const browser = await puppeteer.launch();
    const page = await browser.newPage();
    await page.goto(url);
    await page.waitForSelector("div#availability")
    const  result = await page.evaluate(()=>{
        return Array.from(document.querySelectorAll("div#availability span.a-size-medium")).map((el)=> el.innerText)
    });
    //log data
    console.log(result)

        //close browser
        browser.close();

}

输出：

["Currently unavailable."]