无法使用Selenium登录Quora

Question

我使用Selenium来抓取一些数据(根据条款和条件)，但是我首先需要登录。我有以下代码，名称来自firefox中的inspect元素：

from selenium import webdriver
from selenium.webdriver.common.keys import Keys
from selenium import webdriver
from selenium.webdriver.common.by import By
from selenium.webdriver.support.ui import WebDriverWait
from selenium.webdriver.support import expected_conditions as EC

driver = webdriver.Firefox()
driver.get("https://www.quora.com/")
elem="";
try:
    elem = WebDriverWait(driver, 10).until(
        EC.presence_of_element_located((By.NAME, "email"))
    )
finally:
    driver.quit()
elem.send_keys("email")
try:
    elem = WebDriverWait(driver, 10).until(
        EC.presence_of_element_located((By.NAME, "password"))
    )
finally:
    driver.quit()
elem.send_keys("password")
elem.send_keys(Keys.ENTER)

然而，selenium一直告诉我：

socket.error: [Errno 10061] No connection could be made because the target machine actively refused it

为什么会这样呢？

Answer 1

您不应该在您的web-刮取浏览器会话中调用quit() -您基本上关闭浏览器，然后继续向它发送命令，这将导致套接字错误。

相反，将所有代码放到try/finally下面

try:
    elem = WebDriverWait(driver, 10).until(
        EC.presence_of_element_located((By.NAME, "email"))
    )
    elem.send_keys("email")

    elem = WebDriverWait(driver, 10).until(
        EC.presence_of_element_located((By.NAME, "password"))
    )
    elem.send_keys("password")
    elem.send_keys(Keys.ENTER)
finally:
    driver.quit()

selenium.common.exceptions.ElementNotVisibleException:消息:元素当前不可见，因此可能无法与

对于这个问题，原因是页面上有多个带有name="email"和name="password"的元素。你正在寻找一个无形的，并试图与它互动。您应该改进您的定位器，并使其更加具体：

elem = WebDriverWait(driver, 10).until(
    EC.presence_of_element_located((By.CSS_SELECTOR, ".regular_login [name=email]"))
)
elem.send_keys("email")

elem = WebDriverWait(driver, 10).until(
    EC.presence_of_element_located((By.CSS_SELECTOR, ".regular_login [name=password]"))
)

elem.send_keys("password")
elem.send_keys(Keys.ENTER)