Scrapy Selenium - Scraping Javascript Rendered Websites (2022)

Поделиться
HTML-код
  • Опубликовано: 22 дек 2024

Комментарии • 10

  • @jawad237fx
    @jawad237fx Год назад +10

    if u are getting this error TypeError: WebDriver.__init__() got an unexpected keyword argument 'executable_path'
    i fixed it by downgrading selenium ver to 4.9 .
    if there is a way to make it work on the newer version let me know .

    • @SuperMauroBros1245
      @SuperMauroBros1245 Год назад

      Have you found a solution? I've got the same problem

    • @omyeole7221
      @omyeole7221 8 месяцев назад

      Thank you for solution

    • @harshshukla1363
      @harshshukla1363 7 месяцев назад

      pip install selenium==4.9 should fix the problem

  • @spotshot7023
    @spotshot7023 2 года назад +3

    How to handle pagination in this library?

  • @kineticraft6977
    @kineticraft6977 3 месяца назад

    So let’s say I’m running this in a docker container and there’s only command line. Do I still need to install chrome to get the chrome driver to work? Is there something else that needs to be done? And does it have to be Google chrome or can chromium be used with the chrome driver?

  • @gracyfg
    @gracyfg 7 месяцев назад

    if you say selenium scrapy is not reliable which one can we use with scrapy for javascript sites on windows. Playwright is also not reliable..

  • @filip3195
    @filip3195 2 года назад

    How to use this "from webdriver_manager.chrome import ChromeDriverManager" and
    "from selenium.webdriver.chrome.service import Service"? in scrapy-selenium ?
    When i use only selenium is easy,just import above in code without to edit settings
    Because webdriver '' somepath" is always messy,and always give me output new version not suport weebdriver path

  • @shakirbhai1581
    @shakirbhai1581 Год назад

    When I use this method for another website, it through me error. Errorutils caught an errorErrorutils

    • @shakirbhai1581
      @shakirbhai1581 Год назад

      Please provide the solution i will wait your answer