AM I Missing out NOT Using Node for Web Scraping?

Поделиться
HTML-код
  • Опубликовано: 24 дек 2024

Комментарии • 42

  • @furrom152
    @furrom152 3 года назад +12

    Curly brackets denote objects in js/ts. You're calling it and array in multiple occasions. I know, it's nitpicking, but I think it could be confusing for beginners.

    • @JohnWatsonRooney
      @JohnWatsonRooney  3 года назад +6

      Yes your absolutely right thank you for mentioning it

  • @cgarafulic
    @cgarafulic 3 года назад +7

    There's a huge community of JS developers.
    I learned phyton, which by the way is an excellent programming language, due to the need of scraping some data.
    But 90% of my time I'm using JS.
    It would be great for the JS community, and for you as an expert in web scraping, to offer a new use case of the JS language.
    This is my humble advice as a JS developer.
    I am an avid follower of your channel, and I want to thank you for all the content you have shared to all your followers.

    • @JohnWatsonRooney
      @JohnWatsonRooney  3 года назад +2

      Thank you for watching! I am learning more and more JS as I go and I would love to put out more content using it, watch this space!

  • @katherinebaker3220
    @katherinebaker3220 3 года назад +2

    Still best webscraping author. Thank you, John!

  • @zakyvids6566
    @zakyvids6566 3 года назад +2

    Hi John I saw your comment from the previous video
    Great to hear that you are in the process of putting up a python crash course.
    As for this video it was great watching.

    • @JohnWatsonRooney
      @JohnWatsonRooney  3 года назад

      Thanks! I’ll make some posts when I’ve made some progress but I suspect it will be early 2022 release

  • @sheikh4awais
    @sheikh4awais 3 года назад +5

    Please make a complete course on web scraping with JavaScript and node. This video was helpful and easy to understand

    • @JohnWatsonRooney
      @JohnWatsonRooney  3 года назад +3

      I’d love to but it might be a while as I have lots of other things to finish, but good idea

    • @sheikh4awais
      @sheikh4awais 3 года назад +1

      @@JohnWatsonRooney we are eagerly waiting for it ♥

  • @PowerProd
    @PowerProd 2 года назад +2

    I prefer Node-fetch than axios personnally. You can copy the fetch request from the network tab in the dev tool ! Really nice when trying to get the hidden APIs

  • @fprocyon1
    @fprocyon1 3 года назад +1

    Nice video, Python is the winner

  • @tnssajivasudevan1601
    @tnssajivasudevan1601 3 года назад +1

    Great Sir. Very good info

  • @Adi-jr4xf
    @Adi-jr4xf 2 года назад

    I can't find the producttitle Id on amazon anymore ,did they change it ?

  • @AmodeusR
    @AmodeusR Год назад +1

    As a JS Developer, I feel like Python code is more lean and simple to understand. Because of the many brackets and methods it end being used, it may look more crowded and hence, complex.

    • @JohnWatsonRooney
      @JohnWatsonRooney  Год назад +1

      Python is a very simple language to read and understand and also pretty powerful in the right application!

  • @mohfatkurrozi4069
    @mohfatkurrozi4069 3 года назад +1

    Amazing man..

  • @bolatbekminbayev9217
    @bolatbekminbayev9217 3 года назад +1

    Thank you:) amazing content!

  • @hoseinmirian
    @hoseinmirian 2 года назад +1

    which one s faster a nd better do u think?

    • @JohnWatsonRooney
      @JohnWatsonRooney  2 года назад

      Python in my opinion. It's great for anything data.

  • @jonathanhammond5563
    @jonathanhammond5563 3 года назад

    I love this one. Curious how one does this on multiple pages on a website. I want to search for articles on a website that have playlists and make components with them

  • @Achiesamablog
    @Achiesamablog 3 года назад +2

    Nice, the fact that xpath is usable with cheerio is amazing since its not available on bs4.

    • @JohnWatsonRooney
      @JohnWatsonRooney  3 года назад +2

      Thanks but I was wrong, it doesn't support XPATH. Sorry I felt sure that it said it did!

  • @karthikshaindia
    @karthikshaindia 3 года назад +1

    Seems very interesting... Is it reliable JS sites?

    • @JohnWatsonRooney
      @JohnWatsonRooney  3 года назад +3

      It can do it but not this way, we would need to use puppeteer - I will cover that in another video soon!

    • @karthikshaindia
      @karthikshaindia 3 года назад

      Then will use an our existing patterns/method. Thanks!

  • @nelsontlima
    @nelsontlima 2 года назад +1

    I'm studying Node, but I am more used to python, so I decided to do web scraping in node for educational pourposes. Its important to mention that Axios has its limitations. It is an async function so, no matter if you put an "async/await" it won't return anything and it will always be "pending" wich is a pain in the ass... i didn't figure out how to fix this. So if you're gonna web scrape...maybe python is better. 😅

    • @JohnWatsonRooney
      @JohnWatsonRooney  2 года назад +2

      Good to know! I was exploring it for a learning process but yes Python is better for data stuff

    • @AmodeusR
      @AmodeusR Год назад

      I believe you need to await the result, but to await you need to have it in an async function. Maybe not anymore, but in the past, it used not to be possible to use async/await in the global scope. I'm not 100% sure, have you figure it out?

    • @nelsontlima
      @nelsontlima Год назад

      @@AmodeusR It was 8 months ago... I think I tried to do this at the time, but it didn't work at all, but I don't fully remember. At the time I was only checking Node out... I'm just more used to python to do data stuff. I don't use javaScript much. Someday if i go for a web project, maybe I'll study some more JavaScript.

    • @nikos4677
      @nikos4677 Год назад

      ​@@AmodeusRYou can do that on module.

  • @NotBeHaris
    @NotBeHaris 3 года назад +1

    Awesome

  • @sim7717
    @sim7717 3 года назад +3

    Please, keep creating videos on node js as well.

    • @JohnWatsonRooney
      @JohnWatsonRooney  3 года назад

      Cool, I’d like to cover more and different things

  • @kosmictea
    @kosmictea 3 года назад +1

    I need to use scrapy in my job, so still python :)

    • @JohnWatsonRooney
      @JohnWatsonRooney  3 года назад

      that's cool. can i ask what your job is?

    • @kosmictea
      @kosmictea 3 года назад +1

      @@JohnWatsonRooney I'm working for a startup that optimize SEO, initially I applied for machine learning engineer but the job need me to do scraping with scrapy, python automation development , some php and some javascript dev also. Have a lot to learn haha

  • @Interest_factory
    @Interest_factory 3 года назад +1

    Would really love if you do a video on Puppeteer.

    • @JohnWatsonRooney
      @JohnWatsonRooney  3 года назад

      Sure I was thinking about doing a “round up” style video on the popular headless browsers and the similarities and differences

  • @evalinor
    @evalinor 3 года назад +1

    my eyes are curling then i see js syntax xD but node js are awesome

    • @JohnWatsonRooney
      @JohnWatsonRooney  3 года назад

      Haha yes, I’m nowhere near as good with js as I am Python buts it’s getting there!