Web Scraping With Javascript (Puppeteer Tutorial)
HTML-код
- Опубликовано: 16 окт 2024
- Learn puppeteer in less than one hour. Since I had to take down 3 of the videos I had on my puppeteer series I decided to make this video. I will go over the basics of web scraping and browser automation in NodeJS.
🚀 Learn ReactJS By Building 6 Projects: codedamn.com/l...
Social
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
Website: machadopedro.com
Linkedin: / machadop1407
Instagram: / _pedro.machado_
Github: github.com/mac...
Email: machadop1407@gmail.com
Tags:
Puppeteer
Web Scraping
NodeJS Tutorial
API Tutorial
Estou maratonando seu canal e feliz por ter encontrado ele. Você ensina mto melhor q varios professores de curso q eu paguei pra ter, parabéns pela didática e pelo conteúdo q você vem trazendo.
Muito obrigado Luiz! Fico feliz :)
Awesome videos man, congratulations and thanks for your so clear explanation on all of them!
Awesome explanation man... After looking to more than 10 videos about web scraping i can definitely say your is the best
One of the best tutorials on this, well done!
You don't need that weird function syntax Pedro? you can just create an async arrow function and then put everything inside that and make sure to call that function outside of it to initialize it once you finished your scraping.
Always the best place to start learning something new
Thanks for this, bro! I've been trying to find a decent course on web scraping with nodejs but most suck!
Thank you so much dude. Amazingly explained and well structured video. Keep it up 🎉
Very concise and easy to follow. Great video.
Best video for puppeteer.. Great Video! Thank you
At last I found a reason of why your 2 puppeteer tutorial is missing .. :D
Yeah, i felt really bad cause i really liked that series hahaha
Maybe you can upload it as private and share the link to it in this videos description
I wounder what the legality is if you plan to offer a scraping service on fiverr and one of your clients ask to scrape data on a website that doesn't allow scraping? how can you find if a website doesn't or allows web scraping? i looked on some terms of uses and privacy policies but can't find any hits when using find and searching keywords like scraping, web scraping ect.
Pretty simple to understand, good job!
Thanks , very concise way of teaching and fun to follow
Hey Pedro, amazing tutorial. How to add realtime notifications to this scraping.Is is possible
awesome tutorial man! Can you do one where you crawl and scrape? I am new to all of this and with you learned the scraping part thanks.
Great explanation, subscribed!
Thanks for this one as well, Pedro!
I love this video, thank you so much for all the informations.
Please make a video on apollo server express backend and nextjs ssr with authentication with cookies apollo client. It will be a good one. And thanks for quality contents
What about using js path of xpath to find specific button?
very insightful dude
Thx so much, you've got new subscriber!
THIS IS SO SICK THANK YOU🚀
nice explanation , thnx from INDIA
thank you for a such good videos you publish
Thanks man, this was very helpfull
how do u deal with pagination. For example I want to scrape Amazon books and there's 50 pages each with books and I want to grab all books across 50 pages
enjoyed it ,great work
Very nice video, can you maybe make one on how to scrape SPA's?
Awesome tutorial …can you explain how to access HTML elements style lik font family,size,color,width,…etc
How would you cycle through and click all of the buttons on a page that all have the same class?
great ! how can I copy the data obtained, inside a html div, instead of viewing it, in console. thanks
Great stuff. Thank you
how to click checkbox hCaptchs and select images ?? can you make it a video???
Awesome !
Goat
How to grab the data using its custom attribute?
Super cooool
Great Video, broh, but I come to think "hell, what a brazilian name you've got" hahaha
Eu sou brasileiro kkkkkkkk
@@PedroTechnologies imaginei KKKKKKK
Thanks for video really good
I rececived an error:failed to launche the browser process.PLease help me
I wonder if RUclips allows webscraping it
Thank You
thank you for this
Thanks
Nice Video 👍🏼 I was looking for such type of content from long time. Thanks you're Amazing 🤗. Please continue the series on puppeteer.
Thank you Rahul! I really appreciate the support!
i love you man
some websites disable document object as a result it is impossible to scrap data from that, could show us how to resolve it ?
You can easily add a user agent to puppeteer which fixes this. I go over it in my other puppeteer series. I should have mentioned it in this video :)
@@PedroTechnologies waiting for that
Is your website down?
Can u do with captcha
Hello sir Please help me building product comparison website using web scraping in javascript please make video on it
The tutorial is good but the only thing that I didn't like is that you didn't use ".quote > span.text" to get the quotes themselves directly yet instead, you wrote extra lines of code to get that. Also to get the author info, ".quote > span > .author" or ".quote .author" could have been used.
awesome
can you make next video on MERN stack
nice
Can be solve epub to html
Are you portuguese?
Your website is down :(
Instead of series bring a full length crash course
great tutorial only problem was I couldn't get it to work on edge browser cause I refuse to get chrome, I used puppeteer-core, and edge-paths which is recommend for edge and imported my executablePath property to the browser await function and still nothing, looked all over could't find a solution.
simple solution, sto refusing to get chrome
I am trying very hard to learn mern by my own but i got struck while storing jwt auth token on cookie... It is not storing any cookie while making post rqst in node js....
Plss pedro if u can help me anyhow
Thank You
in last example I tried to logout after the login using
await page.click('a[href="/logout"]');
but it didn't work, it worked when I copy pasted it 2 times. why is it not working with only a single line??
May I suggest something that might be stupid? Try to give it a few moments before performing the action. Set a timeout of a few seconds and check if it works that way. I might be completely wrong but I think it has something to do with the action being asychronous. Again, this might be wrong, but it's worth a try if you have time.