Web Scraping with Puppeteer & Node.js: Chrome Automation
HTML-код
- Опубликовано: 24 июл 2024
- Join my premium 2024 bootcamp here learnwebcode.teachable.com/p/...
0:00 Intro
1:20 Installing Puppeteer
4:29 Taking a Screenshot
7:09 Scraping Text From HTML
15:34 Saving Images to Hard Drive
21:45 Clicking a Button
25:16 Filling Out a Form
30:51 Scheduling a Task to Repeat
The practice URL I'm working with in the video: learnwebcode.github.io/practi...
My finished example code: gist.github.com/LearnWebCode/...
Follow me for updates on new videos or projects:
Instagram: / javaschiff
Twitter: / learnwebcode
Facebook: / brad-schiff-1542576316...
Twitch: / learnwebcode
34:52 "Hope you feel like you learned something". Man, I learned a lot! Thank you!
Fantastic course and the automation part at the end is almost immediately applicable to me! You just instantaneously put yourself on my tech radar! Thank you, sir.
Hello. Your course was the first time I was able to follow along and not hit a snag. This was so much fun. Thank you.
Awesome, I just literally looking for this. Thanks Brad. Good to see you. 😁
Unlike some RUclipsrs on here you explain EVERYTHING. You make it so easy! Best teacher ever thankyou!
New favorite teacher. I actually have hated using javascript since 1998, but I have a reason to use Puppeteer. Great video!
This is really good. I started getting into this about a year ago, and coming back to it was a blur. It's all coming back to me now.
Perfect timing, I was looking for selenium and my favorite teacher has made a video on the similar tool. Great :)
Great video! As someone with 0 development experience who wanted to archive many images, this was perfect.
I tried web scraping in December 2020 but had no luck. I am very happy I found this video!
Every time I watch this , combo for towel under the keyboard & Mr. Barksalot makes my day , Brad ! :D
Very cool node pack. Thanks, Brad. I am taking your WP dev course. Enjoy it very much. The extra plugin lessons you added are a gem. Thanks so much! Let's keep things rolling. I will see you in the next RUclips video 😆
Thank you !
It was a great course !!
It helped me a lot, and I finally found answers to my questions.
You are amazing!! ❤️❤️❤️❤️❤️❤️
He explained the things that 99 percent of the youtubers don't share.
Your explanation is crystal clear. Thank you so much!!!
Great video! You explain the content very well. Thank you sharing your knowledge!
I'm on minute 6 and my jaw is on the floor already, this is exactly what I needed. Thank you!
Beautifully explained! Thank you!
Really enjoy the way you teach, I did learn something every time I watched, awesome ! Now I can practice, great
simple, clear, amazing ! Thank you for making this video
Great tutorial! Thank you for the video and for the code!
thanks so much for this.
i first heard about cron few years back while working with wordpress, i would definitely learn more about it.
Wow such a neat and clever code, I just could not resist to subscribe!
REALLY useful!!! Thank you so much from Buenos Aires, Argentina
this is a great video, and your explenations and examples are very good
Best video to understand puppeteer, hats off. Thanks for ur efforts
Your cat really does mewalot, this was very helpful to me in getting started with puppeteer
Great course! I had some trouble with $eval and $$eval before this now I totally get it. Thank you!
You always read my mind, and btw thanks for the WordPress course. Am now able to earn my living becoz of you.
LONG LIVE Brad.
I start learning puppeteer for a whatsapp project of mine and also some refresher of JS
Since I haven't code that much anymore, but I've to say that this was a very informative tuts.
Good Job!
Wow! this is exactly what I was looking for.
Thank you so much.
The best teacher forever 💪❤️
Amazing video man. Thanks for sharing the knowledge!
You are doing a wonderful job by giving Knowledge many thanks
this was a great tour of puppeteer. thanks!
Thank-you! Sir
Great Tutorial…
Clear in depth explanation!
thank you very much for your detailed explanation. One of the best teachers on youtube. BTW, how would you webscrape with web3 i.e. metamask required to see the info on page?
Very interesting subject and excellent teacher !
Excellent brother, very grateful to you 💜💜💜
Oh! What i was looking for. Thanks!😮
I had never tried puppeteer before because I thought it would be so hard... It turns out this is a breeze, thank you! Just my two cents on crons, we realistically are going to use PM2 to restart automatically the app if anything goes wrong, even if the physical server reboots... personally... I set up our express server and crons to be different entrypoints in the same codebase. I'm yet to see a problem with this approach (perhaps slightly hurt performance and node libs stability)
you're a great teacher, thanks!
thanks a lot man, you make it easy to follow and learn 🙏🙏
Really love the way you teach ❤️
oh FINALLY reeeally good tutorial on this topic
excellent tutorial ,it makes it so easy, thanks!
u r the only reason that i am still coding in js.
Brilliant!! Huge thanks and love 🙂💙💙
great way of expalining things.. thanks
Really Great Content !! Learnt Web Scraping with such ease !! Keep doing bro You jsut earned a Sub!!
Awesome tutorial, thank you!
I have watched full video. Wow so amazing...
Awesome, explained in details
BEST PUPPETEER VIDEO!
Very very nicely done!!! 👍👍👍👍
loved the video man - really helped me out
This video help me so much 💯 Thank you
Thank you so much man! Great explanation!:)
Wow nice to see you again
Amazing amazing tutorial!!!
Great explanation!
Great course!
Thanks for this amazing video sir!
This was a great tutorial!
35 minutes ran looking like 5 mins...great job explaining! thanks
Amazing content 🔥
Hi Brad, Thanks for this. I heard we can start a puppeteer browser and then control it remotely from JS, that would be a really nice tool to know.
Great tutorial. I am having an odd experience (which I assume is due to my lack of experience). I am getting a massive string of errors when I do this, but it still works. Like the output is what is expected. I have traced the errors back to possibility that I am using the wrong version of Node.JS (I am using the most current) but I don't know which version I should be using to squelch those errors or if it even matters. They are mostly navigation errors "Unable to navigate it invalid URL ..../puppeteer/common/Connection.js :230:24" etc... in the terminal.
it's a short video compared to other tutorials available on youtube. but its way better than those tutorials.
solid tutorial thanks man
Great vid, thanks for this
Thanks, great video.
I was trying to figure out the best way to copy images, current prices and other information from some online catalogs, and here you pop in with exactly what I need. But what I really want to know is how you got that code to scrape my thoughts. Thanks!
awesome this is mind-blowing
Hooo the best channel on the earth 🌍
Dude i bought a course on udemy about puppeteer and you explain more stuff on this topic smh. Thank you
Perfect bro thanks!
Thx! Awesome content!
What a great kickstarter tutorial. As someone who is using using web scraping to help me refresh my Javascript skills, this is exactly what I need to get a jump out of the gate.
Thank you very much Sir ...
Perfect explains
your cats meowing in the background made me think mine were in another room 😂
great tutorial! How would you crawl on the website using your "Scraping Text from HTML" part? Can you do a part 2 of this that shows us how to crawl with scraping?
I can hear meowsalot in the background. Maybe hungry. lol. Thank you for the tutorial. :)
Thank you very much.
Great tutorial. Very helpful. One question. I have a task that is extract data from website and then convert it to json I don't need to store those data instead I need to send it those data to another website via api rest. Any idea or suggestions is welcome.
my favourite teacher
Awesome Video Brad! Loved it. One note however. I am running Node JS version 17.1.0 and my node-cron failed without first installing a module called uuid. I'm assuming its a necessary dependency. npm install uuid did the trick. In case anyone else has this issue.
Can you show how we would add this data to an excel sheet after we automate it? This is very helpful! Thanks so much!!
Thanks for the video, please how do I prevent Puppeteer from clearing cookies and session data each time, I close the browser?
Thank you so much man. :) But could someone pls explain to me what the buffer method as seen at 20:52 exactly does? When do you use it? Thank you very much!
Please make a video or a blog an how can we open chrome with some extensions using puppereer
❤️❤️❤️ great sir
Nice Video!
thank you. how can we use jQuery insted of pure javascript?
Would doing the secret message task before the img task stop the images from properly loading? And if so how would you navigate back to collect those images?
Soo it means that you are planning a web scraping course?? I’m really waiting for that to happen ✨
this is gold
how do i add this to a WordPress custom post type that can take screenshots of other websites on every post type with its own different name
Thank you