Fantastic course and the automation part at the end is almost immediately applicable to me! You just instantaneously put yourself on my tech radar! Thank you, sir.
I start learning puppeteer for a whatsapp project of mine and also some refresher of JS Since I haven't code that much anymore, but I've to say that this was a very informative tuts. Good Job!
What a great kickstarter tutorial. As someone who is using using web scraping to help me refresh my Javascript skills, this is exactly what I need to get a jump out of the gate.
Very cool node pack. Thanks, Brad. I am taking your WP dev course. Enjoy it very much. The extra plugin lessons you added are a gem. Thanks so much! Let's keep things rolling. I will see you in the next RUclips video 😆
I was trying to figure out the best way to copy images, current prices and other information from some online catalogs, and here you pop in with exactly what I need. But what I really want to know is how you got that code to scrape my thoughts. Thanks!
I had never tried puppeteer before because I thought it would be so hard... It turns out this is a breeze, thank you! Just my two cents on crons, we realistically are going to use PM2 to restart automatically the app if anything goes wrong, even if the physical server reboots... personally... I set up our express server and crons to be different entrypoints in the same codebase. I'm yet to see a problem with this approach (perhaps slightly hurt performance and node libs stability)
Thank you so much man. :) But could someone pls explain to me what the buffer method as seen at 20:52 exactly does? When do you use it? Thank you very much!
thank you very much for your detailed explanation. One of the best teachers on youtube. BTW, how would you webscrape with web3 i.e. metamask required to see the info on page?
Great tutorial. I am having an odd experience (which I assume is due to my lack of experience). I am getting a massive string of errors when I do this, but it still works. Like the output is what is expected. I have traced the errors back to possibility that I am using the wrong version of Node.JS (I am using the most current) but I don't know which version I should be using to squelch those errors or if it even matters. They are mostly navigation errors "Unable to navigate it invalid URL ..../puppeteer/common/Connection.js :230:24" etc... in the terminal.
Great tutorial. Very helpful. One question. I have a task that is extract data from website and then convert it to json I don't need to store those data instead I need to send it those data to another website via api rest. Any idea or suggestions is welcome.
This is good video. Best teacher. But can we us this technic on server side pages ND can we use this puppeteer to download a whole webpage file? If yes how can we do that?
Would doing the secret message task before the img task stop the images from properly loading? And if so how would you navigate back to collect those images?
great tutorial! How would you crawl on the website using your "Scraping Text from HTML" part? Can you do a part 2 of this that shows us how to crawl with scraping?
for some reason i had to do this for this to run "await fs.writeFile("names.txt", (await names).join(" "))? I kept getting a names not a function error?
Awesome Video Brad! Loved it. One note however. I am running Node JS version 17.1.0 and my node-cron failed without first installing a module called uuid. I'm assuming its a necessary dependency. npm install uuid did the trick. In case anyone else has this issue.
When I open a URL using puppeteer it loads faster. And it uses so much RAM and CPU (in heavy scraping). So I decided to programatically call URL using request.js library. Reading responses, saving cookies into variables, calling each link of images or whatever, one-by-one. But it is slow. Puppeteer loads everthing in that page, things that I dont need. Whereas in manual method, I call only essential links. Then why puppeteer is fast, and my method is slow? Theoratically my method should be the fastest, right? Please help.
![Seungmin "그렇게, 천천히, 우리(As we are)" | [Stray Kids : SKZ-PLAYER]](http://i.ytimg.com/vi/kAzmhLHePqU/mqdefault.jpg)
34:52 "Hope you feel like you learned something". Man, I learned a lot! Thank you!
Fantastic course and the automation part at the end is almost immediately applicable to me! You just instantaneously put yourself on my tech radar! Thank you, sir.
Unlike some RUclipsrs on here you explain EVERYTHING. You make it so easy! Best teacher ever thankyou!
Hello. Your course was the first time I was able to follow along and not hit a snag. This was so much fun. Thank you.
New favorite teacher. I actually have hated using javascript since 1998, but I have a reason to use Puppeteer. Great video!
I tried web scraping in December 2020 but had no luck. I am very happy I found this video!
You always read my mind, and btw thanks for the WordPress course. Am now able to earn my living becoz of you.
LONG LIVE Brad.
I'm on minute 6 and my jaw is on the floor already, this is exactly what I needed. Thank you!
Every time I watch this , combo for towel under the keyboard & Mr. Barksalot makes my day , Brad ! :D
This is really good. I started getting into this about a year ago, and coming back to it was a blur. It's all coming back to me now.
Awesome, I just literally looking for this. Thanks Brad. Good to see you. 😁
The best teacher forever 💪❤️
Great video! As someone with 0 development experience who wanted to archive many images, this was perfect.
Perfect timing, I was looking for selenium and my favorite teacher has made a video on the similar tool. Great :)
Your cat really does mewalot, this was very helpful to me in getting started with puppeteer
I start learning puppeteer for a whatsapp project of mine and also some refresher of JS
Since I haven't code that much anymore, but I've to say that this was a very informative tuts.
Good Job!
You are amazing!! ❤️❤️❤️❤️❤️❤️
He explained the things that 99 percent of the youtubers don't share.
Best video to understand puppeteer, hats off. Thanks for ur efforts
u r the only reason that i am still coding in js.
Really enjoy the way you teach, I did learn something every time I watched, awesome ! Now I can practice, great
Your explanation is crystal clear. Thank you so much!!!
REALLY useful!!! Thank you so much from Buenos Aires, Argentina
Wow such a neat and clever code, I just could not resist to subscribe!
Thank you !
It was a great course !!
It helped me a lot, and I finally found answers to my questions.
Beautifully explained! Thank you!
What a great kickstarter tutorial. As someone who is using using web scraping to help me refresh my Javascript skills, this is exactly what I need to get a jump out of the gate.
35 minutes ran looking like 5 mins...great job explaining! thanks
Very cool node pack. Thanks, Brad. I am taking your WP dev course. Enjoy it very much. The extra plugin lessons you added are a gem. Thanks so much! Let's keep things rolling. I will see you in the next RUclips video 😆
Great course! I had some trouble with $eval and $$eval before this now I totally get it. Thank you!
Very interesting subject and excellent teacher !
oh FINALLY reeeally good tutorial on this topic
this is a great video, and your explenations and examples are very good
simple, clear, amazing ! Thank you for making this video
it's a short video compared to other tutorials available on youtube. but its way better than those tutorials.
You are doing a wonderful job by giving Knowledge many thanks
Great tutorial! Thank you for the video and for the code!
Wow! this is exactly what I was looking for.
Thank you so much.
I was trying to figure out the best way to copy images, current prices and other information from some online catalogs, and here you pop in with exactly what I need. But what I really want to know is how you got that code to scrape my thoughts. Thanks!
Amazing video man. Thanks for sharing the knowledge!
Great video! You explain the content very well. Thank you sharing your knowledge!
Excellent brother, very grateful to you 💜💜💜
this was a great tour of puppeteer. thanks!
your cats meowing in the background made me think mine were in another room 😂
BEST PUPPETEER VIDEO!
thanks so much for this.
i first heard about cron few years back while working with wordpress, i would definitely learn more about it.
you're a great teacher, thanks!
Oh! What i was looking for. Thanks!😮
Thank-you! Sir
Great Tutorial…
Clear in depth explanation!
I had never tried puppeteer before because I thought it would be so hard... It turns out this is a breeze, thank you! Just my two cents on crons, we realistically are going to use PM2 to restart automatically the app if anything goes wrong, even if the physical server reboots... personally... I set up our express server and crons to be different entrypoints in the same codebase. I'm yet to see a problem with this approach (perhaps slightly hurt performance and node libs stability)
Really Great Content !! Learnt Web Scraping with such ease !! Keep doing bro You jsut earned a Sub!!
Really love the way you teach ❤️
loved the video man - really helped me out
Dude i bought a course on udemy about puppeteer and you explain more stuff on this topic smh. Thank you
I actually died on "This is top secret text. The world is not ready to know that 2 + 2 = 4" :D
rip
Thank you so much man. :) But could someone pls explain to me what the buffer method as seen at 20:52 exactly does? When do you use it? Thank you very much!
I have watched full video. Wow so amazing...
thank you very much for your detailed explanation. One of the best teachers on youtube. BTW, how would you webscrape with web3 i.e. metamask required to see the info on page?
thanks a lot man, you make it easy to follow and learn 🙏🙏
Wow nice to see you again
Awesome, explained in details
excellent tutorial ,it makes it so easy, thanks!
Very very nicely done!!! 👍👍👍👍
great way of expalining things.. thanks
I can hear meowsalot in the background. Maybe hungry. lol. Thank you for the tutorial. :)
Thank you so much man! Great explanation!:)
This video help me so much 💯 Thank you
Hooo the best channel on the earth 🌍
Just amazing stuff ❤❤
Great tutorial. I am having an odd experience (which I assume is due to my lack of experience). I am getting a massive string of errors when I do this, but it still works. Like the output is what is expected. I have traced the errors back to possibility that I am using the wrong version of Node.JS (I am using the most current) but I don't know which version I should be using to squelch those errors or if it even matters. They are mostly navigation errors "Unable to navigate it invalid URL ..../puppeteer/common/Connection.js :230:24" etc... in the terminal.
Awesome tutorial, thank you!
Thanks for the video, please how do I prevent Puppeteer from clearing cookies and session data each time, I close the browser?
From 16:00 there is that Meawsalot, you hear it too? First I thought it was outside my door...
Thanks for this amazing video sir!
Brilliant!! Huge thanks and love 🙂💙💙
Amazing amazing tutorial!!!
Great tutorial. Very helpful. One question. I have a task that is extract data from website and then convert it to json I don't need to store those data instead I need to send it those data to another website via api rest. Any idea or suggestions is welcome.
This was a great tutorial!
Please make a video or a blog an how can we open chrome with some extensions using puppereer
Hi Brad, Thanks for this. I heard we can start a puppeteer browser and then control it remotely from JS, that would be a really nice tool to know.
Great explanation!
Amazing content 🔥
Great course!
solid tutorial thanks man
Soo it means that you are planning a web scraping course?? I’m really waiting for that to happen ✨
This is good video. Best teacher. But can we us this technic on server side pages ND can we use this puppeteer to download a whole webpage file? If yes how can we do that?
my favourite teacher
What script do I need to type if I want to close the pop up page that appears after clicking submit button? Or go back to previous page?
Great vid, thanks for this
Would doing the secret message task before the img task stop the images from properly loading? And if so how would you navigate back to collect those images?
How do I accept user input or get it from mysql database then use that to login in a website.
how do i add this to a WordPress custom post type that can take screenshots of other websites on every post type with its own different name
great tutorial! How would you crawl on the website using your "Scraping Text from HTML" part? Can you do a part 2 of this that shows us how to crawl with scraping?
for some reason i had to do this for this to run "await fs.writeFile("names.txt", (await names).join("
"))? I kept getting a names not a function error?
Can you show how we would add this data to an excel sheet after we automate it? This is very helpful! Thanks so much!!
If you need more power and scalability - make sure to give a shot to open-sourced Apify SDK ;-)
How to wait for manual typing captcha login page and after typing automatically login? Please do a tutorial node js puppetteer.
Hey, what's your terminal in vscode ? Why is it so nice 😁
Awesome Video Brad! Loved it. One note however. I am running Node JS version 17.1.0 and my node-cron failed without first installing a module called uuid. I'm assuming its a necessary dependency. npm install uuid did the trick. In case anyone else has this issue.
When I open a URL using puppeteer it loads faster. And it uses so much RAM and CPU (in heavy scraping).
So I decided to programatically call URL using request.js library. Reading responses, saving cookies into variables, calling each link of images or whatever, one-by-one. But it is slow.
Puppeteer loads everthing in that page, things that I dont need. Whereas in manual method, I call only essential links.
Then why puppeteer is fast, and my method is slow?
Theoratically my method should be the fastest, right? Please help.
As it navigates to new page . We want to get every single text on the new page. How can we achieve that