You need not write a callback function to wait the page. There is a waitfor function in which you can pass miliseconds to wait the page. Like - page.waitFor(5000) Then it wait for 5 sec. Before close the browser.
thank you, sir, apse Mai bahut inspire Hua hu, main web development chorna chahta tha, apke videos dekh karke bahut kuch sikhnane aur janne ko milta hai, thanks you for teaching us. love from Chhattisgarh😘😘
Don't try to web scrap popular websites(fb, twitter, LinkedIn). They'll ban your ip and you can even get into trouble for scraping data. Scraping comes with a lot of risk. And there is nothing to worry about scraping publicly available data on the internet or from websites not configured properly.
Great tutorial. I like the way you demonstrate the flexibility of puppeteer and explain the documentation. I actually have a running start on how to scrape web pages in JS. Way more dynamic than python scraping. Thanks!
Its crisp video I loved,it will be great if architecture is explained along with how it works which already explained beautifully Thank you very much Could you please take CodeceptJS as next topic
Hey Hitesh, the video is slightly down (noisy, to be precise). May be camera settings are not good. Have a look. And apart from that, the content is on the infinite quality. Thanks for this great work!!!
Amazing video sir, I am software tester , and i know only selenium+java and protractot+javascript but I was not aware about papeteer, i will definitely try this Thanks (Automate World)
Awesome. I request you do deep webscraping with this and save that to database please. That's my request for next video . Thank you Sir and it's always great stuff from you
Hey @Hitesh Choudhary, nice tutorial! Got stuck, how do I do this - 1. Open a webpage (you see list of items) 2. Click an item - you go inside item detail page 3. Extract data from the detail page (like name, desc, images...) 4. Now store all this data as a markdown file (.md) with the item name as the file name 5. Repeat the same for 300+ items P.S. the class names are complex(with weird names and numbers). How do I use the same with XPATH? Thanks in advance!
i'm having some issues. first off all: "throw new errors.TypeError('ERR_INVALID_ARG_TYPE', 'original', 'function');" TypeError [ERR_INVALID_ARG_TYPE]: The "original" argument must be of type function
Hey Hitesh I saw your RUclips video about Web automation in python for beginners. It was very interesting but what I want to do is open windows clicking a link then clicking for a specific item and every time I click that link the item is in another spot so I might even have to go to the next page to find it. I do this a lot but it’s a lot of work, if you could show me how to automate it that would be awesome!
I'm curious how to set multiple threads (browsers) in Puppeteer Stealth. Also how do I load resources as variables so i can fill out sign up forms with those variables?
Please anybody can help,, for example i have login to a website thant shows certain data in javascript tabel,, ini the dropdownlist menu,, there are only three option of number of showing data, which are 10, 50, and 100. How to for example i want to show all the data not only 100 data. But all the data that i search with certain criteria. Thanks
I started to learn coding.The way you teach made me fall with them. My question is you usually use the word terminal..what is meant for ? As I am a beginner I don't get what it is!
A terminal is dependant on the server. Often seen in the wild as a monitor and keyboard alone. Maybe a small bit of hardware. In this video usage it appears to be referring to the apple name for a command prompt interface.
Can we make some file manager with it , that copy and move file to certain folder when our work done. I think that's interesting and useful for small automation projects too.
Dear sir, is puppeteer good or selenium is good for web automation / web scrapping? Please reply to my question. I did not listen selenium in your videos. I have listen lot of your videos.
im stuck at the first bit, i run the code for getting a snapshot of wiki but it just says Error: Cannot find module 'puppeteer' EDIT: NVM im an idiot and installed puppeteer core instead of of puppeteer
Well it's funny that I am watching this video at 3 am after trying multiple applications that actually didn't work. All I need is to automate several actions, I have tried iMacros, CAB and UI.Automation, maybe I'm just too stupid to use them properly lol. So, I have a question. I have a web page, I need to copy the information from one field (it doesn't look like a field, just one or two words) to another field, I have thousands of such pages (every time I need to copy and paste different information) and I want to automate these actions, because they are very time consuming. Maybe you can recommend me a good tutorial based on JS? I am have 0 coding skills, about 2 years ago I just tried to learn something in JS lol.
Sir...can we perform same action or operation on 2 or more tabs(all tab contains same website) at the same time(simultaneously) with help of selenium automation?
If you create an application with this code, will it not be really weird for a user to see some browser open and close very quickly? It is headless, but I think users will notice something happening?
I have used puppeteer to generate PDF in node js for my college project . It's really nice to work with.
I love coding and You helped me to fall in love with coding.
Bro, he is an example of a true teacher!!! (DRONACHARYA)
Make more video on Automation Testing
me also
Usage examples:
> Array.from(document.querySelectorAll('.mw-headline')).map( h => h.innerText);
> [...document.querySelectorAll('.mw-headline')].map( h => h.innerText);
what is the name of the outro song
Nice introduction!
10:55 doing $$(".mw-headline").map(h => h.innerText) can get you there quicker.
You need not write a callback function to wait the page. There is a waitfor function in which you can pass miliseconds to wait the page.
Like - page.waitFor(5000)
Then it wait for 5 sec. Before close the browser.
Thanks
@@HiteshCodeLab or you can just remove browser close function
thank you, sir, apse Mai bahut inspire Hua hu, main web development chorna chahta tha, apke videos dekh karke bahut kuch sikhnane aur janne ko milta hai, thanks you for teaching us. love from Chhattisgarh😘😘
आपका बहुत बहुत धन्यवाद ,हितेश जी वीडियो बनाने के लिए।
Don't try to web scrap popular websites(fb, twitter, LinkedIn). They'll ban your ip and you can even get into trouble for scraping data. Scraping comes with a lot of risk. And there is nothing to worry about scraping publicly available data on the internet or from websites not configured properly.
Thanks for valuable information.
@@HiteshCodeLab :)
I scrape the shit out of facebook all the time.
Need to learn more of this stuff. 99.99% of my job can literally be automated.
Wow -- that sample wikipedia page aged pretty well.
lol for real !
Wow covid19 in feb 2020 - def look more into this - wise words, wish more people did this one year ago !!!
Lovely content
A small trick for youtubers: go to the end of the video and play restart to avoid ads.
And yeah "You are welcome" 😅😜
just use a adblocker instead and what's the name of the outro song
This guy won't get any revenue tho :(
Very Good to hear automation related stuff through you.. Hitesh garu .. Keep posting..
That was great tutorial you don’t need to be criticise yourself your doing great!
Great tutorial. I like the way you demonstrate the flexibility of puppeteer and explain the documentation. I actually have a running start on how to scrape web pages in JS. Way more dynamic than python scraping. Thanks!
Woah, today I decided to learn puppeteer and was going through docs, and guess what, your video notification pops up. Jinx
This was an amazing video.
You did an amazing job!
Its crisp video I loved,it will be great if architecture is explained along with how it works which already explained beautifully Thank you very much
Could you please take CodeceptJS as next topic
That explanation was rlly great
Thank you Hitesh, very helpful!
I have used puppeteer for my eCommerce website scraping project. It is an amazing library.❤️
For sure more videos on Puppeteer.
Which theme are you using in VS code?
Ahh, good ole Corona in February 2020. Good times, good times.
Amazing👍🏻😍
Love from Nepal❤
Yes please create series on Puppeteer. Will be waiting for same.
You're really a great teacher!
Thanks for this video. Help me much. Keep it up man
I really enjoyed your lesson 😊🙏
Awesome! Thanks very much.
Nice video. love from Bangladesh
Hey Hitesh, the video is slightly down (noisy, to be precise). May be camera settings are not good. Have a look. And apart from that, the content is on the infinite quality. Thanks for this great work!!!
Thanks for comment. Can you please let me know the time of noise.
Is it in screen recording part or intro part.
I will surely fix it
@@HiteshCodeLab The screen recording is a bit blurry & the Normal full screen video (intro) have a little bit of noise.
@@HiteshCodeLab i just realized that, there's no quality down noticed in mobile view, but when we switch to 1080p monitor it seems to be as described.
Yes.. More videos on Web Automation are welcome.
Please continue your videos with web automation
You're the best!!! thank you thank you thank you!!
Video on integrating payment gateway in the website
Yes I want more video like this.
Thanks for your presentation about puppeteer, please make more videos on the same
Amazing.. Please make more such videos
Informative video.thanks for sharing
Which vscode theme are you using ?
Same thing i need to know
More such videos sir please
Sir I was looking forward for this kind of video.. your way of explaining is very easy to grasp
Great tutorial! Thank you.
Amazing video sir,
I am software tester , and i know only selenium+java and protractot+javascript but I was not aware about papeteer, i will definitely try this
Thanks
(Automate World)
I want more videos on JavaScript and NodeJs.
Awesome. I request you do deep webscraping with this and save that to database please. That's my request for next video . Thank you Sir and it's always great stuff from you
Thank you very much! this video summerized the Puppeteer idea for a beginner.
Hey @Hitesh Choudhary, nice tutorial!
Got stuck, how do I do this -
1. Open a webpage (you see list of items)
2. Click an item - you go inside item detail page
3. Extract data from the detail page (like name, desc, images...)
4. Now store all this data as a markdown file (.md) with the item name as the file name
5. Repeat the same for 300+ items
P.S. the class names are complex(with weird names and numbers). How do I use the same with XPATH?
Thanks in advance!
Love from Egypt 💗❤💗
Yeah Definitely web scraping. Thanks
i'm having some issues.
first off all: "throw new errors.TypeError('ERR_INVALID_ARG_TYPE', 'original', 'function');"
TypeError [ERR_INVALID_ARG_TYPE]: The "original" argument must be of type function
please help
nice one, but why didnt you use selenium, here, since it is popular for automation. which one is better "puppeter" or "selenium"
amazing explanation
for each new project we will have to write npm init -y
and npm install puppeteer for once?
Hey Hitesh I saw your RUclips video about Web automation in python for beginners. It was very interesting but what I want to do is open windows clicking a link then clicking for a specific item and every time I click that link the item is in another spot so I might even have to go to the next page to find it. I do this a lot but it’s a lot of work, if you could show me how to automate it that would be awesome!
I'm curious how to set multiple threads (browsers) in Puppeteer Stealth. Also how do I load resources as variables so i can fill out sign up forms with those variables?
Hey dude! Please mention that vs code theme and font
It's horrible
Please anybody can help,, for example i have login to a website thant shows certain data in javascript tabel,, ini the dropdownlist menu,, there are only three option of number of showing data, which are 10, 50, and 100. How to for example i want to show all the data not only 100 data. But all the data that i search with certain criteria. Thanks
Is it possible to check data from server by Jest and Puppeteer ?
I run it and the screenshot is not working, i coped exactly what you did, i am just learning node and puppeteer, and would like help?
How much node do you have to know to make full use of Puppeteer?
if we will delete whole folder i-e youtubefun then we will install puppeteer again?
Please do open and search youtube channel using puppeteer like u did using selenium.
is there a way to access that page variable from another function?
I started to learn coding.The way you teach made me fall with them.
My question is you usually use the word terminal..what is meant for ? As I am a beginner I don't get what it is!
A terminal is dependant on the server. Often seen in the wild as a monitor and keyboard alone. Maybe a small bit of hardware.
In this video usage it appears to be referring to the apple name for a command prompt interface.
Thank you excellent video!
Sir do u have Playlist for this?pls provide link of this series
Sir can I use selenium in JavaScript as I want the use of x path
Can we make some file manager with it , that copy and move file to certain folder when our work done. I think that's interesting and useful for small automation projects too.
when i take Screen short i get it as this web site currently not available in your region
Thanks for the video. Is it possible to automate reading of browser bookmarks???????
yes plz make more videos on it
I want to know that what are the career opportunities in puppeteer?.
Can I login in any website using curl???
Dear sir, is puppeteer good or selenium is good for web automation / web scrapping? Please reply to my question. I did not listen selenium in your videos. I have listen lot of your videos.
Fantastic Sir !!!!
Please do a video on Socket.io with NodeJs
1-Web scraping is illegal?
2-puppeteer is written (made) in pure JavaScript code? or it's written in other languages like python?
How do I pass this information to an HTML page to display?
Great video.👍🏻
im stuck at the first bit, i run the code for getting a snapshot of wiki but it just says Error: Cannot find module 'puppeteer'
EDIT: NVM im an idiot and installed puppeteer core instead of of puppeteer
Sir, please make full course on AngularJs.
Please make a video on tenserflow
Well it's funny that I am watching this video at 3 am after trying multiple applications that actually didn't work. All I need is to automate several actions, I have tried iMacros, CAB and UI.Automation, maybe I'm just too stupid to use them properly lol. So, I have a question. I have a web page, I need to copy the information from one field (it doesn't look like a field, just one or two words) to another field, I have thousands of such pages (every time I need to copy and paste different information) and I want to automate these actions, because they are very time consuming. Maybe you can recommend me a good tutorial based on JS? I am have 0 coding skills, about 2 years ago I just tried to learn something in JS lol.
man this has aged well with that corona virus advice.
With this tool i can Make thinks similar like in jmeter?
I am not getting how to get rid of that promise error, only the copied snippet is working without promise err. plz help me someone
Can you do a tutorial to use puppeteer to scrape data from a password protected page
Sir, Thanks for this video, How can we auto fill captcha using same tech stack????
Sir...can we perform same action or operation on 2 or more tabs(all tab contains same website) at the same time(simultaneously) with help of selenium automation?
1. Yes you can setup multiple tabs to run async. 2. This would be a replacement for selenium
Can I use puppeteer for my backend server?
is there any library like this in PHP?
How can you run that from the browser?
I am getting an error saying that chrome is being controlled by an automated software, can someone please help me out
please need videos for login and registration page with puppeteer automation
We want more videos on automation
Which theme u r using ?
What theme are u using in vs code
If possible then More videos for automation please 🙂
Make more videos on automation. I'm loving it.
If you create an application with this code, will it not be really weird for a user to see some browser open and close very quickly? It is headless, but I think users will notice something happening?
do you know what headless means?