You need not write a callback function to wait the page. There is a waitfor function in which you can pass miliseconds to wait the page. Like - page.waitFor(5000) Then it wait for 5 sec. Before close the browser.
thank you, sir, apse Mai bahut inspire Hua hu, main web development chorna chahta tha, apke videos dekh karke bahut kuch sikhnane aur janne ko milta hai, thanks you for teaching us. love from Chhattisgarh😘😘
Don't try to web scrap popular websites(fb, twitter, LinkedIn). They'll ban your ip and you can even get into trouble for scraping data. Scraping comes with a lot of risk. And there is nothing to worry about scraping publicly available data on the internet or from websites not configured properly.
Great tutorial. I like the way you demonstrate the flexibility of puppeteer and explain the documentation. I actually have a running start on how to scrape web pages in JS. Way more dynamic than python scraping. Thanks!
Its crisp video I loved,it will be great if architecture is explained along with how it works which already explained beautifully Thank you very much Could you please take CodeceptJS as next topic
Hey Hitesh, the video is slightly down (noisy, to be precise). May be camera settings are not good. Have a look. And apart from that, the content is on the infinite quality. Thanks for this great work!!!
i'm having some issues. first off all: "throw new errors.TypeError('ERR_INVALID_ARG_TYPE', 'original', 'function');" TypeError [ERR_INVALID_ARG_TYPE]: The "original" argument must be of type function
Hey @Hitesh Choudhary, nice tutorial! Got stuck, how do I do this - 1. Open a webpage (you see list of items) 2. Click an item - you go inside item detail page 3. Extract data from the detail page (like name, desc, images...) 4. Now store all this data as a markdown file (.md) with the item name as the file name 5. Repeat the same for 300+ items P.S. the class names are complex(with weird names and numbers). How do I use the same with XPATH? Thanks in advance!
Awesome. I request you do deep webscraping with this and save that to database please. That's my request for next video . Thank you Sir and it's always great stuff from you
Hey Hitesh I saw your RUclips video about Web automation in python for beginners. It was very interesting but what I want to do is open windows clicking a link then clicking for a specific item and every time I click that link the item is in another spot so I might even have to go to the next page to find it. I do this a lot but it’s a lot of work, if you could show me how to automate it that would be awesome!
I started to learn coding.The way you teach made me fall with them. My question is you usually use the word terminal..what is meant for ? As I am a beginner I don't get what it is!
A terminal is dependant on the server. Often seen in the wild as a monitor and keyboard alone. Maybe a small bit of hardware. In this video usage it appears to be referring to the apple name for a command prompt interface.
Please anybody can help,, for example i have login to a website thant shows certain data in javascript tabel,, ini the dropdownlist menu,, there are only three option of number of showing data, which are 10, 50, and 100. How to for example i want to show all the data not only 100 data. But all the data that i search with certain criteria. Thanks
Can we make some file manager with it , that copy and move file to certain folder when our work done. I think that's interesting and useful for small automation projects too.
im stuck at the first bit, i run the code for getting a snapshot of wiki but it just says Error: Cannot find module 'puppeteer' EDIT: NVM im an idiot and installed puppeteer core instead of of puppeteer
I'm curious how to set multiple threads (browsers) in Puppeteer Stealth. Also how do I load resources as variables so i can fill out sign up forms with those variables?
Dear sir, is puppeteer good or selenium is good for web automation / web scrapping? Please reply to my question. I did not listen selenium in your videos. I have listen lot of your videos.
Well it's funny that I am watching this video at 3 am after trying multiple applications that actually didn't work. All I need is to automate several actions, I have tried iMacros, CAB and UI.Automation, maybe I'm just too stupid to use them properly lol. So, I have a question. I have a web page, I need to copy the information from one field (it doesn't look like a field, just one or two words) to another field, I have thousands of such pages (every time I need to copy and paste different information) and I want to automate these actions, because they are very time consuming. Maybe you can recommend me a good tutorial based on JS? I am have 0 coding skills, about 2 years ago I just tried to learn something in JS lol.
They are different packages but they perform the same task, the only difference is that Puppeteer only works with chrome whereas the latter can work with firefox and IE
If you create an application with this code, will it not be really weird for a user to see some browser open and close very quickly? It is headless, but I think users will notice something happening?
I have used puppeteer to generate PDF in node js for my college project . It's really nice to work with.
I love coding and You helped me to fall in love with coding.
Bro, he is an example of a true teacher!!! (DRONACHARYA)
Make more video on Automation Testing
me also
Usage examples:
> Array.from(document.querySelectorAll('.mw-headline')).map( h => h.innerText);
> [...document.querySelectorAll('.mw-headline')].map( h => h.innerText);
what is the name of the outro song
You need not write a callback function to wait the page. There is a waitfor function in which you can pass miliseconds to wait the page.
Like - page.waitFor(5000)
Then it wait for 5 sec. Before close the browser.
Thanks
@@HiteshCodeLab or you can just remove browser close function
Nice introduction!
10:55 doing $$(".mw-headline").map(h => h.innerText) can get you there quicker.
Wow covid19 in feb 2020 - def look more into this - wise words, wish more people did this one year ago !!!
Lovely content
A small trick for youtubers: go to the end of the video and play restart to avoid ads.
And yeah "You are welcome" 😅😜
just use a adblocker instead and what's the name of the outro song
This guy won't get any revenue tho :(
आपका बहुत बहुत धन्यवाद ,हितेश जी वीडियो बनाने के लिए।
thank you, sir, apse Mai bahut inspire Hua hu, main web development chorna chahta tha, apke videos dekh karke bahut kuch sikhnane aur janne ko milta hai, thanks you for teaching us. love from Chhattisgarh😘😘
Need to learn more of this stuff. 99.99% of my job can literally be automated.
Which vscode theme are you using ?
Same thing i need to know
Don't try to web scrap popular websites(fb, twitter, LinkedIn). They'll ban your ip and you can even get into trouble for scraping data. Scraping comes with a lot of risk. And there is nothing to worry about scraping publicly available data on the internet or from websites not configured properly.
Thanks for valuable information.
@@HiteshCodeLab :)
Great tutorial. I like the way you demonstrate the flexibility of puppeteer and explain the documentation. I actually have a running start on how to scrape web pages in JS. Way more dynamic than python scraping. Thanks!
Its crisp video I loved,it will be great if architecture is explained along with how it works which already explained beautifully Thank you very much
Could you please take CodeceptJS as next topic
Very Good to hear automation related stuff through you.. Hitesh garu .. Keep posting..
Ahh, good ole Corona in February 2020. Good times, good times.
Wow -- that sample wikipedia page aged pretty well.
lol for real !
Video on integrating payment gateway in the website
Which theme are you using in VS code?
Woah, today I decided to learn puppeteer and was going through docs, and guess what, your video notification pops up. Jinx
That was great tutorial you don’t need to be criticise yourself your doing great!
More such videos sir please
Yes.. More videos on Web Automation are welcome.
This was an amazing video.
You did an amazing job!
Hey Hitesh, the video is slightly down (noisy, to be precise). May be camera settings are not good. Have a look. And apart from that, the content is on the infinite quality. Thanks for this great work!!!
Thanks for comment. Can you please let me know the time of noise.
Is it in screen recording part or intro part.
I will surely fix it
@@HiteshCodeLab The screen recording is a bit blurry & the Normal full screen video (intro) have a little bit of noise.
@@HiteshCodeLab i just realized that, there's no quality down noticed in mobile view, but when we switch to 1080p monitor it seems to be as described.
For sure more videos on Puppeteer.
I have used puppeteer for my eCommerce website scraping project. It is an amazing library.❤️
Thanks for your presentation about puppeteer, please make more videos on the same
Yes please create series on Puppeteer. Will be waiting for same.
Thank you Hitesh, very helpful!
That explanation was rlly great
Yes I want more video like this.
i'm having some issues.
first off all: "throw new errors.TypeError('ERR_INVALID_ARG_TYPE', 'original', 'function');"
TypeError [ERR_INVALID_ARG_TYPE]: The "original" argument must be of type function
please help
1-Web scraping is illegal?
2-puppeteer is written (made) in pure JavaScript code? or it's written in other languages like python?
You're really a great teacher!
Hey @Hitesh Choudhary, nice tutorial!
Got stuck, how do I do this -
1. Open a webpage (you see list of items)
2. Click an item - you go inside item detail page
3. Extract data from the detail page (like name, desc, images...)
4. Now store all this data as a markdown file (.md) with the item name as the file name
5. Repeat the same for 300+ items
P.S. the class names are complex(with weird names and numbers). How do I use the same with XPATH?
Thanks in advance!
Thanks for this video. Help me much. Keep it up man
Please continue your videos with web automation
I want more videos on JavaScript and NodeJs.
Hey dude! Please mention that vs code theme and font
It's horrible
You're the best!!! thank you thank you thank you!!
Please do open and search youtube channel using puppeteer like u did using selenium.
Nice
Awesome. I request you do deep webscraping with this and save that to database please. That's my request for next video . Thank you Sir and it's always great stuff from you
I run it and the screenshot is not working, i coped exactly what you did, i am just learning node and puppeteer, and would like help?
Hey Hitesh I saw your RUclips video about Web automation in python for beginners. It was very interesting but what I want to do is open windows clicking a link then clicking for a specific item and every time I click that link the item is in another spot so I might even have to go to the next page to find it. I do this a lot but it’s a lot of work, if you could show me how to automate it that would be awesome!
Amazing👍🏻😍
Love from Nepal❤
Awesome! Thanks very much.
Amazing.. Please make more such videos
yes plz make more videos on it
I really enjoyed your lesson 😊🙏
when i take Screen short i get it as this web site currently not available in your region
nice one, but why didnt you use selenium, here, since it is popular for automation. which one is better "puppeter" or "selenium"
I started to learn coding.The way you teach made me fall with them.
My question is you usually use the word terminal..what is meant for ? As I am a beginner I don't get what it is!
A terminal is dependant on the server. Often seen in the wild as a monitor and keyboard alone. Maybe a small bit of hardware.
In this video usage it appears to be referring to the apple name for a command prompt interface.
Informative video.thanks for sharing
Please anybody can help,, for example i have login to a website thant shows certain data in javascript tabel,, ini the dropdownlist menu,, there are only three option of number of showing data, which are 10, 50, and 100. How to for example i want to show all the data not only 100 data. But all the data that i search with certain criteria. Thanks
How to change browser to Firefox ?
Can we make some file manager with it , that copy and move file to certain folder when our work done. I think that's interesting and useful for small automation projects too.
im stuck at the first bit, i run the code for getting a snapshot of wiki but it just says Error: Cannot find module 'puppeteer'
EDIT: NVM im an idiot and installed puppeteer core instead of of puppeteer
Great tutorial! Thank you.
I am not getting how to get rid of that promise error, only the copied snippet is working without promise err. plz help me someone
Love from Egypt 💗❤💗
I am getting an error saying that chrome is being controlled by an automated software, can someone please help me out
I'm curious how to set multiple threads (browsers) in Puppeteer Stealth. Also how do I load resources as variables so i can fill out sign up forms with those variables?
Continue the Puppeteer
Nice video. love from Bangladesh
nice job bhai
for each new project we will have to write npm init -y
and npm install puppeteer for once?
I want more videos on pupppeeter
Yeah Definitely web scraping. Thanks
Dear sir, is puppeteer good or selenium is good for web automation / web scrapping? Please reply to my question. I did not listen selenium in your videos. I have listen lot of your videos.
Well it's funny that I am watching this video at 3 am after trying multiple applications that actually didn't work. All I need is to automate several actions, I have tried iMacros, CAB and UI.Automation, maybe I'm just too stupid to use them properly lol. So, I have a question. I have a web page, I need to copy the information from one field (it doesn't look like a field, just one or two words) to another field, I have thousands of such pages (every time I need to copy and paste different information) and I want to automate these actions, because they are very time consuming. Maybe you can recommend me a good tutorial based on JS? I am have 0 coding skills, about 2 years ago I just tried to learn something in JS lol.
How do I pass this information to an HTML page to display?
amazing explanation
I thought Google url crawl made of samething.
Fantastic Sir !!!!
Please do a video on Socket.io with NodeJs
Thanks for the video. Is it possible to automate reading of browser bookmarks???????
is there a way to access that page variable from another function?
How can you run that from the browser?
I want to know that what are the career opportunities in puppeteer?.
Thank you excellent video!
Hey , Nice Video.
can you please tell the difference between "Puppeteer" and "selenium-webdriver-js"
They are different packages but they perform the same task, the only difference is that Puppeteer only works with chrome whereas the latter can work with firefox and IE
Is it possible to check data from server by Jest and Puppeteer ?
please make more video on that
How much node do you have to know to make full use of Puppeteer?
Sir can I use selenium in JavaScript as I want the use of x path
Sir, Thanks for this video, How can we auto fill captcha using same tech stack????
if we will delete whole folder i-e youtubefun then we will install puppeteer again?
Thank you very much! this video summerized the Puppeteer idea for a beginner.
Sir do u have Playlist for this?pls provide link of this series
Sir I was looking forward for this kind of video.. your way of explaining is very easy to grasp
If you create an application with this code, will it not be really weird for a user to see some browser open and close very quickly? It is headless, but I think users will notice something happening?
do you know what headless means?
Can I login in any website using curl???
Make more videos on puppeteer
If possible then More videos for automation please 🙂
Nice and perfect!)
What VSCode theme is that?
With this tool i can Make thinks similar like in jmeter?
Can anybody give me the link of the song he played at the end of this videos please.
How to tackle recaptcha in web scraping
sir what is [...a] #please explain