web scraping with NodeJS
HTML-код
- Опубликовано: 9 апр 2020
- Welcome to a youtube channel dedicated to programming and coding related tutorials. We talk about tech, write code, discuss about cloud and devops. That’s what we do all day, all year. We roll out a lot of series and videos on our channel.
All the learning resources such as code files, documentations, articles and community discussions are available on our website:
chaicode.com/
You can find our discord link, github link etc on the above website.
Twitter/X link: x.com/hiteshdotcom
Discord link: hitesh.ai/discord
Learn React with 10 projects: • Let's learn react from...
Learn Docker: • A practical guide on D...
Learn Kubernetes: • Complete Kubernetes Co...
How does a browser works: • How does a browser wor...
How nodejs works: • How node JS works | En...
Learn Redux-toolkit: • Learn Redux Toolkit in...
Learn NextJS: • Nextjs Full stack course
Learn Typescript: • Why to learn Typescript
Learn Javascript: • Welcome to new JavaScr...
Learn React Native: • React Native Mastery: ...
Learn Zustand: • React state management...
Learn Golang: • How to get started wit... 
Наука
That Async part at 20.47 . I really loved the explanation. Really really awesome.
Yes surely I will love to learn more about these types of small projects.
It's a yes for separate NPM tutorial too.
Another great video in this quarantine period from hitesh sir GREAT👍
I was looking for web scraping courses in last 4 days and u got that covered sir.
This kind of videos are really helpful. Please do more of this. Thank you!!
Hey, Hitesh I love your explanation of every step, and the reason you provide is superb.
I was planing to do this from the day its published. Today i finished it. Thank you very much Sir.
Please make separate videos on selectors. And please can you make 2-3 more videos on scrapping in-depth, if time allow you please.
Thank you sir.. In this hard time we are learning. I have used puppeteer for scraping. We need more this small project like videos.
Corona : "I will stop everything in the world, no studies, no work, no travel nothing"
Coders : "Chill buddy!! Wait for our superman to come and puch you👊"
Till our Hitesh sir(our superman) is there no one can stop us from learning😎
Just a small thank you from our side for making such amazing videos and motivate us not to leave programming.
Loving these mini project series ❤️😊
Awesome 😊 i have learned something new. Keep scrapping!
How do you scrape the entire page automatically and not manually pasting in the urls as you do?
cool video keep up the amazing work
if the request is deprecated then what happened with past project or project which is running
at that time
love that the content is original.
one question: what is the edge of doing web scraping in JS than in Python?
how to do web scraping when there is dynamic data which is being loaded from javascript?
Very informative tutorial. Thanks!
Yup! Selectors are needed now a days. I am waiting... 😜🥰
Now i am going to scrapper worldometer website just to learn more also is scraping and crawling different or there same
Hi, Hitesh sir I am on track by completing this code. during the lockdown period, I am not productive that much I thought. Now I am on track
Amazing tutorial!! 🙏💙🙂
What do I have to put in the request options when the content encoding is br?
how would you do this for example you can enter any movie you want and it will give you the same information not juts limited to a few movies
Yes we would love to learn more about web scraping
Ynwa
Hello Hitesh Sir, Myriads of Thanks to you for these informative videos. Can you please tell that Which language is better for Implementation of Data Structures and Algorithms:- JAVA or C++ ??
Please-Please, give a reply🙏 to this question.
Sir after csv has been created how can we use it to display it in webpage?? And we want to fetch all movies of same geners we have to manually put uri of it??
Please post more videos like this @Hitesh Sir
request-promise library is decrepit so now which one i used i try to find alternative but i can't found so please tell me which npm package now i used?
I tried to follow along with a different website but I can't use $ in the inspector so I assume this pre-scrape stuff only works on sites that use jquery? IMDB works for me so how would I approach this on a non-jquery site?
i am getting my resultant imdb.csv file something like this
"title","rating","summary","releaseDate"
please help me fixing this
Yes, make a video on selectors please.👍
Thank you ; Very good teaching
Why we require selenium in python for imdb like website?
Hey very helpful video. Much appreciated. Can you please let me know what is the alternative for 'gzip=true' for a page with content-encoding as 'br' and not 'gzip'???
i'm totally new so my question is can't we make a dynamic function to get random url data?
why cant i use the same method $() on linkedin? it gives me a Uncaught TypeError: cannot read property 'text' of null.
pls help, thank you!
I have a doubt, how do I know that the website is webscraping enable or not. Is there any security violence issue can occur ?
Is node js scraping is like python scrapy? which one better performe?
Really great so far. But all these request packages are outdated. Next one maybe with axios.
there is onw usecase,
when i am hitting the endpoint, its returning the very minimum data, then its loading the subsequent data (similar to client side rendering). i need to scrape that data, which is loaded after the initial load.
how to scrape that data.
any help is appreciated
Thanks
Use puppeteer
Thank you very much. I am trying to use console like you did in the video but I got `Uncaught TypeError: $ is not a function
at :1:1`. Any idea how to fix that?
Thanks ..amazing video..and can you please make a video for live web streaming in our website with nodejs
Can we have to make web scarapper for instagram which manges posts in python
why don't we run js in console keeping movies = document.location; rather than copy-pasting URLs
Great video.
How to scrape genres? I've been stuck on this for quite some time. I really need your help.
Hello. Nice introduction
yes sir we want a video on scrappy.js and plz make a tutorial on how to login in a website while scrapping it....🥰🥰🥰🥰🥰
Can web scraping from javascript and store in database using php
sir, when I'm doing cosole.log() on the selected data its returning empty string....please tell the solution.
use the mobille website of IMDb if having issues with empty string i.e m.imdb.com
Yes, please one more videos
amazing tutorial...
Can we axios instead of request?
Another great video sir.. I have been trying to web scrap GitHub.. But after a certain number of time it shows some comment about security.. Can you please suggest me something..
Hey Hitesh! I really appreciate this session but can you please create it using Axios and HTTP request. I am trying and it is blocking it and giving a status code of 500.
😍😍😍😍 most waited video
Can we use for stock price
i want more of this content please
Sir please give me any idea about final year project in University based on web
Thank you for the video .
Awesome video 👍
Sir can you make tutorial of puppeteer and upload on cloud on aws .. please
superb dude
Sir make some videos on socket programming as well
Sir, please make a video on "video chat app" using (node.js,socket.io)
Can u share the crawl file in the links ?
And sir please provide more content on web scraping with js
Thanks for making this awsome video sir its very helpfull for me .i m stuck in some point like how to get list kind of data. for example i have one selecter xyz and its repeted multi time .how can we get the data i m using syntax-$('div[class="xyz"]>h1').text(). and i get the result Ordinance: In forceOrdinance: In forceOrdinance: In forceOrdinance: In forceOrdinance: In forceOrdinance: In forceNegativedNegativedNegativedNegativedNegativedNegativedNegativedNegativedNegativedNegativedNegativedNegativedLapsedLapsedLapsedLapsedLapsedLapsedLapsedLapsedLapsedLapsedLapsedLapsedLapsedLapsedLapsedLapsedLapsedLapsedLapsedLapsedLapsedLapsedNegativedNegativedNegativedNegativedLapsedLapsedLapsedLapsedLapsedLapsedLapsedLapsedLapsedLapsedLapsedLapsedLapsedLapsedLapsedLapsedLapsedLapsedLapsedLapsedLapsedLapsedLapsedLapsedLapsedLapsedLapsedLapsedLapsed . and i need seperation data.
how can i do that
Sir great
Sir please make course in Natural Language Processing if possible
Sir, Please make a video on how to fetch third party api data in node js
I requested a new video we have to grab that movie links also dynamically.
Sir which theme are you using in VS code
++
awesome video, can you help in web srapping with password protect web site which I know user name and password
excellent
Isko apne website pe kaise show karu
I'm from bangladesh. I want to learn MERN stack development from your course. But I didn't find any payment getway to buy this course from bangladesh. Can you add internet payment method please? Can you please help?
6:30 Why don't you use element.class-name syntax to access that element? I think this is more convenient and readable way.
I have used that syntax in last such video, so this time little different
@@HiteshChoudharydotcom Oh, okay, I got it ;)
More selectors video please. And please tell your vscode theme name😅😅
Why didn't you use python for scraping?
Sir can u do node.js webscrapping on indeed.com??
thanks man
I want your advance node js
Hi bro please make tutorial how to convert sitemap.xml from site into keywords.txt
i am getting empty strings! Plz help...
Bhaiya aur detail chaiye web scapping ...
Hitesh i'm a huge fan of your's. I really like you all videos. Now i'm searching a freelancer for my projects. If you interested to work with me then please replay me. I'm really glad if you work as a freelancer for me. Waiting for your replays.
Or we can directly do $('.title_wrapper > h1').text()
Similar video explaining parsing hierarchical data - ruclips.net/video/tu1mB_8mPCM/видео.html
Yes up course I want
i was dying to know the laptop you re using . the fact is , that is I actually landed on your youtube channel , just to discover your f laptop and not the github link
Sir please make crash course on Node js
Please crash course on selectors
request-promise has been deprecated. You can use another package named needle for doing request.
www.npmjs.com/package/needle
ty bro it is very helpfull because i am try to find npm pacakge but i couldnot so ty for the help.😍
can you please tell me how you can find this npm
Selectors please
Roses are red
Violets are blue
In this shitty lockdown
I found you ♥️
Advanced tutorial please!
#Bhai pls coding ninja website pur bi video creat karo pls i hope reply me.
Hitesh sir ki khud ki brand hai. You will get each and every videos on his site only :)
CORONA MAI HOTA HAI THROAT SOAR
PLEASE MAKE NODE JS VIDEOS MORE!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
now text() replaced by textContent
Hello Sir.
It was awesome
I have a request.
Can you please upload web scraping video using Python or Django because I am more proficient in that.
And thanks Sir for providing such contents !
I am watching the video at 4:30 am 😂❤️ Thanks Sir for this video