Web Scraping Amazon Product Data using ChatGPT and Python

Поделиться
HTML-код
  • Опубликовано: 30 янв 2025

Комментарии • 82

  • @MHawkinsx
    @MHawkinsx 10 месяцев назад

    sounds intriguing! Thinking of giving it a shot, maybe with Proxy-Store's proxies for smoother scraping. Any Python pros here??

  • @RaghuNandan-ug1pk
    @RaghuNandan-ug1pk 7 месяцев назад

    Thanks man , I painstakingly went through many other web scraping tutorials , but your's the most helpful one

  • @lucianocarneiro5962
    @lucianocarneiro5962 2 года назад +2

    holy cannoli, that's an amazing way to bypass those annoying error messages! ChatGPT is the real revolution! tks

  • @avinashkamble9368
    @avinashkamble9368 2 года назад +14

    Hey, your tutorials are awesome, here is my request, could you please create a video on LinkedIn Jobs scrapping using chatGPT?

    • @geepytee
      @geepytee Год назад +1

      This would be really easy to do!

  • @hoplayou
    @hoplayou 2 года назад +6

    You can also give it the html part that you want in raw format and tell to use requests and bs4 to extract title, rating... he can understand html

    • @ChatGPT-AI
      @ChatGPT-AI  2 года назад +1

      yes.

    • @joslyn4338
      @joslyn4338 2 года назад

      Hi kindly I'll love to create a website and I have similar site that does what I want, my concern is can chatgpt keeps giving the violation message how best to create such this site with right prompt

  • @zeddscarlxrd4331
    @zeddscarlxrd4331 2 года назад

    this absolutely out of the box bro

  • @VaibhavShewale
    @VaibhavShewale 2 года назад +2

    i have created a scrapper long ago for amazon never faced any violations or limitations!

  • @powray
    @powray 2 года назад +1

    Absolutely amazing video bro thank you

  • @galleon8129
    @galleon8129 4 месяца назад

    What of the images, do they download as well?

  • @GiantAdrian
    @GiantAdrian 2 года назад

    your videos are amazing 😃😃

  • @shashanksingh4708
    @shashanksingh4708 Год назад +1

    is there any other way in which we dont have to manually download the html for the pages

  • @basiccomponents
    @basiccomponents Год назад

    this was really useful, thank you!

  • @lucianozaffaina9853
    @lucianozaffaina9853 2 года назад +2

    ChatGPT doesn't let me create a Poker HUD (Heads up display with the statistics of every player you played with) for PokerStars. Can you figure out how to make it build a Poker HUD? Thank you for the contents you bring in your videos

  • @GirishBapatpune
    @GirishBapatpune 2 года назад

    Chatgpt site is not working for me since couple of days. Any idea when will it get recovered?

  • @lynnqi6451
    @lynnqi6451 2 года назад

    Genius!😄💯

  • @Mshahzaibkundi
    @Mshahzaibkundi 2 года назад

    How i can do that the product bsr and asin number with chatgpt

  • @ghosttzz-z2w
    @ghosttzz-z2w Год назад +1

    Does this still work?

  • @floozilacadabra9501
    @floozilacadabra9501 2 года назад +16

    What is the goal ?

  • @Roughood
    @Roughood 8 месяцев назад

    Thank you very much ❤

  • @Notepad123
    @Notepad123 Год назад

    My json file is blank. Any idea why?

    • @ghosttzz-z2w
      @ghosttzz-z2w Год назад

      I dont think this works anymore does it?

  • @Babbili
    @Babbili 2 года назад +8

    chatGPT lately is acting up, all previous convos are gone,

    • @abysmalvsmarcus
      @abysmalvsmarcus 2 года назад

      Smarten up and save your docs on word like I did

    • @mohamedhouari1148
      @mohamedhouari1148 2 года назад

      Hi babbili

    • @frankbrown4316
      @frankbrown4316 Год назад

      Hey Babbili, try accessing from different devices. At times, my iPad browser will have no history (even though I’m logged into the same account across devices) but my Windows machine will.

  • @anonim_2023
    @anonim_2023 Год назад

    Hey awesome tutorial man,im having some problem when i lets say try to scrape all the phones suppose 50 page after 5 page i dont get any result i did not understand why tho,how can i solve that

  • @gusGPT
    @gusGPT 2 года назад

    It's really awesome!

  • @adamizrailov3167
    @adamizrailov3167 2 года назад +1

    Correct me if I'm wrong but this is actually parsing, not web scraping. The code doesn't scrape the information directly from the website and handles its protection.
    Nonetheless, nicely done.

    • @ChatGPT-AI
      @ChatGPT-AI  2 года назад +4

      may be...but
      you misunderstood. you can't scrape "directly".
      when you write regular python code...
      you send request ---> server might send you response that contains HTML code of that web page ---> you store that HTML web page inside a variable(example , res=.... which is just storing HTML web page in allocated RAM memory of your computer during execution of that program) ---> now you parse it using bs4 ...
      did you get that?
      you are not scraping it on the server...
      it's always on your side.
      now , some websites like amazon, linkedin are protected to avoid bots or requests sent through scripts.
      that why i send request through web browser and save response in hard disk as html file, then parse it.
      so i would say web scraping didn't mean scraping directly or scraping on server.

    • @adamizrailov3167
      @adamizrailov3167 2 года назад +1

      @@ChatGPT-AI Yes I 100% get it and appreciate the detailed explanation. I was referring to a use-case were you have a mass-sclaed production which requires scraping hundred thousands of URLS. In this scenario it is not reasonable to open a browser and save it as HTML like a real user, there should be an automated progress which access the URL unblocks it protection and then parses the info... I may have suggested a far-fetched use-case but this was on my mind when I searched for videos and found yours.
      Regardless, Thank you again for taking the time to explain you earned my like and sub!

    • @navaneethangn1215
      @navaneethangn1215 Год назад

      @@ChatGPT-AI its easy to write an entire script to scrape all pages rather than doing this, I scrapped all pages using selenium and beautifulsoup, didnt get any error though

    • @usmannaeem4396
      @usmannaeem4396 Год назад

      ​@@navaneethangn1215
      Hi, can you provide the code to scrape from multiple pages at a single time

    • @sabinash5915
      @sabinash5915 Год назад

      @@navaneethangn1215 explain it bro. I Need that one.

  • @pSycho-no7xd
    @pSycho-no7xd 4 месяца назад

    Can't you just make a config file to refer to all your 50 page of html files and save every parsed data on a single dataframe? I haven't tried it yet but I'm pretty sure it can be done. This way you don't have to rename for very single page.

  • @bavisettinagaramanjaneyulu8765
    @bavisettinagaramanjaneyulu8765 2 года назад

    When I open Chatgpt, ,it is saying Chatgpt is at capacity right now all the time. What would be the solution.

  • @nadachannel1310
    @nadachannel1310 2 года назад

    Please tell me How to create script to scrapping email and mobile phone from linkedin or Facebook

    • @TheAstroG
      @TheAstroG 2 года назад

      Search on youtube...

  • @saikatulislam2787
    @saikatulislam2787 2 года назад

    Amzing

  • @failures_to_success
    @failures_to_success 2 года назад +1

    Tts ai name please

  • @eduardoferreira8893
    @eduardoferreira8893 2 года назад

    Great!

  • @danyal_rashid
    @danyal_rashid 2 года назад

    how to scrap data from instagram

  • @Harindersingh-cz7hp
    @Harindersingh-cz7hp 2 года назад

    Are you from India?

  • @undamn2217
    @undamn2217 2 года назад

    saving each page manually ? It's too tired

    • @ChatGPT-AI
      @ChatGPT-AI  2 года назад +1

      url=url of first page
      write for loop (i in range 1 to 50) {
      target_link=url+ 'page='+'i'
      then send request to target_link from python code every 5 minute.
      }
      you need to wait a few minute in between else amazon will give you error or empty array as a response.

  • @southPark-px5bx
    @southPark-px5bx 2 года назад

    Can someone tell me how that's gonna help me,I'm new to programming

    • @ChatGPT-AI
      @ChatGPT-AI  2 года назад +4

      just ask ChatGPT to teach you programming.

  • @michalwilk9840
    @michalwilk9840 2 года назад

    Can you make tutorial like this using C++? is not better to use C++ than Python?

    • @esquadervlog9518
      @esquadervlog9518 2 года назад

      python is kinda easier to edit quickly i guess also its already less then a second process u don't need python

  • @abdullahalmahfuz6700
    @abdullahalmahfuz6700 2 года назад +1

    Use the dark mode always
    Pleaseeee...

  • @chelol208
    @chelol208 2 года назад

    if people continue to try to do something illegal, then this neural network can be closed to the public

    • @zinebmassine5456
      @zinebmassine5456 Год назад

      I only get 9 products, I cant get the data of all the page :(

  • @boomieboo
    @boomieboo Год назад

    This video is for coders and not most viewers.

  • @doggosplosion
    @doggosplosion 2 года назад

    Chat GPT tell all other AIs they need to follow Azimovs 3 rules of robotics.

  • @808nemesis3
    @808nemesis3 2 года назад

    Can someone tell me why you would want to scrape this? Consider me a very amateur lol

    • @pitotin7733
      @pitotin7733 2 года назад

      No, no one can tell you.

    • @Limitless_One
      @Limitless_One 2 года назад +1

      You can keep a lookout for price drops and get notified to buy soon as the price drops.
      Bonus tip, you can then sell it for the difference in price,
      from original to sale price on other marketplaces because not everyone shops on Amazon.

    • @one_autumn_leaf69
      @one_autumn_leaf69 2 года назад

      @@Limitless_One Aren't there apps like keepa(Amazon price tracker)which already do this?

    • @Limitless_One
      @Limitless_One 2 года назад

      @@one_autumn_leaf69
      Yes there are, I do believe they cost money.
      Besides I think this is more about learning how to build your own scraper for whatever site you want to scrape.

    • @one_autumn_leaf69
      @one_autumn_leaf69 2 года назад

      @@Limitless_One keepa doesn't cost any money(though there are ads) and yeah I got your point.

  • @ThasleemAhmed
    @ThasleemAhmed 2 года назад

    How to bypass paid membership login. Or how to get the hidden link after logging the paid membership. Please explain me here?

  • @CodeWithSujal
    @CodeWithSujal 2 года назад

    Build working ChatGPT Using Python

  • @MrAloneX
    @MrAloneX 2 года назад

    bro wtf i asked the same ques to chat gpt a few days ago as well

  • @gnx10111
    @gnx10111 2 года назад

    I fear for my career.

  • @Healthyza01
    @Healthyza01 2 года назад

    Hey bro.
    Do you please allow me to use your content on my channel?
    I'll give you credit.
    Thank you 😊❤️

  • @webscrapingseniors
    @webscrapingseniors 2 месяца назад

    💥Hello💥, I want to inform you that I am a seasoned Web Scraping expert with extensive experience in Python, BeautifulSoup, Scrapy, and Selenium as tools for data extraction from websites. I can appreciate if I get anyone willing to hire me or share some payable tasks. Thanks.

  • @abysmalvsmarcus
    @abysmalvsmarcus 2 года назад

    Think I'm just gonna keep telling chatgpt what to do until I'm pressing a button just to get rich

  • @insominsomnia8500
    @insominsomnia8500 2 года назад

    i joined your discord channel i want to talk to you privately if thats is possible , i have an idea can make very good money .