How To Use ChatGPT To Fully Automate Web Scraping

Поделиться
HTML-код
  • Опубликовано: 5 янв 2025

Комментарии • 52

  • @alkuzad
    @alkuzad Год назад +29

    For me, it did not show the potential of the tool. You set requirements and then instead of fixing it with ChatGPT you just removed it. Prompt has to be more descriptive and not just "parse the website" to get good results. Pip install command is incorrect but because you had it already pre-installed it works.

  • @mikecorbean8819
    @mikecorbean8819 Год назад +4

    Well, my CGPT buddy has been troubleshooting this w/ me now for about an hour.
    I'm on my 4th version of code from my partner.
    All 4 run successfully but the resulting csv file only contains the headers:
    column A: "Movie"
    column B: "Title"
    Now she's suggesting we attack this one using the API - argh!

  • @hamburger--fries
    @hamburger--fries 11 месяцев назад

    This was super helpful - Like a gateway drug. I used it a little differently. I scrapped 2000 books from my companies site and then removed various html and other odd things that occured in a OCR scan years ago. Anyway thanks!!!!

  • @TheCentoru
    @TheCentoru Год назад +1

    Sorry mate, but the error fix at 8:15 makes this approach as NOT fully automated

  • @dr.samuelburbanks4905
    @dr.samuelburbanks4905 Год назад +3

    How do you get to the terminal. so many steps left out.

    • @MichaelShingo
      @MichaelShingo Год назад

      Windows: search "Command Promp", Mac: search "Terminal"

    • @vasilepelmus3308
      @vasilepelmus3308 Год назад

      Exactly! But they said how to create an account with Chat GBT for 2 minutes🤦‍♂🤦‍♂🤦‍♂

  • @ryandunner
    @ryandunner Год назад +3

    Hey!
    I am looking to scrape data from a website, specifically news articles from a few sources I have. I want to scrape this data and then have it automatically plugged back into chat gpt for further prompting, is that possible?

    • @asifmian43
      @asifmian43 7 месяцев назад

      yes, you can contact me

  • @JozefHLUBIKJr
    @JozefHLUBIKJr Год назад +2

    where do I put the code, pleas? I am not IT at all, BUT willing to learn this scrape skills as I considr it great stuff for us sales people. P.S. how would you suggest to scrape 1. all 5* hotels in New York and 2. car rentals in all Caribbean? Muchas gracias, joseph

    • @viljevisser1442
      @viljevisser1442 Год назад

      Hi! I work with a lot of sales teams to generate new cold leads for them via scraping. Let me know if I can assist.

  • @MirGlobalAcademy
    @MirGlobalAcademy 8 месяцев назад

    .empty what is the purpose of it?

  • @gaa535g
    @gaa535g Год назад +1

    Thank you! That was easy ❤

  • @Peepstep
    @Peepstep Год назад

    How to about getting contacts from sites like jist dial india mart..make a video about getting contacts from websites use chat gpt

  • @yaakovk9468
    @yaakovk9468 8 месяцев назад

    it's can work with linkedin to or google search ? for emails or more ?

  • @PranavPatel-o5z
    @PranavPatel-o5z Год назад

    What if BeautifulSoup and openai prompt to be used to analyse the data and fetch the information what is required.
    any one has tried out.

  • @adied7725
    @adied7725 Год назад +1

    Hi thanks for the video,
    How to visualise this data in wordpress?, please I'm trying to build a we scraper or url parser... Any ideas much appreciated thanks

    • @adied7725
      @adied7725 Год назад

      @@2b_or_not_2b_4gotten how?, please i'm not a develper any pointers?

  • @bigd6566
    @bigd6566 Год назад +3

    Hello, can you please show me how to get just the actors from all the 250 movies without including the directors? Thanks

  • @jessbailie1628
    @jessbailie1628 Год назад

    can this be used to scrape email addresses? the addresses are publicly available on the company website.

    • @jaypg3d977
      @jaypg3d977 Год назад

      you can scrape anything as long as there is no restrictions that prevent it

    • @justaguy905
      @justaguy905 Год назад

      put a requirement of '@' to scrape it

    • @ilyasalmas8841
      @ilyasalmas8841 Год назад

      @@justaguy905 ?? explain

  • @dr.samuelburbanks4905
    @dr.samuelburbanks4905 Год назад +5

    You are skipping important steps like what is the app that you used to paste the code in, yes you said it but I didn't understand what you said.

    • @MichaelShingo
      @MichaelShingo Год назад +1

      VS Code

    • @heroe1486
      @heroe1486 9 месяцев назад

      @@2b_or_not_2b_4gotten And chatGPT would figure out if this man was using Neovim, vim, Sublime Text, Visual Studio, Vscode, Atom or whatever ? This video is just some clickbait that made some people think it was really automated while he copy pasted some basic code you'd figure out by reading some README for 5 minutes, ofc it'd bring clueless non programmers.

  • @ahmadmerei7979
    @ahmadmerei7979 Год назад +2

    Thank you for sharing but still want more details on how I can learn this step by step? any reference, courses?

    • @xsw882
      @xsw882 Год назад +6

      chatgpt will explain it to you step by step

  • @mangeshsawant6361
    @mangeshsawant6361 Год назад +1

    helpful video, thank u

  • @MarblelessMedia
    @MarblelessMedia Год назад

    This is no longer working. I'm told it goes against internet policy.

  • @MyMindGeek
    @MyMindGeek 11 месяцев назад +6

    I am feeling dizzy after this video. Still too complicated and unaccessible to the layman.

    • @GoalRushTV-l6d
      @GoalRushTV-l6d 10 месяцев назад +1

      That’s the easiest video I have watched today

  • @alphalobo7161
    @alphalobo7161 4 месяца назад +1

    To me this is ridiculous. You start off saying we will not need to know any code, and then we are up to our elbows in code!

  • @tapforall
    @tapforall Год назад

    doesn't work

  • @abhishekprakash9803
    @abhishekprakash9803 Год назад

    i have a one questions like ...........we want to build a chatbot .....for confidential document ....can chatgpt give the answers from my documents how to link my document to chatgpt.

  • @v1s1v
    @v1s1v Год назад +2

    This actually shows that it's not that easy to fully automate web scraping with ChatGPT. There are AI-powered web data extraction providers like Kadoa that actually make it easy.

  • @shivamkk007
    @shivamkk007 10 месяцев назад

    Basically Taught how to use chatGPT... That wasn't what I came here for

  • @creamsodabish
    @creamsodabish Год назад +1

    yeah man, you skipped over a LOT of stuff. all good. i'll figure it out

  • @nadranaj
    @nadranaj Год назад

    misleading title. It should have been "How to use ChatGPT to generate code to do web scraping"

    • @heroe1486
      @heroe1486 9 месяцев назад

      Yeah this video doesn't show any "automated" webscrapping, he's just asking chatGPT for basic code you'd figure out by reading some README, some library genuinely do some sort of scrapping automation, requests and Beautiful soup are basic tools that don't do that and would actually be used in the core of such projects. It's a video for laymen I guess.

  • @kirill_good_job
    @kirill_good_job Год назад

    your experiment is not replicate

  • @tajinetopf95
    @tajinetopf95 Год назад

    danke du bist im deutschen netz

  • @ibessf
    @ibessf Год назад

    Your Englisch Sound a bit German 😅

  • @kakamoora7874
    @kakamoora7874 Год назад

    Jokes 😂

  • @brandonjoseph3422
    @brandonjoseph3422 Год назад

    Nonsense

  • @bbrrrrr6553
    @bbrrrrr6553 Год назад

    ChatGPT is just used as a scaffolding tool there. Nothing revolutionary. Sure it will make you gain a lot of a time if you already know how to code. If you don't know how to code AT ALL, you will struggle, even with Chat, you will probably struggle LESS than without Chat but don't expect to produce top notch apps. This is sold by people who just want YT views and sell tutorials.

  • @MichealS-bi8xt
    @MichealS-bi8xt Год назад

    ChatGPT is just used as a scaffolding tool there. Nothing revolutionary. Sure it will make you gain a lot of a time if you already know how to code. If you don't know how to code AT ALL, you will struggle, even with Chat, you will probably struggle LESS than without Chat but don't expect to produce top notch apps. This is sold by people who just want YT views and sell tutorials.