AI Web Scraping Simplified For Everyone
HTML-код
- Опубликовано: 29 сен 2024
- It took me a while to realise this, but being able to scrape with Natural Language Processing instead of looking for specific divs
This took a while to understand - but the power of this is actually crazy with huge potential to do basically anything
You can use this system to do many things, including finding quick and easy ways to feed large amounts of data
This system takes websites, turns them into simplified markdown (with links etc) and then extracts the data using natural language processing
Thanks for watching and PEACE
Hamish
Join this channel to get access to perks:
/ @incomestreamsurfers
thanks Hamish, that's an interesting tool and relatively cheap for a non coder like me
And 5 key benefits are?
What i dont get or i think its not explained in the video, what can you do with it? I mean what is a real usecase for it and which advantages it gives you as competitor or if you want to build up a business to earn money with?
Nice one coach. Imagine hearing and then applying this type of data on a daily basis. Insane.
Were you thinking of Beautiful Soup in mind? (the Python Scraper) ?
can i use this technology on a real estate website to find all property SELLERS ?
@@Markoj-wr6vx yeah probably
Thank you so much,
Is it possible to make amazon arbitrage and can you make a video? Maybe tools that are not so expensive 😊
Would I be able to ask for all the pictures on a website page and then download them all? 6:21 I’m trying to make some tier lists
You can't download them I don't think, not without extra code. You could easily write a script that downloads images from URL though
@@Incomestreamsurfers thank you for the heads up I appreciate it
So can you use the data to test ai agents? What are some practical applications for scraping sites to collect data?
We just made a SaaS using this logic
I just get chatgpt to write a python script for the sites I need to scrape and have my input url be a text box and then output to a table with copy to clipboard buttons, using selenium to get around bot detection and zipfile to zip the images and ad the image zip download to another button. The tool seems cool but it doesn't scrape what I need compared to the python script that "I" custom built for my needs already, since I already have the prompt to get everything running with a html frontend I just change the selectors it needs to scrape and instantly get a web scraper ready to go for any products, skus, images and data that I might need.
I also don't scrape like this - I just wanted to make a clear and understandable video that breaks it down for noobs
I think they might not be charging enough. This tool is fantastic. Especially programmatically. To have a website that only scrape but process and act within the same action whether is an automation or research is incredible.
Combining this with a Claude Projects has the project manager within me giddy ASF!!
Thanks for this! ☘️👌👌
wow
you are the best for sure so I kindly would like to ask help to get a better scraping method for google maps or something else that could give me mobile numers and email addresses
Pay up and join his weekly classes. It's not Christmas yet to justify your request for free help. 😂