Scraping Websites with Infinite Scrolling: The EASY way!

Scraping websites which use "infinite scrolling" (meaning the website keeps loading items when you scroll down) can be extremely complicated. In this video I show you the easiest method which works on 99% of all websites!
💭 Join my Discord community and get help from many other Python developers:
/ discord
⭐️ Copy the source code here ⭐
tomstechacademy.com/code-exam...
⭐️ The website we scrape ⭐
www.fintastico.com/fintech-uk/
⭐️ Timestamps⭐
00:00 - Intro
00:51 - The website we want to scrape
01:55 - Install and import libraries
03:14 - Scrolling through the webpage and detecting the end
06:20 - Extracting the data and saving it in a txt file
08:37 - How to avoid scraping the website every time again?
10:26 - Extracting the fields from the webpage
15:34 - How to store extracted data to either an Excel or a CSV file?
20:47 - How to download the script for scraping websites with infinite scroll?
⭐️ Follow me ⭐
💼 LinkedIn: / thomas--janssen
✅ Instagram: / tomstechacademy
❗ Some of my videos contain affiliate links. When you click on these kind of links, I get a small percentage in case you make a purchase via the website. Be aware that this doesn't cost you anything - you never pay more than the standard retail price.
#webscraping #python #webscraper

[@ahassan7270]

Thank you so much for your insightful video; it was incredibly beneficial. Could I ask you to consider making videos about web scraping periodically? Your expertise in this area is greatly appreciated!👏👏

[@TomsTechAcademy]

Thank you for your comment! You can expect more videos about web scraping in the next months 😊. Any specific topics you're interested in? You can also join my Discord (link in description) to exchange knowledge about web scraping.

[@AnnaWoods-fe8vt]

This was so helpful!! Thank you !!! Could you please make a video on how to go to each product subpage and extract details like description from there (for ecommerce)?

[@TomsTechAcademy]

Hi Anna, there's another video on my channel which shows how to loop through urls, visit every one of them and extract information. You can find it here: ruclips.net/video/nBzrMw8hkmY/видео.html
If you have any questions, don't hesitate to join my Discord and I will be happy to help you: discord.gg/WHJWFNDXXX