When we scrape data from a site, how can we identify whether the data is dynamic or static? For example, if it's dynamic, we should use Selenium, and if it's static, we should use BeautifulSoup. How can we identify this and decide which one to use for scraping?
Inspect the page source for the presence of data, use developer tools to see if content loads after the initial page load, and check the network tab for XHR requests. If the data is in the raw HTML, it’s static, so you can use BeautifulSoup for scraping; if it's loaded via JavaScript, opt for Selenium to interact with the page
Make a video where you fetch data of the Olympic 2024 medalists using web scraping and display it on the frontend using Flask or Streamlit, with a feature for filtering as well. This project will give many ideas, and there isn't a video like this on RUclips.
![Seungmin "그렇게, 천천히, 우리(As we are)" | [Stray Kids : SKZ-PLAYER]](http://i.ytimg.com/vi/kAzmhLHePqU/mqdefault.jpg)
When we scrape data from a site, how can we identify whether the data is dynamic or static? For example, if it's dynamic, we should use Selenium, and if it's static, we should use BeautifulSoup. How can we identify this and decide which one to use for scraping?
Inspect the page source for the presence of data, use developer tools to see if content loads after the initial page load, and check the network tab for XHR requests. If the data is in the raw HTML, it’s static, so you can use BeautifulSoup for scraping; if it's loaded via JavaScript, opt for Selenium to interact with the page
@SQAworld3493 thxx
Make a video where you fetch data of the Olympic 2024 medalists using web scraping and display it on the frontend using Flask or Streamlit, with a feature for filtering as well. This project will give many ideas, and there isn't a video like this on RUclips.