Do not use Selenium for web scraping
buklijas.info
Do not use Selenium for web scraping
1–3 of 3 posts
Re: Do not use Selenium for web scraping
#2> The only exception that I could see for using Selenium as web scraping tool is if a website that you are scraping is using JavaScript to get/display data that you need to scrape.
Like 95% of web sites?
Re: Do not use Selenium for web scraping
#3> The only exception that I could see for using Selenium as web scraping tool is if a website that you are scraping is using JavaScript to get/display data that you need to scrape. Like 95% of web sites?
Scrapy does have the solution for JavaScript with Splash, but I have never used it, so far I always found some workaround.