I want an app which let's me design webscrapping workflows visually. Then once workflow is completed, upload it to cloud and run N instances of this workflow. There was a software called SpiderClimber for this. Unfortunately, the author disappeared and software too. Edit: i want to extract ad banners from websites, think Google ads or any other ad network ads. Pop ads etc... Including redirect sequence and page's scr…
You can build this with scrapinghub.com — IIRC it’s a portia project. Kimono was the best for this until it went through a quiet exit to Palantir.
Also, it didn't handle popup windows. And you couldn't select which popup window to switch to.