11–20 of 29 posts
This is great for simple, quick job. However, you can do only so much in a local browser itself. I basically built a bookmarklet that let's you define the actions locally on your browser, and then run the scrapes in your own box, essentially allowing unmetered scraping without charging per page. http://scrape.ly
this jquery injection looks kind of dangerous. Looks like code from code.jquery.com is loaded into any page. Say I go to https://secretsquirrel.com and they have been very careful to only load javascript from their own domain but now it can also load malicious javascript from https://code.jquery.com . it also disable CSP. i'm not exactly sure how the extension works. maybe it is turned on/off on per tab basis and def…
Still not convinced by the reasons offered for client-side scraping. If I'm on my browser, I'm not interested in consuming JSON. Scraping is really something that's better done in the back end, and today, there are a lot of libraries that let you access web sites from Java and run all the Javascript you need in order to display the page properly.
Still not convinced by the reasons offered for client-side scraping. If I'm on my browser, I'm not interested in consuming JSON. Scraping is really something that's better done in the back end, and today, there are a lot of libraries that let you access web sites from Java and run all the Javascript you need in order to display the page properly.
To each their own. I'm not interested in systematic scraping. I just want to take back, take home the web experience I've had, and be able to digest and work with it latter. The things that I want to work with are the sights and experiences I've had. Client side is perfect. Second, if I was trying to scrape, I'd rather do scraping with WebDriver than anything else, and injecting some client side scraping tools and us…
If we want to Publish Everywhere Syndicate to Own Site (#IndieWeb dubs this PESOS), if we want to have our own experiences we can talk about, client side is the way to go.
Yeaaaah you might wanna rename that. I think the other Artoo already has enough traction and this will just confuse people.
Yeaaaah you might wanna rename that. I think the other Artoo already has enough traction and this will just confuse people.
This is great for simple, quick job. However, you can do only so much in a local browser itself. I basically built a bookmarklet that let's you define the actions locally on your browser, and then run the scrapes in your own box, essentially allowing unmetered scraping without charging per page. http://scrape.ly
closed beta?
It's annoying to have to run scripts multiple times, tweaking it after each run to get exactly what you need. It's a waste of time...