Viewing profile — jeffjia

The browser "back" button for the website is broken...

Self-driving cars need to be trained to run on left side now.

Let's just have Nest...

Thanks Johnie. It is almost what I want, except that it is not open-source and free...

Yeah. Me too. The css selector is quite convenient. The only problem is that I need to pick the selector set for each website I need to scrape, and there are tens of them, which ma…

Thanks. I used beautiful soup for the parser, and actually have written a crawler framework for my scenario. But I was wondering whether there is any tool that could automate the s…

I was using mechanizer + beautiful soup in python before, but it seems that this one also needs human to read the html source code to pick a css selector instead of automating it..…

Hi, In one of my projects, I happen to need to get some scrapers running for tens of websites to collect rows, columns of tables ( , , ). Those tables are well formatted. I have wr…

The question itself may be joke, and I myself really appreciate hard working. But I am still curious to know some interesting, funny and slightly serious ideas, such as "million do…

Thanks, jakedahn. I really appreciate your suggestion. I would try only using Dropbox for authentication in the next version.