11–20 of 105 posts
Also, did you get permission from craigslist to index their listings? I was looking into building something like this, but their terms said something along the lines of "don't access our site with a crawler unless we give you permission".
No Datsun?!? For "car guys" you need to allow searching by the platform code. Way more important and specific than the decade-spanning model names. For example "e30" should return '83-91 BMW 3 Series. Love that you can specify Slushbox/Manual and exclude salvage titles. Very annoying that middle-clicking car posting titles on the 'grid view' page does not open the cars in new tabs. I want to scan through the list and…
7. CONDUCT
You agree not to post, email, or otherwise make available Content: ...
u) use automated means, including spiders, robots, crawlers, data mining tools, or the like to download data from the Service - unless expressly permitted by craigslist;
I am wondering if you already have permission from craigslist?
According to the Craigslist Terms Of Use ( http://www.craigslist.org/about/terms.of.use ) 7. CONDUCT You agree not to post, email, or otherwise make available Content: ... u) use automated means, including spiders, robots, crawlers, data mining tools, or the like to download data from the Service - unless expressly permitted by craigslist; I am wondering if you already have permission from craigslist?
I have heard -- anecdotally, at least -- that while that TOS exists, CL practically enforces this if you're (a) straining the site and/or (b) using it for commercial purposes that seem to go against the spirit of CL. [Hence, neat things like Padmapper, the author of which is really like the nicest guy based on limited interactions.]
(Disclosures: I read this a few years ago for another project, and I also happen to know one of the developers of this site.)
I can't seem to get this to work. I type "Vancouver" in the "near" box and I just get a message that says "Please match the requested format.". What's the requested format? What did I do wrong?
Nice job. Suggestion: specify what format you expect for the "Near" field. It took me a few tries to realize it wanted a ZIP code (and all the while it was telling me to "match the requested format"). Also, did you get permission from craigslist to index their listings? I was looking into building something like this, but their terms said something along the lines of "don't access our site with a crawler unless we gi…
As to Craigslist - we'll see? We actually built a pretty robust classification engine that you can run on any html, so we've added about 600 dealerships in California and are planning on running the crawler on dealerships nationally soon if we can get more server money. I think we're hoping that if we provide a free service where you can see what better deals Craigslist has compared to Autotrader etc people will generally think its cool instead of lame. Thanks for checking us out!