Live data from Hacker News

Bye Bye Craigslist

blog.padmapper.com

241–250 of 312 posts

Re: Bye Bye Craigslist

#241
post #112

Earlier quoted context omitted.

I would say this pretty much killed Carsabi.

Actually not. Enough of their content is direct from dealers that it looks like they will be able to bounce back.

Yeah, they still have quite a lot of content, and to be honest craigslist listings were some of the worst on there. Still, it was handy to just have one go to place for car shopping.

Re: Bye Bye Craigslist

#242
post #162
post #157

Earlier quoted context omitted.

They also don't have an API, and they also don't allow you to pay for a license or API for websites.

Do you have anything you're unwilling to sell? And if so is it cool if I just take it?

The difference here is that CL still has the content. We always end up in the same fruitless discussion with different subjects: software patents, content, digital media. Should you be able to own something if copying it is practically free? The only right answer is "no", but nobody likes it.

Re: Bye Bye Craigslist

#243
post #240

I'm surprised how many people here are defending Craigslist. They've got a history of both providing a terrible experience for apartment seekers and shutting down any attempts to use their data to provide a better experience. That would be okay in a competitive market, but they've got a strong monopoly in a market with a high barrier to entry. They're playing the textbook role of an evil monopolist.

Craigslist is a company whose terms of service were violated by PadMapper. Whether or not PadMapper provides a better experience is irrelevant: Craigslist has a right to defend its content and lists by whatever means it sees fit. Any businessperson on this site would expect to have the same rights.

Craigslist is not in the business of helping anyone but Craigslist be successful. It's not monopoly; it's business.

Re: Bye Bye Craigslist

#244

This is just offensive. It would be one thing if Craigslist was doing their best to satisfy their customers and they wanted to shut down others who were scraping their site and leeching off their business. However, Craigslist puts absolutely no effort into making their product usable. The continued existence of Craigslist is just a testimony to the enormous strength of network effect lock in.

Disagree. Craig Newmark has said that he's scared to make drastic changes to the UX specifically because he doesn't know what magic recipe keeps people coming back. Do I like the CL layout? Nope. Does that mean other people should steal the content and profit from it? Probably not.

You would think that they'd be able to measure these things. How hard can your flavor of a/b testing (or bandit testing for the bros) be to implement for a company like Craig's list.

It's just pure laziness and I'm sure the right talented team could make a product that beats Craig's list

Re: Bye Bye Craigslist

#245
post #212

Earlier quoted context omitted.

My apologies. I may have used some improper wording there. But if I may... you must admit that you have taken "something" from Craigslist. Whatever you want to call it... be it geographical location points, links-to-listings, content, data, images, etc... it is inevitably some form of information that was originally curated by Craigslist through their 10+ years of existence online and is thus available to be used (an…

Thanks for the explanation! I've talked with lawyers about this in the past week, and facts, totally rewritten summaries of fact, and collections of facts aren't copyrightable in the US, so it's not really an issue of their content, as far as I understand. They do have a right not to be crawled by me, though, especially if it causes a burden on them. I wrote that crawler specifically to be very light on their servers…

I agree that this isn't a copyright issue. If you're operating in California, the 9th Circuit is probably your best bet for holding that your scraping of their data doesn't damage or impair their computer system. But given your other comments, it is unlikely you want to raise the funds or spend the time to battle it out in court.

But there is an another way - let us (all of us) get the Craigslist data for you. You could create a browser plugin that would save craigslist posts a user views, and then upload only those posts to a central database that feeds padmapper. With just 1,000 users you would get most but not all the data you currently are scraping.

This is the same approach used by Recap (https://www.recapthelaw.org/) as a response to the federal government's paywall to access public court filings.

Re: Bye Bye Craigslist

#246

Earlier quoted context omitted.

The magic recipe that keeps people coming back is that Craigslist has a large network. I would be willing to bet a large amount of money that adding a map to search results and letting me put an upper limit on the number of bedrooms I'm looking for would not make people less likely to use Craigslist.

To be fair to Craigslist, since everyone and their grandma uses it, I'd imagine a lot of users have underpowered computers, outdated browsers, and low bandwidth connections. I've seen padmapper slow wayyyy down on my i7 macbook with 8GB ram, I can't imagine what it'd be like on grandma's 5 year old budget PC.

I don't see how the existence of padmapper could hurt the grandmas that use craigslist.org

Re: Bye Bye Craigslist

#247

Earlier quoted context omitted.

Does that mean other people should steal the content and profit from it? Craigslist is unwilling to let Padmapper buy a license to use their content. This isn't as black and white as "stealing content".

Content not available for licensing is a justification for infringement? That doesn't ring true at all for me - exclusive content is often much more valuable to a business than content that's licensed. I doubt anyone would think that goldman sachs coverage being distributed by morgan stanley would fit under some "no harm, no foul" ethos even if Morgan significantly improved on the layout of the pages.

Is there a rock bottom hackernews will reach for leaning on shockingly bad analogies to make a point?

Re: Bye Bye Craigslist

#248

This is just offensive. It would be one thing if Craigslist was doing their best to satisfy their customers and they wanted to shut down others who were scraping their site and leeching off their business. However, Craigslist puts absolutely no effort into making their product usable. The continued existence of Craigslist is just a testimony to the enormous strength of network effect lock in.

couldn't agree more. i've tried to write my own scraper in the past to make the search more usable (at least show photos from each post next to the link so that i don't have to click through to every single link to see what pieces are for sale) and i was quickly blocked. keep in mind this was not a public site viewed by 100's of people. it was me making one search worth of individual link requests a couple times. blocked. its craigslist way or nothing.

Re: Bye Bye Craigslist

#249

I hope this doesn't get down-voted for the confusing title (I know it's the title of the Blog post itself; but out of context it's a bit misleading). When I moved from Atlanta to Boston, PadMapper was invaluable in finding a place to live. Given that 1) we didn't know the area, and 2) most rentals in Boston and Cambridge are rented by individuals rather than part of larger complexes, it was great to be able to have t…

PadMapper is a great tool that deserves access to that data. Why do they deserve access?

Because it's highly beneficial to people that use craigslist, including the people that list properties. Craigslist is only hurting itself!

Re: Bye Bye Craigslist

#250
post #240

I'm surprised how many people here are defending Craigslist. They've got a history of both providing a terrible experience for apartment seekers and shutting down any attempts to use their data to provide a better experience. That would be okay in a competitive market, but they've got a strong monopoly in a market with a high barrier to entry. They're playing the textbook role of an evil monopolist.

Craigslist is a company whose terms of service were violated by PadMapper. Whether or not PadMapper provides a better experience is irrelevant: Craigslist has a right to defend its content and lists by whatever means it sees fit. Any businessperson on this site would expect to have the same rights. Craigslist is not in the business of helping anyone but Craigslist be successful. It's not monopoly; it's business.

Companies are not free to do whatever they want. The government compels monopolists to avoid anticompetitive behavior, and even breaks companies up, for examples. The market in this case is a little hard to define, since apartment seekers aren't purchasing the product, so I'm sure it's not actually illegal, but it sure seems to violate the spirit of these laws, which are designed to protect consumers from exactly this kind of behavior.
Post reply on HN