Live data from Hacker News

APIs for content sites must be free

somebits.com

211–220 of 300 posts

Re: APIs for content sites must be free

#211

Earlier quoted context omitted.

Getting something valuable for free sounds weird in the physical world but it's not weird at all in the information world, where costs can diffuse so thinly that many users never even see them. I see no reason why a non-profit reddit couldn't be free if they didn't try to host video or images (links and comments only). Server costs could absolutely be covered by donations (like "reddit gold") and intra-site advertisi…

I know of one long-running message board site which is free of advertising and free for users. A number of users make regular donations and occasionally when funds are low they make an announcement and some other users make a one-off donation. I am very doubtful their model would scale to Reddit's size, and certain they don't have any wish to.

Metafilter? Something Awful?

Re: APIs for content sites must be free

#212
post #12

The most accurate/charitable interpretation of the content, despite the abysmal title, would be: If users provide content for free, then a platform must allow users to consume that content freely , as in "as they wish", not "for free". The author supposes that this is a fundamental social contract between users and platforms that needs to exist for platforms to work well. The author does not cite any evidence or exam…

It's a demand masquerading as an argument.

Re: APIs for content sites must be free

#213

The use of the word "must" (in both the title and the body) is uninformative. What on Earth does it mean? Does it mean there's a law? A moral imperative? A strategic necessity? A technical requirement? Is the author claiming some form of jurisdiction? "It must provide APIs" isn't an argument. It can't be taken literally because it's clearly false. And it can't be taken in any other form because the author doesn't tel…

I fail to follow your chain of reasoning. How can the claim both be "clearly false" and unclear in its statement? The use of "should" as the very first line of the body text actually makes the argument extremely clear, which is that there is a non-legal, non-technical imperative for API access [leaving only a moral/social imperative, as you determine]. I think you are probably smarter than the very low reading compre…

> there is a non-legal, non-technical imperative for API access [leaving only a moral/social imperative, as you determine].

There is no more an argument here than if I said there was a moral/social imperative for them to clean my house. An argument derives conclusions from premises.

Re: APIs for content sites must be free

#214
If you don't provide an API for your content, but you're happy to render some HTML containing the content when I browse to your website, then if I want the content, I will get the content. No API is necessary. I will happily waste your resources scraping HTML if it's necessary to get the content I want, so it's in your best interest to provide it via an API, which is ultimately just a more efficient interface to the same data you're already providing me for free.

Re: APIs for content sites must be free

#215
post #130
post #114

Earlier quoted context omitted.

> A ceasefire during a battle is an example of a social contract. This is absolutely false. A ceasefire is not a social contract. It's just bizarre to even claim this, as ceasefires are most often enacted in the context of ceasefire.. uh, treaties . > Not eating your coworkers' food in the office fridge is another example of a social contract. This is a better example (though still a very poor one, as we have laws ag…

"Why would free API access be an implication of using reddit's service?" Because they offered free API access for 17 years. Same way Heroku breached a social contract when they got rid of their free tier: if you offer something like that for more than a decade, people will reasonably expect it to continue and will be angry with you if you pull the rug on them.

> Same way Heroku breached a social contract when they got rid of their free tier: if you offer something like that for more than a decade, people will reasonably expect it to continue and will be angry with you if you pull the rug on them.

That's not a social contract, it's the definition of entitlement. By no interpretation is it reasonable to expect anybody to offer a free service indefinitely. Thinking otherwise is just a form of social parasitism that strips the host of its own agency, because they were dumb enough to make a handshake agreement decades ago.

Like decrying your favorite band for "selling out" and evolving with the times. You'd rather they only make music a diminishing fanbase wants, until they starve?

Even child support agreements can be renegotiated every 3 years and last up to 21 years at most if your ex's attorney is particularly conniving. You likely renegotiate your own salary every 1-3 years as well. Reddit stuck to their end of the agreement for 17 years (already impressive for anything in tech!), it's now untenable, but fuck them for not going insolvent.

Only the generations raised with the internet seem to have the expectation that if you offer anything for free, you're expected to continue doing so forever even if it kills you.

Re: APIs for content sites must be free

#216
post #13

I like vehement arguments even when I disagree with them. Based on this man's logic, if I were to run a web forum then I must provide an API or data dump to download the posts created by the users? How about a comment section on my blog? How about a community Discord server? Why not Facebook posts? Or Instagram stories? I often get the feeling that in these circumstances people derive first principles from specific d…

Some people perceive Reddit as a platform build with their tax money. The argument usually goes that Reddit is build with the free labor of participants, but I think they forget that they also receive an experience in return.

Re: APIs for content sites must be free

#217
post #86

All of your labor should be free also. What do you mean you want a six figure salary? How incredibly greedy of you. It's fair to pay you only what you need to survive.

> All of your labor should be free also. Yes, it is, and that's ultimately the contention here. Reddit has taken many millions of man hours of free labor. Now it wants to charge for the fruits of that free labor. Legally, they are within their rights to do so. Socially, however, it's thought to be uncouth to exploit workers like that.

> Reddit has taken many millions of man hours of free labor.

Reddit has accepted many millions of man-hours of labor. They didn't kick down anybody's door and take it.

Re: APIs for content sites must be free

#218
> Their main intent is to destroy third party apps that no longer aid the company’s business goals. But they’re also trying to make a few million bucks a year licensing access to data, particularly on the back of AI training. It’s wrong.

This seems backwards to me. It's obviously a move to try (and likely fail, assuming screen scraping works well enough) getting in on the AI money train by charging for Reddit's data being used to train LLMs. I don't think Appolo and other 3P clients are the target of this API change, even if the results of it are anti-competitive and should be stopped regardless of intent.

Re: APIs for content sites must be free

#219
post #53

I've found myself resisting posting comments on Reddit recently - things like answers to simple questions people have about SQLite - partly because I don't want to cross the picket line but also because I realize that I was relying on a very light social contract that was in place there: I would share my knowledge for free, in exchange for which I knew that I was contributing to a larger dataset that myself and other…

Same, I wish we could contribute content (posts, comments, votes, etc) in a redistributable way. I'd like to a P2P-backed service to exist, where people can own all the data. I guess that abuse would be a challenge, but there's probably enough good ideas around bittorrent and cryptocurrency to make sharing and trust/voting possible. My dream is that people could have a ~raspberry at home helping host the internet in…

Inefficiency was always a red herring.

$ curl https://www.reddit.com > /dev/null

    % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                   Dload  Upload   Total   Spent    Left  Speed
  100  970k    0  970k    0     0   840k      0 --:--:--  0:00:01 --:--:--  840k
That's just the index, not images or anything pulled in by scripts. That page takes longer to download on a gigabit internet connection than the The biggest problem is actually funding. The centralized site puts ads on it or tells VCs they could, and then has money to pay for developers or other things that increase the user base.

It's the same reason Linux is used by programmers and not graphic designers. If there is anything deficient about it in the programmer's workflow they fix it for everybody. If there is anything deficient about it in the graphic designer's workflow, they don't know how to fix it so they get a Mac and run Adobe. Social media sites work more like the latter than the former until someone finds a way around that.

Re: APIs for content sites must be free

#220

Earlier quoted context omitted.

Can someone explain to me why Reddit can't have different price tiers for their API service? Why can't they charge people who want to scrape en masse (LLM trainers) 10-100x more than mobile app API users?

Absolutely nothing. I don't understand why they don't just support OAuth and then the api usage would be by user, not by the app itself. Otherwise apps like apollo technically would be some of the biggest "users" of the api. What's wild to me isn't just the amount, it's the lack of time. In theory APollo might have enough users will to pay enough for them to profit (albiet with a fraction of the users). But because t…

> I don't understand why they don't just support OAuth

OAuth breaks peoples brains and I can only imagine the tech / political debt reddit has

Post reply on HN