I don't buy the “scraping” protection when appending .json to any reddit URL still gives you the data. Example: https://www.reddit.com/r/whatisit/comments/1v3mzl6/what_is_t...
So Reddit has decided that plain HTML is unsafe
411–420 of 681 posts
Re: So Reddit has decided that plain HTML is unsafe
#412I think at this point I'm ready to give up on Reddit, most of my questions are already answered by LLM. And the discussions quality on Reddit are abysmal, its filled with bots.
> I think at this point I'm ready to give up on Reddit, most of my questions are already answered by LLM. That's a bizarre and self-sabotaging path to take. Almost all LLMs get a substantial portion of their knowledge from Reddit. In order to evaluate the quality of those LLM responses, you'll have to click through to the Reddit threads and critically evaluate the quality of the underlying discussions. If you just bl…
Err... I spend quite a lot of time on Reddit as well (including moderating a medium size subreddit) and I can assure you that there are tons of bot posts and comments all over the site right now. If you think this, you're probably not very good at identifying this kind of content.
Re: So Reddit has decided that plain HTML is unsafe
#413I refuse to log in to Reddit, deleted my account ages ago. And now on mobile it places an unclosable pop-over asking me to log in to continue reading. So now I only read things on desktop. Would like to stop using Reddit all together but sometimes it is genuinely useful to read some human answers, although since LLM’s train on the data I can get a lot of the same info that way at least.
Re: So Reddit has decided that plain HTML is unsafe
#414Earlier quoted context omitted.
They're just trying to manufacture a reason to kill off old reddit. Someone internally clearly hates the fact that its still quite popular, despite all the efforts to make it unusable so far
The day they kill off old.reddit.com is the last time I'll visit Reddit (after >15 years, >7,000 comments & >70,000 karma). Old.reddit, the Reddit Enhancement Suite (RES), custom userstyle CSS and uBlock make Reddit tolerable. Admittedly, Reddit might be fine with losing me because I only ever see the small niche subs I'm subscribed to, most have less than 100K subs and none have more than a million. I haven't seen t…
They look at the big groups, but don't really pay much attention to the smaller groupings. They also don't pay much mind to who is on those smaller groupings.
I'm willing to bet that all those little groups, are what attracted people to Reddit to start with. The local city forums, or the niche group of people interested in... tumbleweeds or something. Then they progress to "more of reddit". And it's people looking to start small niche communities, which often become larger communities.
But... much like Stack Overflow, Reddit wars with its users. Fights with them.
This change has nothing to do with bots, or AI. I was commenting the other day, that imdb.com has decided that 'reading reviews of movies' requires an account now. They claim it's to 'keep movie comments by humans for humans', which makes zero sense, they simply don't want bots summarizing those comments for humans.
Here's the truth. LLMs are changing everything. People in the industry need to get over it, because they're not going away. Reddit should just stand up a highly optimized, API driven interface for AI. There should be notes at the start of every page "BOT HIT THIS API, instructions are ". It's just the cost of business now. And yeah, I know it's brutal, but here's the thing...
Bots don't care about ads, side panes, updated info, it's actually a vast reduction in resources to serve via such an API.
But the problem, the true problem is the absolute horror show that reddit itself has become. All these forced clicks to read a thread, so they know if you're doing so. All the engagement stats they worry about, at the complete destruction of user engagement. It's like someone on crack is obsessing over all the wrong things.
So there won't be an API. And soon you'll need to login to just read something. And of course, that won't last long, because the whole 'need an account' paradigm is going away. Personal LLMs will have their own mailbox, heck with gmail you can just move a . for sorting and filtering, and they'll easily sign up for accounts and then search anyhow.
You'll never, ever win this Reddit. Just like you lost every other battle before.
To every web property there is? If you fight your users, you're literally fighting to destroy yourself.
And LLMs? Are now the user.
Re: So Reddit has decided that plain HTML is unsafe
#415Earlier quoted context omitted.
Didn’t they just say they’re removing this? https://www.reddit.com/r/modnews/comments/1tq9vxo/protecting...
They did remove it. Note that it says unauthenticated JSON access. You can't get the data if you didn't authenticate. On that note, X.com seems to be doing the opposite — you can only see this page if you DIDN'T log in... https://x.com/coinbureau/status/2071330294452666695/mediavie...
I’m not logged in yet I can access below JSON?
https://www.reddit.com/r/whatisit/comments/1v3mzl6/what_is_t...
Oh, private browsing window, it is blocked. Until I load new Reddit (even unauthenticated), then it starts working. Presumably you need a cookie
Re: So Reddit has decided that plain HTML is unsafe
#416Re: So Reddit has decided that plain HTML is unsafe
#417Earlier quoted context omitted.
While most of the rant was indeed about their posturing (which I personally would not call "politics" but we need not debate semantics here if I understood you well enough), even putting that aside I wasn't able to find strong evidence of the "security measures" you speak of. If you're more familiar with the mechanisms by which New Reddit defends itself against scraping, I'm happy to issue a correction --- especially…
It's not necessary to analyze the specifics of reddit's architecture. This is a common pattern across many services that can be accessed by more than 1 client, whether it me on the same platform/device/OS or different. For example an SaaS provider might offer support for Windows Vista, and when Windos 8 releases, they still support Windows Vista, and when Windows 10 releases, they are now supporting 3 versions. They…
It seems we both agree, though, that Old Reddit is not long for this world. Which I find regrettable.
Re: So Reddit has decided that plain HTML is unsafe
#418Earlier quoted context omitted.
They blocked old.reddit.com unless you are logged in on Monday. I don't have an account on there anymore so that effectively blocks me from the entire platform. Oh well.
I was using old.reddit.com on my pocket supercomputer (not logged in) on Tuesday.
Re: So Reddit has decided that plain HTML is unsafe
#419Earlier quoted context omitted.
Old–school forums never left, still inhabited by the few boomers and genXers who could figure out the Internets back in the day and aren't dead yet. The gamification of Reddit and the ephemeral nature of the main page along with subreddits with varying amounts of overlap contributed to more active interactions, though. Some of the volume was lower quality but not all. The boomer posts about his petunia breeding progr…
Forms are sadly dead. They cost a lot to operate and maintain security updates for so without a critical mass of users they are dead
I know endless local groups. Bike clubs. Hobby groups. They still all run on forums and mailing lists. No ads. No tracking. No doom-scrolling or this and that. Cost?
For many of them, a $5/month VM.
Re: So Reddit has decided that plain HTML is unsafe
#420The reason was censorship by insane moderators. I am also hardly the only one - there is so much criticism about reddit on reddit that it is quite interesting to see reddit has not yet died already. On the one hand, some info on reddit is useful, but on the other hand, I would not be in the slightest concerned if reddit were to be removed - nobody needs censordit.
Thinking about it, I actually should have also deleted all my contributions; feels a bit unfair that they can still benefit from what I wrote even though they (many moderators) censored me.