Live data from Hacker News

So Reddit has decided that plain HTML is unsafe

cole-k.com

411–420 of 681 posts

Re: So Reddit has decided that plain HTML is unsafe

#411

I don't buy the “scraping” protection when appending .json to any reddit URL still gives you the data. Example: https://www.reddit.com/r/whatisit/comments/1v3mzl6/what_is_t...

It only works if you are authenticated, and if you are authenticated there's a heavy rate limit on it. The unauthenticated one that scrapers used is gone. They also detect if you are using a headless browser vs a regular one in many cases.

Re: So Reddit has decided that plain HTML is unsafe

#412

I think at this point I'm ready to give up on Reddit, most of my questions are already answered by LLM. And the discussions quality on Reddit are abysmal, its filled with bots.

> I think at this point I'm ready to give up on Reddit, most of my questions are already answered by LLM. That's a bizarre and self-sabotaging path to take. Almost all LLMs get a substantial portion of their knowledge from Reddit. In order to evaluate the quality of those LLM responses, you'll have to click through to the Reddit threads and critically evaluate the quality of the underlying discussions. If you just bl…

>I spend quite a lot of time reading and writing on Reddit, and while I encounter plenty of low-quality posts and comments, I'd say that essentially none of them are written by bots.

Err... I spend quite a lot of time on Reddit as well (including moderating a medium size subreddit) and I can assure you that there are tons of bot posts and comments all over the site right now. If you think this, you're probably not very good at identifying this kind of content.

Re: So Reddit has decided that plain HTML is unsafe

#413

I refuse to log in to Reddit, deleted my account ages ago. And now on mobile it places an unclosable pop-over asking me to log in to continue reading. So now I only read things on desktop. Would like to stop using Reddit all together but sometimes it is genuinely useful to read some human answers, although since LLM’s train on the data I can get a lot of the same info that way at least.

Use incognito mode. The banner doesn't pop up with it.

Re: So Reddit has decided that plain HTML is unsafe

#414
post #293

Earlier quoted context omitted.

They're just trying to manufacture a reason to kill off old reddit. Someone internally clearly hates the fact that its still quite popular, despite all the efforts to make it unusable so far

The day they kill off old.reddit.com is the last time I'll visit Reddit (after >15 years, >7,000 comments & >70,000 karma). Old.reddit, the Reddit Enhancement Suite (RES), custom userstyle CSS and uBlock make Reddit tolerable. Admittedly, Reddit might be fine with losing me because I only ever see the small niche subs I'm subscribed to, most have less than 100K subs and none have more than a million. I haven't seen t…

This is the mistake so many platforms and software packages make.

They look at the big groups, but don't really pay much attention to the smaller groupings. They also don't pay much mind to who is on those smaller groupings.

I'm willing to bet that all those little groups, are what attracted people to Reddit to start with. The local city forums, or the niche group of people interested in... tumbleweeds or something. Then they progress to "more of reddit". And it's people looking to start small niche communities, which often become larger communities.

But... much like Stack Overflow, Reddit wars with its users. Fights with them.

This change has nothing to do with bots, or AI. I was commenting the other day, that imdb.com has decided that 'reading reviews of movies' requires an account now. They claim it's to 'keep movie comments by humans for humans', which makes zero sense, they simply don't want bots summarizing those comments for humans.

Here's the truth. LLMs are changing everything. People in the industry need to get over it, because they're not going away. Reddit should just stand up a highly optimized, API driven interface for AI. There should be notes at the start of every page "BOT HIT THIS API, instructions are ". It's just the cost of business now. And yeah, I know it's brutal, but here's the thing...

Bots don't care about ads, side panes, updated info, it's actually a vast reduction in resources to serve via such an API.

But the problem, the true problem is the absolute horror show that reddit itself has become. All these forced clicks to read a thread, so they know if you're doing so. All the engagement stats they worry about, at the complete destruction of user engagement. It's like someone on crack is obsessing over all the wrong things.

So there won't be an API. And soon you'll need to login to just read something. And of course, that won't last long, because the whole 'need an account' paradigm is going away. Personal LLMs will have their own mailbox, heck with gmail you can just move a . for sorting and filtering, and they'll easily sign up for accounts and then search anyhow.

You'll never, ever win this Reddit. Just like you lost every other battle before.

To every web property there is? If you fight your users, you're literally fighting to destroy yourself.

And LLMs? Are now the user.

Re: So Reddit has decided that plain HTML is unsafe

#415
post #345

Earlier quoted context omitted.

Didn’t they just say they’re removing this? https://www.reddit.com/r/modnews/comments/1tq9vxo/protecting...

They did remove it. Note that it says unauthenticated JSON access. You can't get the data if you didn't authenticate. On that note, X.com seems to be doing the opposite — you can only see this page if you DIDN'T log in... https://x.com/coinbureau/status/2071330294452666695/mediavie...

> They did remove it. Note that it says unauthenticated JSON access. You can't get the data if you didn't authenticate.

I’m not logged in yet I can access below JSON?

https://www.reddit.com/r/whatisit/comments/1v3mzl6/what_is_t...

Oh, private browsing window, it is blocked. Until I load new Reddit (even unauthenticated), then it starts working. Presumably you need a cookie

Re: So Reddit has decided that plain HTML is unsafe

#417
post #215

Earlier quoted context omitted.

While most of the rant was indeed about their posturing (which I personally would not call "politics" but we need not debate semantics here if I understood you well enough), even putting that aside I wasn't able to find strong evidence of the "security measures" you speak of. If you're more familiar with the mechanisms by which New Reddit defends itself against scraping, I'm happy to issue a correction --- especially…

It's not necessary to analyze the specifics of reddit's architecture. This is a common pattern across many services that can be accessed by more than 1 client, whether it me on the same platform/device/OS or different. For example an SaaS provider might offer support for Windows Vista, and when Windos 8 releases, they still support Windows Vista, and when Windows 10 releases, they are now supporting 3 versions. They…

While I appreciate you taking the time to reply, I'm interested in the particulars of what constitutes security in New Reddit.

It seems we both agree, though, that Old Reddit is not long for this world. Which I find regrettable.

Re: So Reddit has decided that plain HTML is unsafe

#418
post #374

Earlier quoted context omitted.

They blocked old.reddit.com unless you are logged in on Monday. I don't have an account on there anymore so that effectively blocks me from the entire platform. Oh well.

I was using old.reddit.com on my pocket supercomputer (not logged in) on Tuesday.

I am using it right now and it still works for me. I guess it's a rollout. Someone mentioned cookies, maybe it will stop working when they expire, I am not willing to clean them to find out.

Re: So Reddit has decided that plain HTML is unsafe

#419

Earlier quoted context omitted.

Old–school forums never left, still inhabited by the few boomers and genXers who could figure out the Internets back in the day and aren't dead yet. The gamification of Reddit and the ephemeral nature of the main page along with subreddits with varying amounts of overlap contributed to more active interactions, though. Some of the volume was lower quality but not all. The boomer posts about his petunia breeding progr…

Forms are sadly dead. They cost a lot to operate and maintain security updates for so without a critical mass of users they are dead

Cost a lot to operate? apt-get install forum-software. All security updates with apt-get updates. Use something like Debian, and you keep the same forum software for years with zero config changes, but with security updates.

I know endless local groups. Bike clubs. Hobby groups. They still all run on forums and mailing lists. No ads. No tracking. No doom-scrolling or this and that. Cost?

For many of them, a $5/month VM.

Re: So Reddit has decided that plain HTML is unsafe

#420
I retired from reddit last year or perhaps two years ago already.

The reason was censorship by insane moderators. I am also hardly the only one - there is so much criticism about reddit on reddit that it is quite interesting to see reddit has not yet died already. On the one hand, some info on reddit is useful, but on the other hand, I would not be in the slightest concerned if reddit were to be removed - nobody needs censordit.

Thinking about it, I actually should have also deleted all my contributions; feels a bit unfair that they can still benefit from what I wrote even though they (many moderators) censored me.

Post reply on HN