Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Google is the only search engine that works on Reddit now, thanks to AI deal

404media.co

Post reply on HN
Print view View original

341–350 of 379 posts

Re: Google is the only search engine that works on Reddit now, thanks to AI deal

#341

Post by account42 »

Elfener wrote: post #7

I mean, the reddit company did go public, so things like this were inevitable. Also things like the API fiasco, and also small annoyances like the fact that when you click on an image on reddit, it now goes to a wrapper html page instead of just the actual image (this was one of the reasons reddit was better than most social media...).

It used to be that Reddit didn't host images and you'd have to link (often shitty) external image hosts. The someone created imgur to host images for reddit. And slowly but surely imgur became just another shitty image host (and social media site for some reason). Then reddit wanted some of the dough imgur was pulling in (probably just making losses) and added their own image hosting. At first it worked just like you are saying with you getting direct links to the image file. Now they also turned into yet another shitty image host.

Part of the blame for the redirect-to-wrapper page lies with browsers. If browsers didn't let servers reliably differentiated between a direct request and an embed then this practice would not be as widespread.

Re: Google is the only search engine that works on Reddit now, thanks to AI deal

#342

Post by ToucanLoucan »

lotsofpulp wrote: post #335
account42 wrote: post #329

Earlier quoted context omitted.

> Popular websites that allow user content to be uploaded or linked do cost that much to run, due to content moderation. Reddit outsourced most of it's moderation to unpaid volunteers.

I am referring to moderation of child sexual abuse material and other legally problematic content. I assume volunteers do not handle that.

I don't see how that would fall to different people in reddit's case. I'm sure reddit has some moderators on staff but the vast, vast majority of their moderation happens on the proverbial front lines, which is basically all volunteers. I would hope there's a dedicated abuse team at Reddit that are actually paid people whom the volunteers can kick the truly sick shit to so it can be properly dealt with, but given the corporate culture Reddit has shown over the years, I also wouldn't be awfully surprised if it's JUST down to the volunteers either.

Re: Google is the only search engine that works on Reddit now, thanks to AI deal

#343

Post by elashri »

WarOnPrivacy wrote: post #333
hugh_kagi wrote: post #183

Earlier quoted context omitted.

> Are they finally applying filters and operands to image searches? That was a bug, apologies. It should be fixed now.

I sincerely appreciate the diligence. I really did see Pinterest results over a longish span. I may well have only noted their presence and not their absence - skewing my perspective. Overall, my experience is very positive. I'm on many PCs throughout the day and I miss Kagi when it isn't there.

Pinterest serves pages in many domains (different TLDs). It is better to use a regex to block them.

Re: Google is the only search engine that works on Reddit now, thanks to AI deal

#344

Post by neongreen »

sssilver wrote: post #311
tedivm wrote: post #210

Earlier quoted context omitted.

According to the US court systems the robots.txt file is meaningless. If they respond with a 200 status code giving you the access then you can legally scrape it all you want. If they require that you log in then you have to follow the terms you agree to when creating an account. Public means public though, and if Reddit doesn't want to make the content private (put it behind a login) then we can scrape away. Note th…

Fascinating. Where can one learn more about this?

I liked the chapter on DMCA from the 5-volume E-Commerce & Internet Law. It was super detailed.

I haven’t read volume 1, but apparently half of it is about data scraping, and I expect it to be similarly detailed. So if I were you, that’s where I’d start.

Another option is looking for “robots.txt” at Google Scholar and trying various keywords like “legality”, “scraping”, “case law”, etc.

Re: Google is the only search engine that works on Reddit now, thanks to AI deal

#345

Post by zooq_ai »

nativeit wrote: post #299
not_wyoming wrote: post #255

Earlier quoted context omitted.

If you check citations, you'd find the sentence preceding my excerpt on barriers to entry: "Because barriers to entry protect incumbent firms and restrict competition in a market, they can contribute to distortionary prices and are therefore most important when discussing antitrust policy." Antitrust policy then links to a page on competition law: "Competition law is the field of law that promotes or seeks to maintai…

I took care of the down vote for you. I dunno when the privilege is earned, but keep up the quality comments and you’ll be able to downvote incurious ideologues like this in no time!

HN Downvotes on non-engineering things are my badge of honor. It has rewarded very well financially

Re: Google is the only search engine that works on Reddit now, thanks to AI deal

#346

Post by em-bee »

MichaelZuo wrote: post #307
em-bee wrote: post #264

Earlier quoted context omitted.

if that is true then they are lying on their site where they claim: " Brave Search operates from a fully independent search index " do you have any reference for your claim? i use brave search and find it very useful. very rarely there is something i can't find, and when i run into that other search engines are not much better.

Notice that it doesn't say "Brave Search solely operates from..." or "only operates from"? Instead the wording leaves wiggle room for the possibility of using multiple.

it would still be lying by omission at least

Re: Google is the only search engine that works on Reddit now, thanks to AI deal

#347

Post by Khelavaster »

dogleash wrote: post #116
popcalc wrote: post #5

# Welcome to Reddit's robots.txt # Reddit believes in an open internet, but not the misuse of public content. # See https://support.reddithelp.com/hc/en-us/articles/26410290525844-Public-Content-Policy Reddit's Public Content Policy for access and use restrictions to Reddit content. # See https://www.reddit.com/r/reddit4researchers/ for details on how Reddit continues to support research and non-commercial use. # pol…

> # Reddit believes in an open internet, but not the misuse of public content. Calling it "public" content in the very act of exercising their ownership over it. The balls on whoever wrote that.

The Fake News police should shut down this sort of messaging

Re: Google is the only search engine that works on Reddit now, thanks to AI deal

#348

Post by cyanydeez »

Work is such a flimsy word for qhat google currently does with search

As soon as someone shows me a search engine that restores quality of searxh, im getting a subscription for work.

It really cany be hard to whitelist sources and index appropiately.

Get goimg nerds , google has fallen.

Re: Google is the only search engine that works on Reddit now, thanks to AI deal

#349

Post by cyanydeez »

account42 wrote: post #318
shit_game wrote: post #272

Earlier quoted context omitted.

Their license/Eula clearly state that Reddit has perpetual whatever to content posted on Reddit, but relying solely on DMCA for "stolen" content _yet again_ feels like a terrible way to deal with non-original content. Part of me hopes that Reddit gets hit with some new precidence-setting lawsuits regarding non-original content that requires useful attribution, but I double t that will ever happen.

An EULA does not change the morality of the situation anyway. They are a leech profiting off users generating content who are now upset about not getting a cut from third-parties also profiting from said user generated content.

Also, EULAs cant violate laws, the same qay you cant sign away your first born child.

Re: Google is the only search engine that works on Reddit now, thanks to AI deal

#350

Post by wsve »

latexr wrote: post #312
immibis wrote: post #78

Earlier quoted context omitted.

Nobody who wants to be successful obeys robots.txt. And I do mean nobody.

That’s a weird statement to be absolutist about. The majority of individuals and companies who want to be successful do not do so by scrapping websites, thus have no reason to disobey robots.txt. Most people in the world, ambitious or not, wouldn’t even understand what your sentence refers to.

OP is obviously talking about people whose area of research/development/product would involve web scraping... This feels like being purposefully obtuse
Post reply on HN