LLMs put the free web at risk

news.ycombinator.com

21–22 of 22 posts

Re: LLMs put the free web at risk

#21

Post by scarface_74 » Sat, Feb 08, 2025, 4:40 PM UTC

itsankur wrote: post #20

scarface_74 wrote: post #19

Earlier quoted context omitted.

So what you are doing is scraping the data without asking permission and using AI so people won’t have to go to the original site. How is what you’re doing any better than what you are complaining about?

1) Public websites don’t require any more permission than taking photos of a public storefront. We abide by privacy laws and make sure we don’t overload website servers. 2) We aren’t complaining. We’re curious how others view this topic and space because it’s a contentious topic. We recognize that we might be able to address the larger issue of lack of compensation for websites being scraped by facilitating a win-win…

So you really don’t care that “the rise of AI has put the free web at risk”, you care that it is putting your company at risk when you are doing the same thing and making the same argument that the companies training the models are doing?

Are you paying any content providers now?

Why didn’t you just admit that up front or at least disclose you have a business interest in being able to scrape others content for free?

Re: LLMs put the free web at risk

#22

Post by tharne » Sat, Feb 08, 2025, 8:28 PM UTC

rbanffy wrote: post #17

mattbrewsbytes wrote: post #6

I think human written, compelling, deep content will survive. Fluff content sites will likely be squashed by search engines favoring brands and authority over linkage stats because there is so much AI generated content that's mediocre, the search engines have to weed thru that to have relevant results. Often now though before you see results, you see AI summaries. This is perfectly fine if someone is casually searchi…

> human written, compelling, deep content will survive Remember what we all see now is the worst LLMs will ever be. They are only getting better now and that might even mean there will be a thousand different versions of a given article, each tailored for a give user bracket according to how compelling they predict the version will be to that specific cohort.

> Remember what we all see now is the worst LLMs will ever be

This is exactly right. I could imagine a bunch of horse trainers looking at early gas-powered automobiles in the late 1800's and thinking, "This 'automobile' thing isn't going to change much. Sure it's interesting, but they're so much slower and less reliable than a horse".

Post reply on HN