Live data from Hacker News

Are large language models a threat to digital public goods?

arxiv.org

101–110 of 163 posts

Re: Are large language models a threat to digital public goods?

#101

Earlier quoted context omitted.

I want attribution if I inspire a thought in AI. I'm surprised the nerve the issue has struck in me.

It isn’t clear to me (other than it’s an open engineering problem) why LLs couldn’t also include attribution as part of training. Also tracking attribution could lead to some insights on how its internal representations in vector space are created.

I have really enjoyed using https://phind.com, which includes attribution in its responses.

Re: Are large language models a threat to digital public goods?

#102

Earlier quoted context omitted.

> when smart phones became popular: no one remembers phone numbers of their family, people can’t remember directions when driving. This is a concern, though I'd argue unrelated to the concern about people no longer contributing publicly online, and one that was already present with SO. I've seen SO posts specifically reference or criticize the "copy paste" crowd that is just taking the answer and putting it into thei…

Why is that a concern? When’s the last time you needed to remember a phone number or directions for travel?

That's the point. People used to be able to memorize 7 digit numbers and now we can't because we don't have to. Where the brain is a muscle, it's atrophying. Those parts of the brain aren't being exercised and used, so we're getting dumber. Individually and as a society. The fear is that this will become an impediment to progress.

Re: Are large language models a threat to digital public goods?

#103
post #97

The paper title is clickbait and therefore the HN comments are focused on various low-effort reactionary noise, but it seems like an interesting study. I would not be surprised to find StackOverflow usage dropped significantly because of ChatGPT. It's simply a much more effective tool for getting help with typical programming problems. Not as good of a resource for expert-level or architectural advice, but that's oka…

If you're only pasting backtraces, you're not taking advantage of its coding ability. You can describe the problem, have it write some code, then iterate by telling it what to add, cases you want it to handle, add features to the code. It's been doing a pretty good job of helping me designing a database down to the actual CREATE TABLE statements for me as well.

Re: Are large language models a threat to digital public goods?

#104

Earlier quoted context omitted.

> I very much do not care about who discovered/created/published it, except only if it helps me quickly ascertain the trustworthiness of said information. I do not want to be forced or prodded to establish relationships with creators or communities. I do not want their ads and upsells. And this is why humanity is going down the tubes...because you want something, you derive value from what you want, and yet you do no…

> And this is why humanity is going down the tubes... On the contrary - this is exactly how and why humanity built a technological civilization in the first place. Note that I didn't say > because you want something, you derive value from what you want, and yet you do not care about giving something back to who makes it. Yes, because it would be backward and limiting to do that. Note: I never said I don't want to giv…

Regarding the baker example, some form of compensation is eventually directed to the employees, the farmers etc. even though you could say there are many layers of indirection.

In case of LLMs, no compensation is directed to the person authoring the information. While it may not be a problem for the consumer of the information, it removes any incentives for the people authoring the information to continue doing so, which has long term consequences.

Re: Are large language models a threat to digital public goods?

#105

The real question is, are large language models a threat to ad-supported web sites? Far fewer ads will be seen by humans. Running a LLM does not seem to create much of a moat. Everybody is doing it now.

With all these LLMs browsing the internet and picking up ideas, i wonder if anyone has considered making "ads" targeted at them? To influence them to promote a particular way of doing things, etc.

Re: Are large language models a threat to digital public goods?

#106

Earlier quoted context omitted.

It isn’t clear to me (other than it’s an open engineering problem) why LLs couldn’t also include attribution as part of training. Also tracking attribution could lead to some insights on how its internal representations in vector space are created.

I have really enjoyed using https://phind.com , which includes attribution in its responses.

Phind’s base model, which is GPT3.5/4 doesn’t itself do attribution, it’s made to do that with prompt engineering which provides the most relevant materials on the web based on a word embedding vector search, and then asks it to reference each source in the answer.

Re: Are large language models a threat to digital public goods?

#107

The real question is, are large language models a threat to ad-supported web sites? Far fewer ads will be seen by humans. Running a LLM does not seem to create much of a moat. Everybody is doing it now.

With all these LLMs browsing the internet and picking up ideas, i wonder if anyone has considered making "ads" targeted at them? To influence them to promote a particular way of doing things, etc.

This will likely be operating a large PBN network, all of which reference your product or service so that it is overly represented in the dataset.

Re: Are large language models a threat to digital public goods?

#108
Large language models have a huge problem with hallucinating incorrect information and censorship of it.

Right now, most of those services very strictly refuse to say anything even mildly controversial or pornographic. Because LLMs have an increasingly large amount of influence on society, this is quite concerning, because many things will simply get memoryholed if the creators of the models deem it's not "safe" or acceptable.

Re: Are large language models a threat to digital public goods?

#109
post #51

I won't upload any of my writing to the web anymore until this is all sorted out. You can make fun of me all you like, but it's taken me decades to get good at this, and I'll be damned if some soft-skinned SV kid with a MacBook uses my work to power his mill.

The basilisk will remember this.

molon labe, basilisk

Re: Are large language models a threat to digital public goods?

#110

Earlier quoted context omitted.

> I very much do not care about who discovered/created/published it, except only if it helps me quickly ascertain the trustworthiness of said information. I do not want to be forced or prodded to establish relationships with creators or communities. I do not want their ads and upsells. And this is why humanity is going down the tubes...because you want something, you derive value from what you want, and yet you do no…

> And this is why humanity is going down the tubes... On the contrary - this is exactly how and why humanity built a technological civilization in the first place. Note that I didn't say > because you want something, you derive value from what you want, and yet you do not care about giving something back to who makes it. Yes, because it would be backward and limiting to do that. Note: I never said I don't want to giv…

What does your example have to do with this situation?

The people in the bread supply chain get paid, the author of content we're discussing will never get paid by anyone, will never even get a bit if personal satisfaction from their analytics knowing last month x thousand people read that page and it hopefully helped them.

It's completely zero reward, even worse it's completely zero feedback of any kind!

This really is the doom of the web as we know it because for the first time ever there will be an active disincentive to put knowledge on it. I think much information will retreat to places like Discord or locked down login only versions of sites like Stackoverflow.

Post reply on HN