As AI eats the web, the internet’s collective memory is disappearing
341–350 of 954 posts
Re: As AI eats the web, the internet’s collective memory is disappearing
#342Earlier quoted context omitted.
That's why you don't share them, until comes a time when the ideabringers gets the money and recognition they deserve. Until then, good luck going knee deep in the sewers of ideas.
Can’t say I agree. The most influential ideas in history were not conceived of by people looking for money and recognition. Nor were they “radically original.”
Patents, copyrights, trade marks exist because rewarding people for their insights and inventions matters.
Re: As AI eats the web, the internet’s collective memory is disappearing
#343I called this maybe 3y ago, but I think so did everyone else that was sane. Sure, we get immense value from AI, but indiscriminately injecting into everything, the one thing we know to be unreliable above the threshold we used to fire people for, is probably the greatest undoing of all the good companies like Google brought to the internet. I mean what a way to destroy your legacy of democratizing information. The am…
Re: As AI eats the web, the internet’s collective memory is disappearing
#344AI will kill the internet because it is killing the incentive to make it. It is an industrial-strength example of why we don’t allow stealing.
Recently, I had some ideas I would normally just put up on a blog, in the public domain for anyone to develop on top of. Now, I'm feeling slightly reluctant because an LLM will ingest it, remix it and serve it in response to a query by some unimaginative individual who will either conclude that they are smart, or that LLMs are capable of original thought, or both. And they will have no clue where the idea originated…
Re: As AI eats the web, the internet’s collective memory is disappearing
#345Earlier quoted context omitted.
That movie is ridiculous and still great. At least as a nostalgia pump. And the red box references and pots patching and such were true enough, even if everything else got hilarious hollywood treatment.
If I recall correctly, the film actually had Emmanuel Goldstein of 2600 and Kevin Mitnick as consultants, so despite the hollywood treatment you have moments of accuracy like https://www.youtube.com/watch?v=4U9MI0u2VIE . Probably the only time Compilers: Principles, Techniques and Tools made it to the big screen. At the yearly 2600 conference, they used to always do a big group rollerblade through NYC.
Re: As AI eats the web, the internet’s collective memory is disappearing
#346AI will kill the internet because it is killing the incentive to make it. It is an industrial-strength example of why we don’t allow stealing.
And that will kill AI itself, since much of what it knows is from what learned from StackExchange before this latest one demise. And before the obvious comments on how GenAI is creative , then please do this OpenAI and Anthropic, for your next LLM. Just teach it Python, C and Rust and give it some good books. But dont give it access to Github...lets see what you can do then...
AI companies are also working to integrate training with real-world experience through sensors and robotics, to shrink the gap between human experience and hallucinated LLM experience.
They all have archives of pre-LLM content. There's also archive.org, google books, and pirate ebook archives. I don't know what they're doing to build video and audio archives, but judging from the cost of spinning rust, they're storing significant quantities of that, too.
Some parts of the internet are curated, and even with LLM influence they're still worth training on. I doubt wikipedia or stackexchange or rosettacode will ever cease to be useful at all.
Re: As AI eats the web, the internet’s collective memory is disappearing
#347I called this maybe 3y ago, but I think so did everyone else that was sane. Sure, we get immense value from AI, but indiscriminately injecting into everything, the one thing we know to be unreliable above the threshold we used to fire people for, is probably the greatest undoing of all the good companies like Google brought to the internet. I mean what a way to destroy your legacy of democratizing information. The am…
what value do we get from AI?
Re: As AI eats the web, the internet’s collective memory is disappearing
#348Earlier quoted context omitted.
In modern times don't we all think that ideas are cheap: don't we all mostly regurgitate the same stock of them. Have we yet lost the open ideals of university sharing? The core of open source? The failure of the GPL is that you can't force anyone to collaborate and share if they don't really want to.
> The failure of the GPL is that you can't force anyone to collaborate and share if they don't really want to. Failure of the GPL? How can you even put those words next to each other? GPL is an amazing success. It took software out of hands of SV / VC / corpo crowd and put it where it should be - users.
Re: As AI eats the web, the internet’s collective memory is disappearing
#349Earlier quoted context omitted.
Yes - previously there was some chance someone reading the ideas on the blog would contact the author to thank them, or ask them to collaborate. When laundered via LLMs whose pretraining destroys all credit, that can't happen.
If all you care about is financial, expected value of someone reading your blog and asking to collaborate is MUCH lower than odds of being part of some settlement in the future with these AI companies ingesting your data for training purposes.
Re: As AI eats the web, the internet’s collective memory is disappearing
#350Earlier quoted context omitted.
So only GitHub Copilot can read it then? Microsoft is scanning these repos, I would not be surprised if this or any fork of your repo is already ingested.
They say they don't do that. But maybe I should be more skeptical.