Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Chat GPT is the birth of the real Web 3.0, and it's not going to be fun

lajili.com

Post reply on HN
Print view View original

171–180 of 392 posts

Re: Chat GPT is the birth of the real Web 3.0, and it's not going to be fun

#171

Post by cheschire »

toyg wrote: post #87
btown wrote: post #42

Earlier quoted context omitted.

IMO it's more vital than ever to fund projects like the Internet Archive. They're the only ones incentivized to maintain a snapshot of un-LLM-clouded training data of human knowledge, unclouded by the hubris of "who cares about the old stuff, we should focus our archiving on the web as it exists today" that inevitably will take hold (or already has) in big tech companies who will have laid off the vast majority of th…

The problem with the Internet Archive, which does an amazing job, is that they do an amazing job despite the problem being fundamentally intractable . Web content expands too quickly and too massively. I wonder if the answer is a network of topic-focused archives; like moving from a "Library of Alexandria" model to a modern nationwide system of libraries.

Okay so you build a knowledge graph on top of the internet archive. Now you are struggling to prioritize the resources necessary to capture long-tail content that doesn't mesh easily into popular corpuses. I imagine this would lead to the library equivalent of an echo chamber.

Re: Chat GPT is the birth of the real Web 3.0, and it's not going to be fun

#172

Post by whamlastxmas »

ionwake wrote: post #152
schrodinger wrote: post #85

Earlier quoted context omitted.

It may just be an arms race—the same AI that generates the nonsense also learns to identify and filter it out. Perhaps it'll also take down SEO spam with it. Feels unlikely but Google has an incentive to combat AI spam if people stop clicking on it, and presumably strong in-house AI capability…

In b4 controversial users get their content banned by accidentally tripping the AI filter

The other problematic area with that detection is people who have disabilities and use an AI assistant to help them type.

Re: Chat GPT is the birth of the real Web 3.0, and it's not going to be fun

#173

Post by c7b »

DebtDeflation wrote: post #22

An endless loop of AI generated content that gets posted to the web as original human generated content, with LLMs getting re-trained on this content and spitting out more content that also gets re-posted, resulting in a cesspool of BS masquerading as organic knowledge. I'm old enough to remember when Google provided meaningful search results rather than just SEO spam, the problem is about to get an order of magnitud…

> AI generated content that gets posted to the web as original human generated content, with LLMs getting re-trained on this content

Isn't that extrapolating the current trend a bit too much? Clearly, the text corpora[0] amassed before mass LLM content distribution are already big enough to train such models to decent general language fluency. So why would AI creators contaminate those datasets with potentially spurious content?

Sure, you want to keep your model up-to-date about the state of the world (the GPT corpus ends in mid-2021 afaik), but you can be much more careful about which texts you include. Those newer training data serve a different purpose than the original corpus, you don't need to bootstrap general language proficiency anymore. OpenAI already released a product for classifying AI-generated text, why would they not use something like that to filter future training data, for example?

[0] edited, thanks!

Re: Chat GPT is the birth of the real Web 3.0, and it's not going to be fun

#174

Post by api »

anonymouskimmer wrote: post #70
api wrote: post #15

I've been predicting since GPT-2 that AI text generators will mean the end of the open web and open social media. It will be destroyed by a Biblical tidal wave of unfilterable spam to the point that it becomes useless.

Is there a reason AI can't filter the AI produced content?

That’s an arms race that rapidly converges on a thin margin of detection and a high false positive rate.

Re: Chat GPT is the birth of the real Web 3.0, and it's not going to be fun

#175

Post by chefandy »

hagbarth wrote: post #47
DebtDeflation wrote: post #22

An endless loop of AI generated content that gets posted to the web as original human generated content, with LLMs getting re-trained on this content and spitting out more content that also gets re-posted, resulting in a cesspool of BS masquerading as organic knowledge. I'm old enough to remember when Google provided meaningful search results rather than just SEO spam, the problem is about to get an order of magnitud…

In the back of my mind, I have a hope that it will lead to the collapse of the platform internet and a return to smaller trusted communities and boards.

I hate being cynical, and I haven't really researched it, but my gut says there is too much invested from the non-tech world at this point in both the public and private sectors. The powers that be would probably rather force us all to asphyxiate on inane AI bullshit spewed out by our increasingly centrally-controlled technical world than cede control of electronic communication. Considering the pressure governments have freely applied to communications companies through policy, public shaming, disinformation, and secret infiltration (e.g. NSA breaking encryption to monitor gmail), and how effectively industry has skirted even the most basic privacy protections for users, I think they'll probably succeed. I don't see any reason to think that things like personal encryption or small community-run fora will change its course any more than legal guns have discouraged the creeping authoritarianism of the US Govt.

Re: Chat GPT is the birth of the real Web 3.0, and it's not going to be fun

#176

Post by zackmorris »

I agree with the headline and am glad that someone finally said it.

Web 1.0 was great: designed by academics, it popularized idempotence, declarative programming, scalability and ushered in the Long Now so every year since has basically been 1995 repeated.

Web 2.0 never happened: it ended up being a trap that swallowed the best minds of a generation to web (ad) agencies with countless millions of hours lost fighting CSS rules and Javascript build tools to replicate functionality that was readily available in 1980s MS Word and desktop publishing apps. It should have been something like single-threaded blocking logic distributed on Paxos/Raft with an event database like Firebase/RethinkDB and layout rules inspired by iOS's auto layout constraint solver with progressive enhancement via HTMX, finally making #nocode a reality. Oh well.

Web 3.0 is kind of like the final sequel of a trilogy: just when everyone gets onboard, the original premise gets lost to merchandizing and people start to wish it would just go away. Entering the knee of the curve of the Singularity, it will be difficult to spot the boundary between the objective reality of reason and the subjective reality of meaning. We'll be inundated by never-ending streams of infotainment wedged between vast swaths of increasingly pointless work.

Looking forward: the luddites will come out after the 2024 election and we'll see vast effort aimed at stomping out any whiff of rebel resistance. Huge propaganda against UBI, even more austerity measures to keep the rabble in line, the first trillionaire this decade. Meanwhile the real work of automating the drudgery to restore some semblance of disposable income and leisure time will fall on teenagers living in their parents' basement.

Thankfully Gen X and Millenials are transitioning into positions of political power. There is still hope, however faint, that we can avoid falling to tech illiteracy. But currently most indicators point to calamity after 2040 and environmental collapse between 2050 and 2100. Somewhat ironically, AI working with humans may be the only thing that can save civilization and the planet. Or destroy them. Hard to say at this point really!

Re: Chat GPT is the birth of the real Web 3.0, and it's not going to be fun

#177

Post by supriyo-biswas »

anonymouskimmer wrote: post #70
api wrote: post #15

I've been predicting since GPT-2 that AI text generators will mean the end of the open web and open social media. It will be destroyed by a Biblical tidal wave of unfilterable spam to the point that it becomes useless.

Is there a reason AI can't filter the AI produced content?

To take a reductionist view, humans are language models too, so the better LLMs become, the closer they become to a human, and at that point differentiation is not possible.

Re: Chat GPT is the birth of the real Web 3.0, and it's not going to be fun

#178

Post by isthisthingon99 »

JohnFen wrote: post #161
isthisthingon99 wrote: post #50

Stop guys, stop. Be young in your mind. Be young. How are young people interpreting this? "Oh wow, I can get it to write or help edit essays" "I can use it as something to bounce ideas off of" "I can use it to take ideas from my head into the digital realm." Stop being old people.

You mean stop enjoying the benefits of experience and wisdom?

No, stop being old. Age is no indication of wisdom.

Re: Chat GPT is the birth of the real Web 3.0, and it's not going to be fun

#179

Post by isthisthingon99 »

altdataseller wrote: post #137
isthisthingon99 wrote: post #50

Stop guys, stop. Be young in your mind. Be young. How are young people interpreting this? "Oh wow, I can get it to write or help edit essays" "I can use it as something to bounce ideas off of" "I can use it to take ideas from my head into the digital realm." Stop being old people.

Or just not play the game. If it's already this popular/hyped, it means it's too late to create a product and profit from it. Find the next big thing before it's overhyped

If you did not buy Tesla at the absolute bottom in 2000-whatever, could you still have been a multi-millionaire?

So why do you need to "be first"?

Re: Chat GPT is the birth of the real Web 3.0, and it's not going to be fun

#180

Post by throwanem »

williamcotton wrote: post #77
throwanem wrote: post #60

Earlier quoted context omitted.

The Internet Archive is a library.

You're right, and it has a better signal to noise ratio than the internet in general, even when you factor in the Wayback Machine! Here's to curated knowledge!

The Wayback Machine is part of the library, too. Specifically, it's the periodicals room.
Post reply on HN