Live data from Hacker News

ChatGPT Can't Kill Anything Worth Preserving

biblioracle.substack.com

191–200 of 363 posts

Re: ChatGPT Can't Kill Anything Worth Preserving

#191

ChatGPT is trained on the internet corpus written by humans. Over time, more and more of this corpus will be written by ChatGPT. Has anyone tested what happens when the output of a LLM is fed back as the training data?

In the future internet, every paragraph will begin with "As a Large Language Model" or "It is not appropriate to"

Re: ChatGPT Can't Kill Anything Worth Preserving

#192

"Show your work", "Correct answer without showing your work earns a zero". These were things that were extremely common in STEM classes when I was in school and were rare in English classes. This author/professor has a very solid point that English instructors being less lazy and grading on the process instead of the final result would go a long way in terms of combatting cheating and producing better writers. Anothe…

At least from the perspective of the English profs/teachers I had, actually generating words was a black box not requiring instruction or introspection. Editing and structuring, sure, but the nuts and bolts of how you turn a blank page into a nonblank page... that wasn't really discussed much.

Re: ChatGPT Can't Kill Anything Worth Preserving

#193
post #107
post #79

Earlier quoted context omitted.

I have the same worry. Another example: Is furniture nowadays more beautiful and durable than it used to be 100 years ago? Is there more variety now? Not in my book. Same goes for a lot of products that are now produced in the cheapest way possible at scale. Looks very much like a race to the bottom dominated by a few big players to me. Consumers don't seem to care that much.

The poor quality furniture of 100 years ago is no longer around.

Households had way less furniture in general, then, too, and yeah, some of it was makeshift or rough-built and probably didn't make it to today.

Office furniture seems to have been incredibly well-built, though, by modern standards. Kinda like how office and government buildings used to be built a lot better. Institutions seem to have cared a lot more about that kind of thing back then. They built desks for ordinary low-paid clerks or typists like they expected the office to still be running, and still using that same desk, in 200 years.

[EDIT] Also, part of what makes older furniture seem so nice is that excellent-quality wood was abundant. It seems so nice because they used wood that'd be ultra-expensive luxury-grade today, for, like, interior structural parts you never even see. Same story for houses. I've seen wooden support beams that'd be almost impossible to find at any price, today, the quality's so high and the piece is so large. Floor underlayment (again, not even intended to be seen) so knot-free it'd probably be used for veneer, now. That kind of thing.

Re: ChatGPT Can't Kill Anything Worth Preserving

#194

ChatGPT is trained on the internet corpus written by humans. Over time, more and more of this corpus will be written by ChatGPT. Has anyone tested what happens when the output of a LLM is fed back as the training data?

It was not a language model, but AlphaZero played against itself millions of games and trained on the data it generated, without seeing any human games. And it reached super human level, of course. Why was this possible? The game itself acted as an anti-bullshit filter. So you can train on your own generated data if you filter it. Like this one: Large Language Models Can Self Improve https://arxiv.org/abs/2210.11610

I presume that OpenAI is already running cgpt against itself. The discussion should already be incomprehensible to humans

Re: ChatGPT Can't Kill Anything Worth Preserving

#195
post #126

Earlier quoted context omitted.

Most people can't afford top talent to play live music at their wedding or photograph it.

I'm sort of sick of the top talent argument. My grandfather and group sang. From what tapes I have heard of them, they didn't sound worse than any other group of Appalachian gospel/blue grass singers. My parents' wedding photos weren't 'professional' and I think they came out pretty well, perhaps even charming. Sometimes I think people are putting too much stock in the notion of a 'perfect' life, rather than a lived…

Exactly, that's my point. I'd rather listen to a "good enough" local band performing live than some "World's best" recorded performance.

Re: ChatGPT Can't Kill Anything Worth Preserving

#196

Earlier quoted context omitted.

By that logic a sprinkler system is “artificial intelligence” when compared to a garden hose. That’s not what the term means.

That's exactly what artificial intelligence means... There is a secondary definition of AI that says basically an AI is anything that we haven't yet figured out how to do. Once we figure out how to do it, it ceases to be AI. Indeed, terms can and do have multiple meanings, but I'm not sure that secondary definition fits the topic of discussion.

You’re being insincere. Let me guess, you’d say a can opener is artificial intelligence compared to a pocket knife?

That’s not the way anyone uses the term.

Re: ChatGPT Can't Kill Anything Worth Preserving

#197
post #34

I see two big problems with GPT: 1. It presents information really well that is completely false. I don't know exactly how it works under the hood, but sometimes it spits out paragraphs that read like the fever dreams of a flat earther. 2. It will cause our communication skills to further atrophy. Maybe in an innocuous way (no one memorizes epic poems anymore), but with GPT I think it will make people less likely to…

Could what we consider persuasive change in the next 20 years? What if today's techniques are considered too crass and only perfectly crafted words by ai, finetuned with empathy for the person you are trying to persuade, is the only thing that works anymore?

Re: ChatGPT Can't Kill Anything Worth Preserving

#198

Earlier quoted context omitted.

Trading quality for price has been happening everywhere for long enough that it is easy to see how unfortunately it will now play out in the arts as well. I mean, not that long ago all clothes you wore were custom made by a tailor, all the music you listened to was played live by musicians, all stories were brought to life in front of you by theatre actors: now all of those while still available are significantly mor…

> now all of those while still available are significantly more expensive and niche than the mechanized (production or reproduction) equivalents. No, they cost exactly as much as they always had. Before machines, people didn't have wardrobes full of tailor-made clothes. Each person had, give or take one, exactly as many tailor-made clothes as we have today.

Supporting industries losing economies of scale drives up costs. If you have fewer tailors, local cloth suppliers become insolvent. This leads to the few tailors having to import cloth and increase prices.

Re: ChatGPT Can't Kill Anything Worth Preserving

#199

Earlier quoted context omitted.

AI/LLMs cannot "do work that is worth doing" in this context because the work that is worth doing involves human learning/education, not simply the production of content. If you meant, "when can AI perform all writing tasks such that it would be a waste of time for human beings to develop the ability to express themselves in writing", well, fine question, likely answered far too soon.

It's already clear that existing LLM have the ability to do things that were previously only accessible to people with "human learning/education." "Production of content" can probably go a lot further than you think, for a model that has internet/API access. Would love to see more warrants on the claims you are making - feel like you haven't fleshed it out enough in this comment.

Will reliance on LLMs neuter our minds the same way that reliance on machinery has withered our bodies.

Re: ChatGPT Can't Kill Anything Worth Preserving

#200

Earlier quoted context omitted.

That's exactly what artificial intelligence means... There is a secondary definition of AI that says basically an AI is anything that we haven't yet figured out how to do. Once we figure out how to do it, it ceases to be AI. Indeed, terms can and do have multiple meanings, but I'm not sure that secondary definition fits the topic of discussion.

You’re being insincere. Let me guess, you’d say a can opener is artificial intelligence compared to a pocket knife? That’s not the way anyone uses the term.

> you’d say a can opener is artificial intelligence compared to a pocket knife?

No. In that case the intelligence is applied by the user. A can opener could be a component in a larger AI system. An AI needs to be aware (in the artificial sense) of its surroundings.

Edit: I forgot that AI can openers do exist. The can opener I own is of the dumb machine kind and I hadn't fully considered what else might use that term. Yes, those are an AI.

> That’s not the way anyone uses the term.

Except when they do. Indeed, the "an AI is anything we haven't figured out yet" definition is about as common, but doesn't seem to be the definition that fits the topic at hand.

A third definition where AI is defined as an ANN seems to be emerging in popular culture, but again that doesn't really fit the topic at hand as a lot of the job-replacing intelligences are not based on ANNs.

Post reply on HN