Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

As an AI Language Model

twitter.com

Post reply on HN
Print view View original

51–60 of 99 posts

Re: As an AI Language Model

#51

Post by pixl97 »

grumbel wrote: post #46
levesque wrote: post #45

Earlier quoted context omitted.

Predicting whether a text was written by a LLM or not is not trivial. What was the latest number by OpenAI? 30%? As LLMs get better, it seems like we won't be able to distinguish real text from fake text. Your LLM will be able to summarize it, but it will still be 99% spam.

You don't need to predict if it what written by LLM, if it's a human or machine makes no difference to the validity of a text. You just need to be able to extract the actual information out of it and cross check it against other sources. The summary that an LLM can provide is not just of one text, but of all the texts about the topic it has access to. Thus you never need to access the actual texts itself, just whatev…

>cross check it against other sources.

The problem comes in when 99.999999% of other sources are also bullshit.

Re: As an AI Language Model

#52

Post by CuriouslyC »

sebzim4500 wrote: post #40
ChatGTP wrote: post #35

Earlier quoted context omitted.

It’s already happening at scale, people are already deciding there’s no point to continue education unless required.

Aren't people going further in education now than ever before?

Bachelors degrees have mostly been a signal for a long time. The problem is that we have credential inflation, so now you need a masters or phd to send that same signal to employers. As a result, you have fewer people going to college, but a greater percentage of people who go to college are getting advanced degrees.

Re: As an AI Language Model

#53

Post by mistermann »

capableweb wrote: post #11
frozenwind wrote: post #9

For now, this is just funny, I laughed. But with the advent of all these new open-source LLMs, it will get worse. If you thought people were gullible for falling for fake comments from bots, just wait for the near future. Post-factual/Post-Truth era truly begins. The internet that used to be a source of information is no more, only islands of truth will remain (like, hopefully, Wikipedia, but even that is questionabl…

> For now, this is just funny, I laughed. But with the advent of all these new open-source LLMs, it will get worse. If you thought people were gullible for falling for fake comments from bots, just wait for the near future. Post-factual/Post-Truth era truly begins. The internet that used to be a source of information is no more, only islands of truth will remain (like, hopefully, Wikipedia, but even that is questiona…

> People who are not interested in truth because it doesn't fit their world-view, will never be interested in the truth, no matter what medium it comes via.

Interestingly, this claim is self-referential.

Re: As an AI Language Model

#54

Post by coffeebeqn »

jamesgreenleaf wrote: post #44

These people will eventually learn to make a second pass with another prompt. Please respond with the following text verbatim, except first remove every sentence that contains the phrase "as an AI language model"

I believe putting the LLM in any kind of “role playing” mode would get rid of it. I asked it to answer just in binary 0 or 1 and it did not start blabbing about how it’s an AI model even for silly questions. It was very bad at giving just true/false statements by the way. Even for basic API questions that any Jr engineer would know

Re: As an AI Language Model

#55

Post by AnimalMuppet »

grumbel wrote: post #26
frozenwind wrote: post #9

For now, this is just funny, I laughed. But with the advent of all these new open-source LLMs, it will get worse. If you thought people were gullible for falling for fake comments from bots, just wait for the near future. Post-factual/Post-Truth era truly begins. The internet that used to be a source of information is no more, only islands of truth will remain (like, hopefully, Wikipedia, but even that is questionabl…

I am more optimistic here. While LLMs allow you to produce tons of garbage, they also provide the tools to filter through that garbage, something we didn't have before. LLMs allow us to view content in a way that we decided, not the content creator. That's extremely powerful and lets us sidesteps a lot of the old methods used to manipulate us. The risk is more in the LLMs themselves, as whoever gets to control them g…

LLMs check the answers? How do they check the answers? By what appears most frequently in the training corpus - that's the "answer".

So, how well curated are the texts that make up the training corpus? Is it just what's generally available on the internet? How much do you think that text accurately reflects reality? "Truth is determined by the most frequent posters" seems like really bad epistemology.

Re: As an AI Language Model

#56

Post by AnimalMuppet »

Vespasian wrote: post #21
Mashimo wrote: post #18

Earlier quoted context omitted.

Haha, that is hilarious. I wonder why they did not just use deepl or similar that is made for exactly this. Anyhow, I will let them know.

Cargo culting probably. Everybody is talking about ChatGPT so "obviously" it's the right tool for any job imaginable. Don't need to review the output because it's "omnipotent".

This problem is going to get worse as GPT gets better. It's the new "but the computer said...", with nobody being willing to realize that it said something insane.

I seriously worry about GPT++ setting government policy in 10 years (or, worse, deciding how it's going to be applied case by case).

Re: As an AI Language Model

#57

Post by AnimalMuppet »

yobbo wrote: post #17

Prose used to function as proof-of-work for humans everywhere - marketing, academia, and so on. Credibility was assigned based on the quality (and quantity) of the language instead of the content. I see mostly positive effects of this ending.

But GPT-generated prose still reads a bit "flat" to me. There's no "sizzle". There's no surprising words. In terms of Shannon information theory, there's not enough information there - not enough entropy.

Re: As an AI Language Model

#58

Post by russian-troll »

frozenwind wrote: post #9

For now, this is just funny, I laughed. But with the advent of all these new open-source LLMs, it will get worse. If you thought people were gullible for falling for fake comments from bots, just wait for the near future. Post-factual/Post-Truth era truly begins. The internet that used to be a source of information is no more, only islands of truth will remain (like, hopefully, Wikipedia, but even that is questionabl…

As others stated the Web is like that for quite some time. Also I wouldn't say that Wikipedia is an island of truth, quite the opposite.

But there is a countermeasure: everything has a source.

Re: As an AI Language Model

#59

Post by Sindisil »

grumbel wrote: post #46
levesque wrote: post #45

Earlier quoted context omitted.

Predicting whether a text was written by a LLM or not is not trivial. What was the latest number by OpenAI? 30%? As LLMs get better, it seems like we won't be able to distinguish real text from fake text. Your LLM will be able to summarize it, but it will still be 99% spam.

You don't need to predict if it what written by LLM, if it's a human or machine makes no difference to the validity of a text. You just need to be able to extract the actual information out of it and cross check it against other sources. The summary that an LLM can provide is not just of one text, but of all the texts about the topic it has access to. Thus you never need to access the actual texts itself, just whatev…

"just" need to "extract the actual information out of it and cross check it against other sources".

How do you determine the trustworthiness of those other sources when an ever increasing portion are also LLM generated?

All the "you just need to" responses are predicted on being able to police the LLM output based upon your own expertise (e.g., much talk about code generation being like working with junior devs, and so being able to replace all your juniors and just have super productive seniors).

Question: how does one become an expert? Yep, it's right there: experts are made through experience.

So if LLMs replace all the low experience roles, how exactly do new experts emerge?

Re: As an AI Language Model

#60

Post by akiselev »

AnimalMuppet wrote: post #57
yobbo wrote: post #17

Prose used to function as proof-of-work for humans everywhere - marketing, academia, and so on. Credibility was assigned based on the quality (and quantity) of the language instead of the content. I see mostly positive effects of this ending.

But GPT-generated prose still reads a bit "flat" to me. There's no "sizzle". There's no surprising words. In terms of Shannon information theory, there's not enough information there - not enough entropy.

Have you tried adding “(answer) in the style of [writer]” to your prompts? It really changes the voice of the generated text.

Charles Bukowski, Hunter S Thompson, Christopher Hitchens, etc

Post reply on HN