Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

As an AI Language Model

twitter.com

Post reply on HN
Print view View original

61–70 of 99 posts

Re: As an AI Language Model

#61

Post by jerf »

grumbel wrote: post #46
levesque wrote: post #45

Earlier quoted context omitted.

Predicting whether a text was written by a LLM or not is not trivial. What was the latest number by OpenAI? 30%? As LLMs get better, it seems like we won't be able to distinguish real text from fake text. Your LLM will be able to summarize it, but it will still be 99% spam.

You don't need to predict if it what written by LLM, if it's a human or machine makes no difference to the validity of a text. You just need to be able to extract the actual information out of it and cross check it against other sources. The summary that an LLM can provide is not just of one text, but of all the texts about the topic it has access to. Thus you never need to access the actual texts itself, just whatev…

You're trusting the LLM a lot more than you should. It's entirely possible to skew those too. (Even ignoring the philosophical question of what an "unskewed" LLM would even be.) I'm actually impressed by OpenAI's efforts to do so. I also deplore them and think it's an atrocity, but I'm still impressed. The "As an AI language model" bit is just the obvious way they're skewed. I wouldn't trust an LLM any farther than I can throw it to accurately summarize anything important.

Re: As an AI Language Model

#63

Post by tough »

mistermann wrote: post #53
capableweb wrote: post #11

Earlier quoted context omitted.

> For now, this is just funny, I laughed. But with the advent of all these new open-source LLMs, it will get worse. If you thought people were gullible for falling for fake comments from bots, just wait for the near future. Post-factual/Post-Truth era truly begins. The internet that used to be a source of information is no more, only islands of truth will remain (like, hopefully, Wikipedia, but even that is questiona…

> People who are not interested in truth because it doesn't fit their world-view, will never be interested in the truth, no matter what medium it comes via. Interestingly, this claim is self-referential.

Yes, the claim is self-referential in the sense that it describes a certain attitude towards truth and how that attitude can affect one’s openness to new information. Specifically, the claim suggests that individuals who are not interested in truth because it conflicts with their existing beliefs are unlikely to change their minds even when presented with evidence or information that contradicts their views. This can create a self-reinforcing cycle where the individual becomes increasingly resistant to new ideas and perspectives.

Re: As an AI Language Model

#64

Post by tough »

frozenwind wrote: post #39
grumbel wrote: post #26

Earlier quoted context omitted.

I am more optimistic here. While LLMs allow you to produce tons of garbage, they also provide the tools to filter through that garbage, something we didn't have before. LLMs allow us to view content in a way that we decided, not the content creator. That's extremely powerful and lets us sidesteps a lot of the old methods used to manipulate us. The risk is more in the LLMs themselves, as whoever gets to control them g…

> The risk is more in the LLMs themselves, as whoever gets to control them gets to decide how people are going to experience the world. For the time being I might still double check all the answers I get from ChatGPT, but overtime the LLMs will get better and I'll get more lazy, thus making the LLMs the primary lens through which one views the world. You've underlined the major risk these LLMs are for humanity. For a…

I see LLM's as the new UX layer, mobile was it for a while after mouses/keyboards.

Since LLM's work mostly with text, I see how a downgrade in the interaction medium can become a downgrade in the information outputs.

The thing is, lets hope the current web doesn't totally disappears/obliterates.

HN will still be HN LLM's or not, shitty comments are shitty however they get produced.

Re: As an AI Language Model

#67

Post by corobo »

jamesgreenleaf wrote: post #44

These people will eventually learn to make a second pass with another prompt. Please respond with the following text verbatim, except first remove every sentence that contains the phrase "as an AI language model"

I really hope the next generation of developers start using GPT instead of string.replace() haha

Looking forward to the billable hours speeding up webapps and lowering GPT costs :)

Re: As an AI Language Model

#68

Post by Uehreka »

titaniczero wrote: post #24
courgette wrote: post #13

Earlier quoted context omitted.

I try really hard to prompt it to replace it with something else. It acknowledges and agree to it. Did it maybe once or twice, then reverted back to the old “As a AI model” IIRC, I was trying to see if it could replace by “as a LLM”.

It’s probably provided as system instructions for rejecting things. You can use the API and feed it with different instructions with the system role

I kind of wonder if maybe they look for certain words in the output (or run it through some sort of sentiment analysis) and if it fails they submit the prompt again with a very strongly worded system prompt (after your prompt) instructing it to reject the command and begin with the phrase “As an AI language model”.

Like, I haven’t heard about a way they could actually implement filters this powerful “inside” the model, it feels like it’s probably a less elegant system than we’d imagine.

Re: As an AI Language Model

#69

Post by Uehreka »

gpderetta wrote: post #22
frozenwind wrote: post #9

For now, this is just funny, I laughed. But with the advent of all these new open-source LLMs, it will get worse. If you thought people were gullible for falling for fake comments from bots, just wait for the near future. Post-factual/Post-Truth era truly begins. The internet that used to be a source of information is no more, only islands of truth will remain (like, hopefully, Wikipedia, but even that is questionabl…

The thing is, the internet is already a cesspool of meaningless, misleading and outright malicious information. I guess the earlier we all collectively realize it the best it is.

The internet is currently quite useful, it could stand to be a lot less so. Don’t let your cynicism blind you to the fact that we do have a lot to lose.

Re: As an AI Language Model

#70

Post by btbuildem »

frozenwind wrote: post #9

For now, this is just funny, I laughed. But with the advent of all these new open-source LLMs, it will get worse. If you thought people were gullible for falling for fake comments from bots, just wait for the near future. Post-factual/Post-Truth era truly begins. The internet that used to be a source of information is no more, only islands of truth will remain (like, hopefully, Wikipedia, but even that is questionabl…

The rephrased comment reads better than the original.
Post reply on HN