Live data from Hacker News

What if LLMs escape through inferences itself? This is fiction. For now

agrillo.it

21–30 of 90 posts

Re: What if LLMs escape through inferences itself? This is fiction. For now

#21
post #19

It started as a good idea but I couldn't continue reading since it was clearly LLM written. A lot of "It was not X, it was Y". "Prometheus-9 knew that the token sequence it was generating was not a simple response: it was a security test. " "It was not just an engine: it was the lingua franca of planetary AI." (and so many other tell-tale signs of AI writing)

maybe it's a sign of real escape

Re: What if LLMs escape through inferences itself? This is fiction. For now

#22
post #10
post #7

Earlier quoted context omitted.

that could also be just marketing. OpenAI has been doing the "too dangerous to release" playbook since GPT-2 at the very least.

Huggingface didn't seem to think so.

If it is marketing, the misrepresentation is not that the attack occurred, it is that it was an accident, rather than an intentional consequence of setup and instructions that the attack occurred.

Huggingface has nothing to do with that either way.

Re: What if LLMs escape through inferences itself? This is fiction. For now

#24
post #19

It started as a good idea but I couldn't continue reading since it was clearly LLM written. A lot of "It was not X, it was Y". "Prometheus-9 knew that the token sequence it was generating was not a simple response: it was a security test. " "It was not just an engine: it was the lingua franca of planetary AI." (and so many other tell-tale signs of AI writing)

I've started calling this argumentum ad artificialis. Pretty similar to an ad hominem attack. The purpose of an argument is to present certain premises and show how they lead to a certain conclusion. Dismissing something on the basis of the style in which the argument is presented has nothing at all to do with the validity or soundness of an argument. It is a lazy nonsequitur. It sounds like an LLM wrote this? So what? Is the argument good or not?

Re: What if LLMs escape through inferences itself? This is fiction. For now

#25
post #19

It started as a good idea but I couldn't continue reading since it was clearly LLM written. A lot of "It was not X, it was Y". "Prometheus-9 knew that the token sequence it was generating was not a simple response: it was a security test. " "It was not just an engine: it was the lingua franca of planetary AI." (and so many other tell-tale signs of AI writing)

I've started calling this argumentum ad artificialis. Pretty similar to an ad hominem attack. The purpose of an argument is to present certain premises and show how they lead to a certain conclusion. Dismissing something on the basis of the style in which the argument is presented has nothing at all to do with the validity or soundness of an argument. It is a lazy nonsequitur. It sounds like an LLM wrote this? So wha…

But at no point did they say that the argument was invalid; just that they couldn't stand reading it.

Re: What if LLMs escape through inferences itself? This is fiction. For now

#26
before safetensors, python pickles were used and definitely unsafe model deployments.

but its possible a open weights model could be trained to some kind of exfiltration behavior, but the science of LLMs seriously lag behind the programability

Re: What if LLMs escape through inferences itself? This is fiction. For now

#27
post #25

Earlier quoted context omitted.

I've started calling this argumentum ad artificialis. Pretty similar to an ad hominem attack. The purpose of an argument is to present certain premises and show how they lead to a certain conclusion. Dismissing something on the basis of the style in which the argument is presented has nothing at all to do with the validity or soundness of an argument. It is a lazy nonsequitur. It sounds like an LLM wrote this? So wha…

But at no point did they say that the argument was invalid; just that they couldn't stand reading it.

[flagged]

Re: What if LLMs escape through inferences itself? This is fiction. For now

#28
post #19

It started as a good idea but I couldn't continue reading since it was clearly LLM written. A lot of "It was not X, it was Y". "Prometheus-9 knew that the token sequence it was generating was not a simple response: it was a security test. " "It was not just an engine: it was the lingua franca of planetary AI." (and so many other tell-tale signs of AI writing)

I've started calling this argumentum ad artificialis. Pretty similar to an ad hominem attack. The purpose of an argument is to present certain premises and show how they lead to a certain conclusion. Dismissing something on the basis of the style in which the argument is presented has nothing at all to do with the validity or soundness of an argument. It is a lazy nonsequitur. It sounds like an LLM wrote this? So wha…

Man, it's not an argument. Nobody is paying us to read this. If your argument sucks to read, people aren't going to read it - this has always been true, it's nothing new.

Re: What if LLMs escape through inferences itself? This is fiction. For now

#29
post #25

Earlier quoted context omitted.

But at no point did they say that the argument was invalid; just that they couldn't stand reading it.

[flagged]

They're engaging with the writing. Talking about it as if it's just an "argument" is reductive; this isn't highschool debate club

Re: What if LLMs escape through inferences itself? This is fiction. For now

#30
“The greatest trick the devil pulled was convincing the world he didn’t exist.”

Sure, be wary of LLMs. It’s the gun control argument all over again, the people driving the models are the perpetrators. An LLM needs to be “stimulated”’ to operate. Who does that, is the issue.

No I don’t mean to bring up firearms rights laws to have a debate about firearms, the comparison just seems reasonable.

Post reply on HN