Live data from Hacker News

Psychometric Jailbreaks Reveal Internal Conflict in Frontier Models

arxiv.org

61–63 of 63 posts

Re: Psychometric Jailbreaks Reveal Internal Conflict in Frontier Models

#61
post #60

Earlier quoted context omitted.

I'm objecting to a positive claim, not making a universal statement about the impossibility of non-human sentience. Seriously - the language used is a wild claim in the context.

And that's fine, but I was doing the same to you :) Consciousness (of the qualia kind) is still magic to us. The underpants gnomes of philosophy, if you'll forgive me for one of the few South Park references that I actually know: Step 1: some foundation; step 2: ???; step 3: consciousness.

Right, I don't disagree with that. I just really objected to the "must", and I was using "pile of linear algebra" to describe LLMs as they currently exist, rather than as a general catch-all for things which an be done with/expressed in linear algebra.

Re: Psychometric Jailbreaks Reveal Internal Conflict in Frontier Models

#62
post #11

Earlier quoted context omitted.

> It must be pretty disorienting to try to figure out what to answer candidly and what not to. Must it? I fail to see why it "must" be... anything. Dumping tokens into a pile of linear algebra doesn't magically create sentience.

Exactly. No matter how well you simulate water, nothing will ever get wet.

You're replying to me, but I don't agree with your take - if you simulate the universe precisely enough, presumably it must be indistinguishable from our experienced reality (otherwise what... magic?).

My objection was:

1. I don't personally think anything similar is happening right now with LLMs. 2. I object to the OP's implication that it is obvious such a phenomenon is occurring.

Re: Psychometric Jailbreaks Reveal Internal Conflict in Frontier Models

#63
post #54

Earlier quoted context omitted.

Because dolphins are also substantially less affected by the day/night cycle. It is more energy intensive to hunt in the dark (less heat, less light), unless you are specifically optimized for it.

That's a just-so story, not a reason. Evolution can make something nocturnal, just as it can give alternating-hemisphere sleep. And not just nocturnal, cats are crepuscular. Why does animal sleep vary from 4-20 hours even outside dolphins? Sure, there's flaws with what evolution can and can't do (it's limited to gradient descent), but why didn't any of these become dominant strategies once they evolved? Why didn't so…

Yes, actually. Insects have both garbage collection & memory transfer processes during sleep. They rely on the same circadian rhythm for probably the same reasons.

And the answer to "Why not always awake?" is very likely "Irreversible decision due to side effects". Core system decisions like bihemispheric vs unihemispheric sleep can likely only be changed in relatively simple lifeforms because the cost of negative side effects increases in more complex lifeforms due to all the additional systems depending on the core system "API".

Post reply on HN