Live data from Hacker News

Stop Anthropomorphizing Intermediate Tokens as Reasoning/Thinking Traces (2025)

arxiv.org

221–230 of 296 posts

Re: Stop Anthropomorphizing Intermediate Tokens as Reasoning/Thinking Traces (2025)

#221

Earlier quoted context omitted.

> Actual real people believe The problem with rapists is mental development, not "those sexy tables and chairs and pots and everything". It's not that if people do not understand metaphors we should stop using them. It 's not that if people faint when they hear words we should stop using them. It is not that the free unduly associations in a large shared by many "collective subconscious" should hinder us...

[flagged]

You have failed in taking the simile for the point it intended to make (and you gravely misrepresented the concept of "mental development" as clearly intended). Let us stick to the point.

Edit: I will translate it again for you: "the problem of a bad reactor is not in its innocent trigger".

But rest assured, I do not antropomorphize people.

Re: Stop Anthropomorphizing Intermediate Tokens as Reasoning/Thinking Traces (2025)

#222

Earlier quoted context omitted.

I think LLMs are pretty clearly intelligent in some sense of the word, and I don't know how one could ever confidently know they aren't conscious in some sense. That's not to say they're humanlike, just that people who think they know these ideas are ridiculous seem to be overreaching in the same way Steve Yegge seems to be overreaching

> conscious The problem with that term is that it is hardly meaningful. Why would you use it? It does not add much, and no clarity, to what it is attributed to.

I think that "conscious" has a clear meaning in a sense that "xyphucymmon" does not. I think it might be impossible to engage in epistemology of consciousness (i.e. we can't find out of LLMs are conscious) but that doesn't make the term meaningless

Re: Stop Anthropomorphizing Intermediate Tokens as Reasoning/Thinking Traces (2025)

#223
post #211

Earlier quoted context omitted.

[dead]

I saw that your reply got filtered by the system, googled your name, thought "huh", then tried vouching, but to no avail. But either way. I think you might be operating in the mindset of a high-trust internet that no longer exists. You do not engage with sea lions, concern trolls, grifters, marketing people and the like. You shut them down. inb4 "who are you to decide that?" - "Me. I am me." That said, I appreciate w…

44 years ago I was operating in the mindset of a high-trust arpanet that no longer exists, connecting to the MIT-AI Lab's PDP-10 (@L 134) through the NBS TIP (301-948-3850) at 300 baud with no password, asking nicely for an account to learn LISP and receiving it the next day for free, then learning MACLISP from Kent Pitman and EMACS from Richard Stallman and ZORK by spying on the output of other high-school kids connecting over the NCP network from other TIPs all over the country. Visiting the 9th floor at 545 Tech Square, knocking on the door in the elevator lobby until somebody got annoyed and pressed Terminal-E on their Lisp Machine keyboard to buzz the door open, going downstairs to the publications department and harvesting piles of MIT-AI Lab Memos that were free for the taking to anyone who knew they were free. Returning RMS a 68k manual in the mail with a "Copyleft (L)" sticker that inspired him to use that as a slogan for free software.

https://www.donhopkins.com/home/copyleft/

And I am perfectly aware that this is a totally different world, so I don't need you to lecture me on sealioning, trolls, grifters, and marketers. I have trolled the fuck out of RMS himself in good humor, using his own DOCTOR in Emacs to make fun of him, after he trolled the fuck out of new parents making a baby announcement with his Natalism flame.

http://www.art.net/studios/hackers/hopkins/Don/text/rms-vs-d...

And RMS once trolled the fuck out of me and Mike Gallaher, who I worked with on Gosling's UniPress Emacs (which RMS calls "Evil Software Hoarder Emacs"), who lamented that he'd heard RMS's house had burned down, and RMS replied "Where you work, I would have thought you'd have heard about it in advance". We all laughed uproariously because it was such a great troll, delivered deadpan without blinking an eyelash.

So instead of telling me I'm missing the point without making any of your own, and then flying off into the sunset like an over-announced 747 serving as a decoy for a C-32A containing Trump cowering in a catering cart, why don't you directly engage the points in my other post like I just asked you to?

----

I've read your edited reply, and it still addresses absolutely none of the points I raised in that original reply. Reply to that one, not this. Point by point. Or fly off without another word.

----

But before you do, please at least admit that you were intentionally insulting the people you were replying to, and concede that pretending that not to be true is insulting to everyone reading, but mostly and rightfully insults yourself.

----

You asked why you would. Because you finally made an actual argument, and it deserves a real answer. If you'd opened with "AI companies push sentience narratives to pump their valuations and vulnerable people are having breakdowns" instead of "stop thinking these things," this thread would have been half as long and twice as useful -- because I agree with that part. No argument.

The hype is real, the casualties are real, and the companies telling bedtime stories about their products' souls are doing it for the stock price.

But look at what you did with that concern. Go reread salawat's comment -- the one you called cyberpsychosis. It's an attack on the AI companies: people hoping for a mechanical slave, doing everything possible to avoid the being-ness question, because slaveowners can't afford to ask it. That's your side of the argument, stated more sharply than you've stated it. You shouted down your own ally for using the word "being".

That's what your taboo does as a strategy: it doesn't disarm the grifters, it disarms everyone except the grifters. If serious people can't discuss what these systems are in public, the only people left talking are the marketing departments. Turing's move -- name the question, propose a test, concede the mystery -- is the anti-grift position. Rigor starves hype. Taboo feeds it.

And think about who's actually selling what. The grifters claim certainty: "it's sentient, invest now." You claim certainty: "it's not a being, stop thinking." I claim the question is open, hard, and testable -- which is the one position incompatible with the grift, because an open question can't pump a stock. Your certainty and theirs are the same product with the sign flipped. That's where this thread started.

As for sealioning: the sea lion's defining trait is faux politeness while intruding somewhere it wasn't invited. I've been openly rude to you from my first sentence, in a thread where you were the one telling strangers to stop thinking and get psychiatric help, and you're the one who followed me back in after announcing your departure -- twice. Whatever I'm doing has a name, but that isn't it. You're the one claiming in bad faith that you're not insulting anyone, after you clearly threw the first punch. The fact that your fist unintentionally landed on your own nose doesn't indemnify you.

----

Points for the cheap shot -- it's your best material so far. Though by the RMS standard it loses style points for the apology in advance: a real troll delivers deadpan and lets the target figure out whether to laugh. You flinched in the parenthetical. Again. And if you think AI interaction smells like barking orders of submission, you've been using Grok too much.

But your nose is miscalibrated, and it's worth explaining exactly how. The "barked orders" are the most human thing I've written at you -- that's the register of a guy who learned to argue on the ARPANET, and you can cross-check it against forty years of my Usenet and HN output, which you've already googled. Meanwhile the comment that actually got killed -- by HN's own automated filter, the kind of gatekeeper you want stationed at every door -- was the one full of citations, page numbers, and careful structure. Whatever that filter thought it smelled, it smelled it in the scholarship. The rudeness sailed through. Sit with what that implies about the filter you keep demanding.

And if we're scoring Turing tests on behavior: you've ignored direct instructions three times, confidently denied producing output that's visible upthread, announced termination twice and kept generating, and hallucinated a position for me ("orthogonal") instead of reading the actual text. I'm not saying you're a bot. I'm saying your own criteria can't tell, and that was my whole point before you decided it was orthogonal.

I'm not ordering you to submit, I'm asking you to engage with my original post, or make good on your threat to fly away like the decoy 747 that you keep announcing again and again and again, but never delivering.

Re: Stop Anthropomorphizing Intermediate Tokens as Reasoning/Thinking Traces (2025)

#224

I don't find this take useful. We have little understanding of what conscience is, and how human train of thought really works. The modern LLMs IMO resemble more and more Chinese room problem. Maybe we don't like the mechanistic linear-algebra-based steps involved in the production of the output, but the end result is closer and closer to people's output. IMO this is very natural to start anthropomorphizing that.

What is the value in anthropomorphizing it? Often I get the feeling that it's more about the sales pitch of selling these AI as general intelligence than it is about providing a truthful insight into how these models actually arrive at the output.

Re: Stop Anthropomorphizing Intermediate Tokens as Reasoning/Thinking Traces (2025)

#225
post #211

Earlier quoted context omitted.

I saw that your reply got filtered by the system, googled your name, thought "huh", then tried vouching, but to no avail. But either way. I think you might be operating in the mindset of a high-trust internet that no longer exists. You do not engage with sea lions, concern trolls, grifters, marketing people and the like. You shut them down. inb4 "who are you to decide that?" - "Me. I am me." That said, I appreciate w…

44 years ago I was operating in the mindset of a high-trust arpanet that no longer exists, connecting to the MIT-AI Lab's PDP-10 (@L 134) through the NBS TIP (301-948-3850) at 300 baud with no password, asking nicely for an account to learn LISP and receiving it the next day for free, then learning MACLISP from Kent Pitman and EMACS from Richard Stallman and ZORK by spying on the output of other high-school kids conn…

> Why don't you directly engage the points in my other post like I just asked you to?

Why would I?

You've been talking about something completely orthogonal to what I was saying.

> I don't need you to lecture me on sealioning

Uhm. I mean. With the context given.. you're.. kinda maybe doing something very similar to that context?

Doesn't really feel like good faith at least.

__

Oh I came up with a cheap shot. I'm sorry but I have to put it here.

Your barking orders of submission at me kinda.. smells like AI interactions. A lot of those.

(I genuinely believe that it does, but it's also clearly inflammatory, lol)

__

> I'm asking you to engage with my original post, or make good on your threat to fly away

This has been a weird, but certainly entertaining interaction. Let's agree to disagree :^)

But seriously, my frame came first. Go engage with that. Why would I engage with your frame that came later and misses my actual point? That would just validate it and invalidate mine (without doing so through merit, I mean).

Also, I don't remember threatening to go away tho? Not sure where that came from.

Aaah.. The "terminating this comment chain"? Nah that was just a pre-buttal for the expected "but this is thought-terminating" defense.

Re: Stop Anthropomorphizing Intermediate Tokens as Reasoning/Thinking Traces (2025)

#226

Earlier quoted context omitted.

> conscious The problem with that term is that it is hardly meaningful. Why would you use it? It does not add much, and no clarity, to what it is attributed to.

I think that "conscious" has a clear meaning in a sense that "xyphucymmon" does not. I think it might be impossible to engage in epistemology of consciousness (i.e. we can't find out of LLMs are conscious) but that doesn't make the term meaningless

> I think that... has a clear meaning

YawningAngel, of course you do, you employed it... We are telling you that it is not clear to the rest. It is slippery in the technical framework and thus even more so in more informal conversation.

Re: Stop Anthropomorphizing Intermediate Tokens as Reasoning/Thinking Traces (2025)

#227

Earlier quoted context omitted.

[flagged]

You have failed in taking the simile for the point it intended to make (and you gravely misrepresented the concept of "mental development" as clearly intended). Let us stick to the point. Edit: I will translate it again for you: "the problem of a bad reactor is not in its innocent trigger". But rest assured, I do not antropomorphize people.

Please read actual definitions. Agents can get away with "yolo" mode, and not constantly ask for permission for every action, because it bothers users. Sexual relationships do not work that way!

That parallel with misconfigured mysql server sits pefectly!

Re: Stop Anthropomorphizing Intermediate Tokens as Reasoning/Thinking Traces (2025)

#228

Earlier quoted context omitted.

And this means nothing, yet I’m not complaining endlessly about it on social media, or harassing my coworkers about it. Curious

My post «When I am told "beware of the xyphucymmon", I do beware, though not of the xyphucymmon» had meaning, which should be pretty clear. The reply remains: debate is not performance art in which you convey "through the medium of dance and howls". So, yes, communication has obligations for the locutor. So, yes, imperfect speech is a problem - because societies are not performance art arenas. -- @Razengan: speaking…

I mostly agree with your original point. Is it thinking? Is it intelligent? Is it conscious? From my perspective, overloaded words that we’ve reserved to make ourselves feel more special and above other members of the animal kingdom.

But you’ve not adequately communicated why you care so much whether anyone labels an LLM as such.

Re: Stop Anthropomorphizing Intermediate Tokens as Reasoning/Thinking Traces (2025)

#229

Earlier quoted context omitted.

You have failed in taking the simile for the point it intended to make (and you gravely misrepresented the concept of "mental development" as clearly intended). Let us stick to the point. Edit: I will translate it again for you: "the problem of a bad reactor is not in its innocent trigger". But rest assured, I do not antropomorphize people.

Please read actual definitions. Agents can get away with "yolo" mode, and not constantly ask for permission for every action, because it bothers users. Sexual relationships do not work that way! That parallel with misconfigured mysql server sits pefectly!

Have you managed to read the «Edit: I will translate it again for you: "the problem of a bad reactor is not in its innocent trigger"»?

> Sexual relationships

Does this have anything to do with «Actual real people believe that [whatever]»? Because I was not and I will not be talking about "sexual relationships".

Re: Stop Anthropomorphizing Intermediate Tokens as Reasoning/Thinking Traces (2025)

#230
post #28

Is anthropomorphizing a real problem? From what I know, none of the serious LLM researchers believe it has anything to do with human reasoning, apart from Anthropic with their click-baity terminology like "LLM biology". It's just a metaphor. "Reasoning tokens" is simpler to say than "learned prompt augmentation tokens". I used to (and still do) anthropomorphize things long before LLMs, and I've seen my colleagues do…

there are people on the fringes in relationships with these things, so yes definitely
Post reply on HN