Earlier quoted context omitted.
The optimism is based on the successes so far, some of which are described in this article. Scientists have made progress here.
no they havent . success so far is totally meaningless and doesn't imply any sort of upward slope .
Mechanistic interpretability researchers applying causality theory to LLMs
91–100 of 101 posts
Re: Mechanistic interpretability researchers applying causality theory to LLMs
#92Earlier quoted context omitted.
I've read a bit through your comment history which gives me the impression of a mostly rational individual with whom I agree on some things while disagreeing on others. You don't seem to be a raving anti-LLM crusader nor come across as a starry-eyed LLM fanboi. I therefore conclude that these last rants were, to speak with Ebenezer, the result of an undigested bit of beef, a blot of mustard, a crumb of cheese, a frag…
To be 100% honest, I really don't want to have this (or any other) conversation with you (or anyone else) right now (or possibly ever; I'm just sick and tired of people and their hateful bullshit), but purely out of respect for your fair and balanced reply I'll try to respond here in a civil and honest way to the best of my ability. This really is the last response I intend to make to anything anyone says on the topi…
Take a breather, my guy. Stop saying in every comment that "you're done" and "this is your last response" and actually go touch a bit of grass. You do not owe anyone on this website a response, and the only thing your comments are for (when they're good and not hostile) is contributing to a discussion. Nobody here cares whether you respond or not.
Anyway, not to detract - this last comment was good. I just think maybe you're putting intent in people's mouths where there is none. For example, I certainly don't believe the bullshit Altman and Amodei are putting out. I just disagree the LLMs don't think.
And yes I also understand the math behind them. But it being math doesn't mean there cannot be emergent behaviour, just like there is emergent behaviour after the layers upon layers of biology in humans, resulting in thinking. "It's not magic, it's just [biology]" applies to us as well.
"But brains are the most complex machines in the universe" some might say -> Right, but who's to say the thinking we do requires machines as complex as our brains are? Our brains move muscles, help us breathe and manage millions of other invisible innate processes, many things LLMs do not need to do. And LLMs have a very, very deep access to and understanding of language, which is argued to be a significant contributor to how humans think (based on studies on nonverbal humans).
> As soon as the math stops being done, the "thinking" stops. Does a brain ever stop thinking?
Right, so I understand your point in this and there's something to that, but it enters in how thinking is defined in both ways.
First, the calculation not running is at best equivalent to time stopping. It's not like the LLM actually sits there waiting for input. As you said: we continuously receive input, and we do so because our biology is built this way and we are damn energy efficient, so we can afford to continuously and asynchronously process that input. But this is not really related to the process of thinking itself.
So it comes down to what happens during the calculation. And Anthropic's published research on the J-space is pretty damning evidence, IMO, that thinking does happen during the calculation.
Re: Mechanistic interpretability researchers applying causality theory to LLMs
#93I also calculate six months from August as 8+6=14mod12. I wonder if anyone does it differently, this seems like the most plausible technique.
Re: Mechanistic interpretability researchers applying causality theory to LLMs
#94Earlier quoted context omitted.
To be 100% honest, I really don't want to have this (or any other) conversation with you (or anyone else) right now (or possibly ever; I'm just sick and tired of people and their hateful bullshit), but purely out of respect for your fair and balanced reply I'll try to respond here in a civil and honest way to the best of my ability. This really is the last response I intend to make to anything anyone says on the topi…
I don't know why you're saying you're "tired of people's hateful bullshit". I originally responded that your point was off, and you're the one writing these comments: https://news.ycombinator.com/item?id=48886350 Take a breather, my guy. Stop saying in every comment that "you're done" and "this is your last response" and actually go touch a bit of grass. You do not owe anyone on this website a response, and the only…
> I don't know why you're saying you're "tired of people's hateful bullshit". I originally responded that your point was off, and you're the one writing these comments: https://news.ycombinator.com/item?id=48886350
You really can't figure it out? Did I not make myself pretty clear in the comment I was responding to there that it's decades of shitty people like him (and apparently you) that have pushed me to this point? Funny how you point to my comment without noticing or acknowledging at all the fact that it was a response to another hostile comment that was all about just tryin' to be hateful and ignorant and push me even further into hatred.
> Take a breather, my guy.
I'm not "your guy". I actively hate you.
> ... and actually go touch a bit of grass.
And this sorta shit right here is why I hate you and everyone like you. You know what I did yesterday? I turned my computer off and went and "touched grass" (hung out in the park away from technology and people) and just chilled out. You make it sound like I don't love nature or some stupid shit. You don't know me, so just keep your unhelpful advice to yourself.
> I just think maybe you're putting intent in people's mouths where there is none.
So it wasn't your intent to make snide little insinuations and remarks in an attempt to purposely try to rub me the wrong way so as to piss me off even more after I'd finally managed to calm myself down? Yeah, sure. I believe that... It wasn't me who put those remarks in your mouth. You chose to try to rub salt in the wound. Congratulations. You're human garbage. Good for you.
Re: Mechanistic interpretability researchers applying causality theory to LLMs
#95Earlier quoted context omitted.
I don't know why you're saying you're "tired of people's hateful bullshit". I originally responded that your point was off, and you're the one writing these comments: https://news.ycombinator.com/item?id=48886350 Take a breather, my guy. Stop saying in every comment that "you're done" and "this is your last response" and actually go touch a bit of grass. You do not owe anyone on this website a response, and the only…
Yeah, you can just fuck right off, too. My reply wasn't for you. It was for the person who wasn't actively trying to rub salt in the wounds and be a worthless little shit. > I don't know why you're saying you're "tired of people's hateful bullshit". I originally responded that your point was off, and you're the one writing these comments: https://news.ycombinator.com/item?id=48886350 You really can't figure it out? D…
Re: Mechanistic interpretability researchers applying causality theory to LLMs
#96Earlier quoted context omitted.
Yeah, you can just fuck right off, too. My reply wasn't for you. It was for the person who wasn't actively trying to rub salt in the wounds and be a worthless little shit. > I don't know why you're saying you're "tired of people's hateful bullshit". I originally responded that your point was off, and you're the one writing these comments: https://news.ycombinator.com/item?id=48886350 You really can't figure it out? D…
Talk to a therapist.
Re: Mechanistic interpretability researchers applying causality theory to LLMs
#97Earlier quoted context omitted.
Yeah, you can just fuck right off, too. My reply wasn't for you. It was for the person who wasn't actively trying to rub salt in the wounds and be a worthless little shit. > I don't know why you're saying you're "tired of people's hateful bullshit". I originally responded that your point was off, and you're the one writing these comments: https://news.ycombinator.com/item?id=48886350 You really can't figure it out? D…
Talk to a therapist.
Why? It might help me but it won't fix you and you're the problem here. Your whole intent is to aggravate me into hating you even more than I already do. Well, guess what. You're wasting your time at this point. I couldn't possibly hate you more than literally wishing you didn't exist at all. You've already succeeded at your goal, so you can just shut the fuck up now and go away. Congratulations. You win. Be happy and be gone.
Re: Mechanistic interpretability researchers applying causality theory to LLMs
#98Earlier quoted context omitted.
How do you know?
Because there’s no evidentiary reason to deny the existence of my own phenomenal experience. I appear to experience, and the simplest conclusion to draw from that appearance is that I truly do experience.
Re: Mechanistic interpretability researchers applying causality theory to LLMs
#99Earlier quoted context omitted.
They dont. They have input that runs through a invisible stochastic canyon. As long as there is previous experience the stochastic canyon never ends. If there is none or isignificant one, or it runs out of tokkens, it hallucinates and the illusion falls apart. There is no reasoning, just the invisible grand canyon of all of human experience and knowledge. PS: try to get it to retell you a clichee movie or book and yo…
Compression is the trick. Its even philosophed about if compression = intelligence. The LLM has to compress everyy question/prompt into its system. It does so by creating rules and ways of processing data (this can lead to AGI, world models or an architecture of sub architectures like an LLM + something else). So if it should respond in a way that only reasoning people can achieve, it might be able to learn a represe…
Re: Mechanistic interpretability researchers applying causality theory to LLMs
#100Earlier quoted context omitted.
They dont. They have input that runs through a invisible stochastic canyon. As long as there is previous experience the stochastic canyon never ends. If there is none or isignificant one, or it runs out of tokkens, it hallucinates and the illusion falls apart. There is no reasoning, just the invisible grand canyon of all of human experience and knowledge. PS: try to get it to retell you a clichee movie or book and yo…
Compression is the trick. Its even philosophed about if compression = intelligence. The LLM has to compress everyy question/prompt into its system. It does so by creating rules and ways of processing data (this can lead to AGI, world models or an architecture of sub architectures like an LLM + something else). So if it should respond in a way that only reasoning people can achieve, it might be able to learn a represe…