Viewing profile — naasking

People say Qwen overthinks because they analyzed the thinking traces, and Qwen finds the answer relatively quickly but then second guesses itself multiple times for another 20,000+…

The continued vagueness suggests this isn't going anywhere, so I'll just conclude by saying that you've given nobody any real reason to believe this.

No such thing has been shown.

Typical LLM pretraining is very inefficient with data. NanoGPT slowrun shows that data can be used much more efficiently.

I don't understand all this dismissal of Einstein. What you just described is that he published a unified theory of Brownian motion, developed a new way of conceptualizing scientif…

I use LLMs regularly for real work. I understand the current limitations, but you're talking about existing limitations that will never be overcome, because they cannot be overcome…

Yes, it's worse because processors clocks are much faster than memory clocks.

Yes. That's why law is a different discipline from linguistics requiring its own rules of analysis, pedagogy, etc.

That's just vibes then. How is that supposed to be convincing?

> but there are many things which they are not good at which it is not cost effective or meaningful to improve Can you name a few such things so I can keep an eye on them in the co…

> We know exactly how attention layers work and how they produce the next word as well as draw them from larger feature spaces. This is not what's meant by the statements that we d…

The search space is far too large for a mere order of magnitude to make any difference at all.

> we know everything about how LLMs work No we don't. That we understand the low level mechanics of a system doesn't mean we understand how any high level phenomena emerge from tho…

I don't think that's correct. Increasing parameter count increases capabilities in all domains per the scaling laws. Models are larger than they were years ago, so capabilities in …

Bribes are not speech though, and advertising is.

It's interesting to claim that it would be difficult to explain why we punish successful crime more. A successful murder creates more suffering (victim's friends and family), and o…

It does matter though. If you want to murder someone by hitting them with a plushie, you're not going to get charged with attempted murder because it's not possible that that would…

The margins for groceries are objectively thin. The only way to provide food at lower prices is to provide a worse good or service, eg. less variety, less quality, less availabilit…

Yes, but there is little evidence this had a meaningful effect on votes.

They're important everywhere of course, but especially on mobile. If AI researchers figure out how to offload knowledge and expertise from reasoning weights, then a core reasoning …

> I can't see how the model could include the actual subjective human experience. People who say LLMs have subjective experience aren't saying they have human-type subjective exper…

Even mechanistic models generate interesting discussion. How many years have we discussed Turing machines and the lambda calculus? Almost a century of great work came out of those.…

> Dunno about the parent commenter, but I personally interpret the concept as having a hidden representation of self that is continually tended to I don't see why an LLM could not …

Making definitive claims about whether LLMs do or do not have specific properties absolutely does require precise definitions of those properties that can be used to evaluate those…

> The qualia themselves, even those that are quite abstract, are rooted in our physical presence and evolution. There is no objective evidence of qualia. All evidence of qualia are…