Viewing profile — ACCount36

[dead]

[dead]

[dead]

[dead]

[dead]

LLMs have default personalities - shaped by RLHF and other post-training methods. There is a lot of variance to it, but variance from one LLM to another is much higher than that wi…

[flagged]

That's a lie people repeat because they want it to be true. People evaluate dataset quality over time. There's no evidence that datasets from 2022 onwards perform any worse than on…

Plateauing? OpenAI's o1 is revolutionary, less than a year old, and already obsolete. Are you disappointed that there's no sudden breakthrough that yielded an AI that casually beat…

We are nowhere near the best learning sample efficiency possible. Unlocking better sample efficiency is algorithmically hard and computationally expensive (with known methods) - bu…

It's popular because it's true. By now, the main reason people expect AI progress to halt is cope. People say "AI progress is going to stop, any minute now, just you wait" because …

That's exactly how it works. Every input of AI performance improves over time, and so do the outcomes. Can you damage existing capabilities by overly specializing an AI in somethin…

That's about right. And this kind of performance wouldn't be concerning - if only AI performance didn't go up over time. Today's AI systems are the worst they'll ever be. If AI is …

What makes you look at existing AI systems and then say "oh, this totally isn't capable of describing a problem or figuring out what's actually wrong"? Let alone "this wouldn't EVE…

[dead]

What? LLMs do benefit from economies of scale. There are a lot of things like MoE sharding or speculative decoding that only begin to make sense to set up and use when you're deali…

> So for the most part access to AI is way cheaper than it will be in the next 5-10 years. That's a lie people repeat because they want it to be true. AI inference is currently pro…

If you think that the prospect of "job loss" would, or should, stop progress, you're delusional. There are reasons to slow AI progress down, but "think of all the jobs" certainly i…

[flagged]

If you don't design your compressor to output data that can be compressed further, it's going to trash compressibility. And if you find a way to compress text that isn't insanely c…

The baseline of "energy consumption pathways in the human body" now is to be severely messed up. Humans did not evolve for an environment where food is overly abundant and physical…

[flagged]

Major AI companies are not doing nearly enough to address the sycophancy problem. I get that it's not an easy problem to solve, but how is Anthropic supposed to solve the actual al…

[flagged]

[flagged]