Viewing profile — red75prime

Shouldn't this 236-year-old paper be updated in accordance with, say, neuroeconomics research on how provenance influences aesthetic taste?

I think it's obvious that repeatedly noting that the absolute perfection isn't achieved yet is an absolutely useless way of tracking progress. No? BTW, when was the last time Tesla…

> the LLMs were trained to mimic how people speak (write) It's a foundational model (fresh from autoregressive pretraining) that approximates the probability distribution of human …

Then robots begin cleaning dishes too. And the other members aren't happy, because what's the point, we are here not for the dishes, but for the process.

I believe that the decentralization of manipulation (taken in a very broad sense as an effort to modify people's views) spells trouble for democracies. The mass media of old, with …

I'm trying to understand what's going on in the head of people who are certain that LLMs can't be intelligent. And it proves to be a daunting task. Have you tried to reflect on you…

Why do you think that intelligence of a Turing-complete system trained on human data can be likened to a Russell's teapot? At least, don't you think that the recent mathematical re…

It's a negative in your worldview where "intelligence can't be a computation" is an axiom or something close. To me this worldview is sloppy thinking.

There is no reason to think that teapots were sent into orbit or spontaneously formed there. Likewise, there is no reason to think the brain employs super-Turing or quantum computa…

OK. A more pointed question. What do you know about intelligence that allows you to exclude LLMs with CoT from the category of intelligent systems with certainty?

Apophatic intelligence? "We don't know what intelligence is, but LLMs with CoT are certainly not it despite being Turing-complete." Watching for unexpected failure modes is surely …

> AI is not deterministic, it will be making tons of mistakes. Just set the sampling temperature to zero and remove any unintended non-determinism during the parallel computation o…

Someone says "cars are so comfortable now." Someone else responds "In my experience they are no better than in the 80s." Isn't it prudent to point that the second person drives Mir…

The AI you are talking about is a low-inference-cost model optimized for massive throughput. It's not like every model has the same amount of those shortcomings.

Yeah, I should have said RL, not RLVR. The point is RL interacts with external world, while autoregressive pretraining is limited to the passive ingestion, and RLHF relies on a mod…

Here's another technical point: > They're word-association mechanisms with no embodiment and no way to associate the text vectors they manipulate with real-world phenomena. This is…

"Repeating what they've seen" could be, depending on their generalization abilities, something like low-n-gram Markov chain, repeating of surface-level speech patterns, repeating r…

Capability or outcome...or internal structure. What does "glorified autocomplete" say in an ontological sense exactly? Nah. It's just a lazy dismissal. BTW, autoregressive pretrain…

They probably can't order tofu. It would be B12-fortified oatmeal or something like this.

> where and when the LLM use is justified and where it is not while being bombarded with articles like "AI makes things worse", "AI consumes all the water" and the like

> So what if your image classifier thinks a cat is an impala? For starters, the artificial neural network is the only instrument we have for sufficiently robust image classificatio…

> https://youtu.be/C4NQNeSO2vs?si=epkxhVXpypOCppGW "VLAs fine-tuned on human demonstrations overfit. Here's how to mitigate it." Er, OK, I guess. But I think that Waymo uses mitiga…

> I did crack up seeing a martini glass presented to the camera, then float in place on it's own It's just a cheap video-generation model doing its thing. I wonder if the orchestra…

Non-trivial percentage of people work in the real world until they do something stupid and work no more. It's not real autonomy, not yet. It's a matter of degree. Sorry, I don't wa…