Viewing profile — tonii141

I just see a lot of people who’ve put money in the LLM basket and get scared by any reasonable comment about why LLMs aren’t almighty AGIs and may never be. Or maybe they are just …

I’m not demanding anything, I’m pointing out that performance tends to degrade as context scales, which follows from current LLM architectures as autoregressive models. In that sen…

a) That "no-tools" win depends on prompt orchestration which can still be categorized as tooling. b) Next-token training doesn’t magically grant inner long-horizon planners.. c) Lo…

a) Still true: vanilla LLMs can’t do math, they pattern-match unless you bolt on tools. b) Still true: next-token prediction isn’t planning. c) Still true: error accumulation is mi…

Not true. AI has been around far longer than modern LLMs and has performed well in non-generative areas, often with orders of magnitude fewer parameters.

What do you mean by "they add instability"?

I agree, but maybe there is no need for billions of neurons to be simulated right away. Artificial neural networks were pretty small at the time.

Why doesn’t AI use dynamical neurons instead of static activations even when it is known that biological neurons are dynamical systems?

https://archive.is/lYTN8

I have been involved in research focused on ML control for some time, and believe me, I would love to see an AI model capable of controlling arbitrary systems at different operatin…

Let's not forget that this works solely for this particular racing setup. If you change a single gate, the AI they are using would not be able to adapt. Still fascinating, though.

If the model uses FP16 precision and has 7 billion active parameters, it would require approximately 14 GB of VRAM. I didn't read the paper.

AI is used in scene understanding for those applications, but there is no neural network that is steering the wheel.

"they just totally failed to live up to expectation" Because the expectation was too high. If you are aiming for precision, neural networks might not be the best solution for you. …

This article addresses the misconception that arises when someone lacks a clear understanding of the underlying mathematics of neural networks and mistakenly believes they are a ma…

[flagged]

Random generator of tokens can also solve any problem if you give it enough time and memory.