Viewing profile — azakai

If you want a more concrete example, then LLMs are also trained on visual data these days, which means they do have access to the world in an important way. This directly contradic…

You can also take the opposite conclusion from this: C++ is now viable because LLMs can catch the security bugs. I'm obviously not entirely serious here, but I think this is true t…

> How much of the identity of a mathematician is tied up in being the first to discovery? Here is how I'd put it: math has an enormous focus on discovery. It is why we have Godel's…

Wait, what does this mean? > We reuse WebAssembly linear memories under the covers to implement and sandbox the GC heap. A reference to a GC object is not a native pointer, it is a…

The overall point feels strained to me. Yes, formal mathematics has such limits. We can't expect machines to be perfect and provably perfect. But the industry isn't assuming that. …

> All of the AI projects we have observed as a team are failing. Every single one – we have seen 0% success in a year and a half, What is an "AI project"? The post doesn't define i…

I'm not sure what "branch on undefined values" means there, yeah, but never reusing memory addresses is enough to prevent use-after-free. Or, rather, you can use a value after free…

Zig does offer some amount of temporal memory safety. Link: https://zig.guide/standard-library/allocators/ Text: > The Zig standard library also has a general-purpose debug allocat…

Prior art: WebKit.js, the WebKit rendering engine ported to JS https://github.com/trevorlinton/webkit.js/

The researchers in the field disagree with you. Look at conferences like NeurIPS and ICLR to see a steady stream of incremental progress in this area.

The optimism is based on the successes so far, some of which are described in this article. Scientists have made progress here.

Yes, we do see signs of actual reasoning, see the papers linked in the article. (There are many others too.) Yes, we have a tendency to anthropomorphize, but (most) researchers are…

The article answers this question, at least to the extent it can be answered, at this time. We see some signs of reasoning, but also we understand little about how they work.

They made a claim about language models in general, not just ones that had been released so far. The point of the paper, in fact, is that language models are getting "too big", and…

My main criticism of the paper is that it says LLMs work "haphazardly", using probabilistic information. That is a hypothesis, but it is stated as a known fact, a fundamental limit…

Yes. Godot and Zig are the exceptions, and therefore newsworthy.

> Let's keep WebAssembly lean and fast! Note that wasm is still lean and fast - WASI is not part of core wasm, but layered on top. That is, it is possible to implement wasm without…

Not the person you are responding to, but here: > I believe that artificial intelligence has three quarters to prove itself before the apocalypse comes, and when it does, it will b…

Exactly. Here is where this happens in the paper: > Suppose one copies an LLM into AoE II and feeds into the AoE II-LLM ‘I feel lonely’ as an input. This AoE II-LLM replies: ‘I fee…

What about the cognitive capacity of understanding?

If you want examples of this, see the recent book "The AI Con" https://www.goodreads.com/en/book/show/217432753-the-ai-con which describes LLMs as "souped-up autocomplete", complex…