Viewing profile — Zondartul

It is easier to trust in the correctness and reliability of an LLM when you treat it as a glorified NLP function with a very narrow scope and limited responsibilities. That is to s…

In my unqualified opinion, LLMs would do better at niche languages or even specific versions of mainstream languages, as well as niche frameworks, if they were better at consultig …

At some point our understanding of fundamental reality will be limited not by how much the physicists have uncovered but by how many years of university it would take to explain it…

Comments that explain the intent, rather than implementation, are the more useful kind. And when intent doesn't match the actual code, that's a good hint - it might be why the code…

Ask stupid questions, receive stupid answers.

What does "speculative" mean in this case? I understand it as CPU-level speculative execution a.k.a. branch mis-prediction, but that shouldn't have any real-world effects (or else …

Normal welding needs heat to melt the metals. Cold welding happens without heat. Two metal parts will cold-weld on any smooth, touching faces if the air molecules that keep the two…

Cold welding is unintentional, spontaneous joining of two metal parts in vacuum. You don't want that to happen, especially if the parts are meant to move. Normal welding is intenti…

ARC problems are too hard for me. I'm no longer sure I'm generally intelligent.

By "learns" do you mean "just shove the entire codebase into the context window", or does actual training-on-my-data take place?

To be fair, once someone has physical access to the machine, them having full access is just a matter of time and effort. So at that point it's security-through-too-much-effort-to-…

Future NeuroLink collab? Grab the experience of qualia right from the brains of those who do the experiencing.

If we figure out AGI, that still doesn't mean a singularity. I'm going to speak as though we're on the brink of AI outthinking every human on earth (we are not) but bear with me, I…

You can say "Bullshit". LLMs bullshit all the time. Talk without regard to the truth or falsity of statements. It also doesn't pressupose that the trueness is known, nir deny it, s…

My hunch is that since LLMs are trained on a per word basis (okay, per-token), vacuus verbosity is overrepresented. If you have one normal sentence and one overly verbose, the latt…

Rule #1 of talking about the aether is "don't call it aether". Nowadays it's "spacetime this" and "mass-energy tensor that" and "properties of vacuum something else".... and we sti…

I applaud the effort, but, these templated skill trees are just not very good imo. I have only one issue but it's a big one: It's missing a tree structure, so there is no ordering …

As far as I understand, and I may be wrong here, the system is composed of two networks: Gemini and AlphaZero. Gemini, being an ordinary LLM with some fine-tunes, only does transla…

It's cool how some minerals are just lying out in the open on Mars. On Earth this would have been washed away or buried under the soil.

With how big and aggressive Disney is I'd expect it to be under ongoing litigation 24/7/365.

It's convienient because any random collection letters is a "valid" brainfuck program.

I'm now convinced Disney has better engineers than Tesla and SpaceX. Maybe even on par with Boston Dynamics.

There is no benefit to ultra-processed fast food, but a lot of people eat it anyway. Social media is just fast food for the brain.

Sorry, I meant the information that is inferred (from scratch on every token) from the entire context, and is then reduced to that single token. Every time a token is generated, th…

The tokens are also necessary to store information, or at least off-load it from neuron activations. E.g. if you asked an LLM "think about X and then do Y", if the "think X" part i…