Viewing profile — timlarshanson

This was very surprising to me, so I just fact-check this statement (using Kimi K2 thinking, natch), and it's presently is off by a factor of 2 - 4. In 2024 China installed 277 GW …

Re the Apportionment Act of 1929 -- care to elaborate? Are there figures for "the worst representation in the free world"? My impression is that there are many reasons for the dysf…

Ok, thanks for the clarification. Seems the implicit assumption then is that M(q) -> v 'looks like' or 'is smooth like' the dot product, otherwise 'train on keys, inference on quer…

I doubt it. This does not seem to be a particularly well written or well thought-out paper -- e.g. equations 6 and 7 contradict their descriptions in the sentence below; the 'theor…

Yes, this bothered be as well - the department of government efficiency is, as with all government agencies, is working for the public good in the public interest. This means every…

Yep. From what I've seen, if the head wants to do nothing, it can attend to itself = no inter-token communication. Still, differential attention is pretty interesting & the benchma…

Agreed. Also, how does it get started? Seems like the only force pushing the piston against the axial cam is the fuel explosion. (Perhaps extra springs to retract the piston for in…

Yep. This is a very interesting material, and of course it's a research prototype -- but it's not very strong. They list the modulus as 12.7 GPa and the yield strength (= ultimate …

I don't follow how punctuated equilibrium fits in here, but I do agree with your general intuition. Evolution 'likes' spaces that are navigable. Protein evolution is, in my mind, t…

I was aware of Neftci's work, but not your result -- I stand corrected! Given the perspective, given LIF networks are causal systems, of course you can reverse it with sufficient m…

But, if your realistically-spiking, stateful, noisy biological neural network is non-differentiable (which, so far as I know, is true), then how are you going to propagate gradient…

Agreed. As I've grown older, I spend less time running tight verbal loops in my mind, and more time examining things visually. It seems more externally-oriented, and allows for bet…

> This is mostly meant for neuroscience research in animals. Exactly! And thank you, nice summary. It should be noted, with respect to other comments here as well, that in animals …