Viewing profile — Ari_Rahikkala

I'm a big fan of Scott's, but I haven't been happy to see how this story's failure to say what it means has in some ways only made it less relevant over the years as we've come clo…

Neat. Very similar to tree-based speculation as they point out, and they also point how to combine them. Speculative decoding: Sample a linear output (next n tokens) from draft mod…

> Almost every team that I’ve been talking to that is training a LLM right now talks about how they’re training a Chinchilla optimal model, which is remarkable given that basically…

Call me an optimist, but I think prompt injection just isn't as fundamental a problem as it seems. Having a single, flat text input sequence with everything in-band isn't fundament…

"They" as in OpenAI, when they trained the tokenizer, just dumped a big set of text data into a BPE (byte pair encoding) tokenizer training script, and it saw that string in the da…

> Models like ChatGPT aren’t eligible for the Hutter Prize for a variety of reasons, one of which is that they don’t reconstruct the original text precisely—i.e., they don’t perfor…

> I'm glad that you enjoyed my previous responses, but I want to clarify that I was not pretending to be a Linux terminal. People who like to pooh-pooh generative AI systems as una…

Stories like this might as well be titled "Local change in Earth's magnetic field causes objects to float in the air". They shouldn't be read and then disputed because their detail…

With the defaults of per_replica_batch=1, seq=2048 and gen_len=512, a completion takes about 20 seconds. I'm not sure yet what settings I'll end up with if I decide to play with th…

I'm running it comfortably on my 3090, although it's a really snug fit for the VRAM, and that's with a number of fixes to significantly reduce its memory use from https://github.co…

I used to think that this was only ever going to be possible with some sort of incomprehensible type trickery that I would never be able to understand. Then TypeScript came along a…

Hello, my name is Ari and I'm a type addict. Thankfully, the impulse to waste time trying to come up with the most precise typing possible for everything hasn't been as strong with…

The Internet often makes me feel old, but seeing Photopia called a "newish" game certainly put some spryness in my joints again. It's not that it's not a great game - it is - but e…

Aw. Well, it was worth a shot, that kind of mild homonym abuse is kind of direction that these sorts of titles usually tend to take. Fortunately the real story is more interesting.…

My guess is it's either about a picture of Donald Knuth, or Knuth's reward checks, being put in picture frames.

"Nitpickers will complain that this isn’t the same as pickle.load(), since you have to pass a Class token to choose what type of thing you want ahead of time. However, nothing is s…

Could be it just came across the right pair of eyes. It's quite reminiscent of the old EvilIx problem in Haskell, where you can break memory safety without doing anything explicitl…

This turned out to be quite an angry post, so a quick preface: All of this is a knee-jerk response to a single sentence in your post. So, you know, please take with a grain of salt…

I don't know. Maybe if you've been reading bad science fiction with immortal geniuses running around everywhere, it might seem that living to 120 and having an IQ of 130 is leaving…

Just to make sure I'm not completely confused here: "Information can't be lost" and "you can't arrive to the same state of the universe through two different paths" are two ways to…

I'll admit to not being a physicist and to being easily confused by the subject, so I'll just use a silly little metaphor to check whether I'm thinking straight, and try to avoid t…

Only locally, though. The next galaxy cluster over has a uniquely privileged inertial reference frame, too, but it's in motion (and accelerating!) relative to ours.

AIT applies to: - Votes with at least three options. A simple majority vote between two options does in fact satisfy all of Arrow's fairness criteria (if only vacuously). - Ranked …

Just for the sake of having another solution for the same problem, here's the basically-zero-thought-required brute-force search solution in C: https://gist.github.com/arirahikkala…