Viewing profile — x1000

It’s the negative of the inverse of the golden ratio. (Also 1 minus the golden ratio.) So, good for anything the golden ratio itself is good for.

Not a physicist, but I see it this way too. My understanding of Boltzmann brains is that they are a theoretical consequence of infinite time and space in a universe with random qua…

If they had experimented using a newer model (gemma 3, deepseek-1 7b, etc.) and reported better results, would that be because their newer baseline model was better than the llama …

It’s the fundamentals that underly Stable Diffusion, Dalle, and various other SOTA image generation models, video, and audio generation models. They’ve also started taking off in t…

I ran into exactly same pain point which was enough to nullify the benefits of using zod at all.

Could you help explain how we would achieve an attention score of exactly 0, in practice? Here’s my take: If we’re subtracting one attention matrix from another, we’d end up with a…

My first exposure to computer architecture was through a Minecraft video[1] (which I likely stumbled upon on Digg). In Linear Algebra lecture the next day, I overheard my classmate…

There’s a video[1] of Karpathy recounting an email correspondence he had with with Bahdanau. The email explains that the word “Attention” comes from Bengio who, in one of his final…

Imagine you are a LLM and all you see are tokens. Your job is not only to predict the next token in a sequence, but also to create a nice embedding for the token (where two similar…

An interesting aspect of these cryptocurrencies is the aspect of consensus, not through the intended mechanisms like PoW, but through societal acceptance. Look at BTC and BTG (bitc…

Reminds me of Asimov's Second Law of Robotics[1]. [1] https://en.wikipedia.org/wiki/Three_Laws_of_Robotics

I've been studying the bitcoin book lately [1]. Slowly but surely I'm getting a better understanding of all the pieces involved. I was inspired by an article I found here on HN, [2…

Been following this guy for a while now too. And you're absolutely right. It's been fun watching his evolution. Glad to see this series of articles posted here. I've been sharing t…

Is there a reason you specified partial derivative with respect to time? Why not just d/dt(state)? I've been tempted lately to model application state as the integral over time of …

I thought this would only apply to rendering graphics, but after reading the "When To Use It" section, I realized I've done double buffering on entire game states before (~2 years …

Idk anything about any of it. But, what if open AI is "bad" at ward placement because it plays itself so much, it already know exactly where it would be if it were the other team?

This article seems relevant, https://www.typescriptlang.org/docs/handbook/advanced-types.... . Particularly the part on discriminated unions. I'm just now learning TypeScript, so I…