Viewing profile — refibrillator

All the author’s comments here are straight from Claude too :/

Previous discussion here (with links to actual primary source): https://news.ycombinator.com/item?id=48023079 No technical report published yet, unlikely code or weights will be ei…

Hmm in distributed computer systems similar patterns exist, e.g. adding jitter to avoid thundering herd effects. This feels like an essential pattern of the universe or something…

Sometimes I wonder if anyone else feels there is a halo effect around certain personalities on this site. When I see someone ending nearly every comment with a link to their blog o…

Here’s a starting point: https://pmc.ncbi.nlm.nih.gov/articles/PMC5241507/#B1 TLDR: NAC is a derivative of an amino acid called cysteine, as such it is a precursor for one of the m…

No disrespect but paying to verify age feels absurd, let alone putting a private company in charge of what should be an essential function of the government. How about when you tur…

H100 has 80 GB of HBM3 . There’s only like 37 MB of SRAM on a single chip.

Fascinatingly, the body already has a mechanism for this: fasting. One of the many beneficial side effects is rapid mucosal atrophy, decreasing villus height and crypt depth. You c…

This is hilarious, I don’t even want to know if it’s legit.

Love anecdotes like this! But admittedly I feel a bit lost, so please forgive my ignorance when I ask: why does choosing a subset of k integers at random require deduplication? My …

One of the cooler and lesser known features of JPEG XL is a mode to losslessly transcode from JPEG while achieving ~20% space reduction. It’s reversible too because the original en…

Yeah it’s pretty clearly a bot account, or at least someone who likes to copy paste from chatgpt to sound smart.

> It works better! > I strongly believe it is one of the best technologies for AI agents Do you have any quantitative evidence to support this? Sincere question. I feel it would ad…

Ha made me chuckle. For those wondering seriously about this, it’s not a viable optimization because weights are not readily compressible via JPEG/DCT, and there are a limited numb…

Great exposition, loved the touch of humor. Please do the backward pass when it’s published. As a fellow Tri Dao groupie and lucky duck who gets to build on Hopper/Blackwell cluste…

Well “import torch” for example will resolve certain dynamically linked symbols, which must be done first before importing your own .so code that uses libtorch and pybind11. If not…

Tokenization is typically done on CPU and is rarely (if ever) a bottleneck for training or inference. GPU kernels typically dominate in terms of wall clock time, the only exception…

Hi author(s), the on-GPU interpreter approach looks like a promising path forward, have you seen this strikingly similar concurrent work? https://news.ycombinator.com/item?id=44111…