Viewing profile — sarosh

But why does, as you explain "training goes brrr"? Francis Bach, the author, makes a good faith effort to explain exactly why this material is beneficial (see https://francisbach.c…

This is the PDF of the following 2011 book focused on FFTs and fast arithmetic for both real numbers and finite fields. https://www.amazon.com/Matters-Computational-Ideas-Algorithm…

Interesting that the underlying model, a LoRA fine-tune of Qwen2.5-Coder-32B, relies on synthetic data from Claude[1]: But we had a classic chicken-and-egg problem—we needed data t…

Defer to other experts, but (briefly) normalizing flows are a method for constructing complex distributions by transforming a probability density through a series of invertible tra…

This actually seems like just a very clever market segmentation solution since the GPU was already limited to 8x PCIe lanes (its a laptop GPU see https://www.notebookcheck.net/NVID…

A wonderful thread from last year (https://news.ycombinator.com/item?id=33990944), looking for new recommendations!

The paper, Trigger-Level Event Reconstruction for Neutrino Telescopes Using Sparse Submanifold Convolutional Neural Networks, is here https://arxiv.org/abs/2303.08812 . The crucial…

Looking at https://research.wmz.ninja/projects/phd/rulesets/default/eve... provides most of the key 'game loops', i.e. # idea -> prelim -> major -> 2 figures -> submitted paper int…

A (now 6 year old) discussion that might be helpful: Anders Hejlsberg on Modern Compiler Construction: https://www.youtube.com/watch?v=wSdV1M7n4gQ Also https://github.com/salsa-rs/…

The author, David Mumford, is known for his distinguished work in algebraic geometry, and was awarded the Fields Medal in 1974. [2] Pattern theory was formulated by Ulf Grenander t…

Heres the Arxiv link with the PDF since the Science link isn't working. https://arxiv.org/pdf/2203.07814v1.pdf *See p. 21 for a list of benchmarks, including the results of a finet…

The repo from the paper: https://github.com/mlpen/Nystromformer

A more detailed source: https://www.pulitzer.org/winners/staff-quanta-magazine-new-y... , explaining "For coverage that revealed the complexities of building the James Webb Space T…

The pre-print referred to in this article itself is here: https://arxiv.org/abs/2111.15323

An interesting take from Mike Pondsmith given his heavy involvement in the venture at the end of (at least in my opinion) well-written article: "[C]omparing the tabletop experience…

The paper itself is here: https://arxiv.org/abs/2111.09259 with the key conclusion that "Examining the evolution of human concepts using probing showed that many human concepts can…

Can you explain a bit about your personal note taking/retention process?

A nice summary of the current understanding (from a lay perspective) on manifold "sameness". From the article: "But Freedman’s [1981] proof left open the “smooth” four-dimensional …

There is already a nice writeup on the current incident from Cloudflare at https://blog.cloudflare.com/october-2021-facebook-outage/ They key observations: "Due to Facebook stoppin…

This Economist article is from October of 2020. Peter Turchin is not a historian. He is instead in the Department of Ecology and Evolutionary Biology at the Universtiy of Connectic…

Thanks Lee - appreciate the insight!

Hi Aaron - are you using VSCode for the IDE? How is this similar to/different from say, Gitpod?

The write up at https://blog.cloudflare.com/doom-multiplayer-workers/ contains a lot more technical details, including the Durable Object interaction with Workers.