Viewing profile — marmaduke

similar to RWKV7’s new (sub quadratic) attention mechanism which models key values as v≈kS’ and does an in-context descent on ||v - kS’||^2/2 (where the state matrix S is one atten…

ha, yeah, thanks.

no, wrote it by hand for use with my own Heun implementation, since it’s for use within stochastic delayed systems. jax is fun but as effective as i’d like for CPU

looks like a nice overview. i’ve implemented neural ODEs in Jax for low dimensional problems and it works well, but I keep looking for a good, fast, CPU-first implementation that i…

i like how the contraction it’s and abbreviation T’is are anagrams

I didn’t look it up, but at first glance, it reminded me of discussions like this one https://youtu.be/qnT48wO0UL0

that’s not what the story says. in any case, the point is to explain, in terms of dualistic if-then logic, that the if (you practice now) and then (you will wake up) are a single n…

do you have a link for your game? how was the release process?

how far from your previous experience is the game work?

i wonder if there are any semi automated approaches to finding outliers or “things worth investigating” in these traces, or is it just eyeballs all the way down?

https://www.biorxiv.org/content/10.1101/2024.10.25.620245v1.... covers some of the recent perspectives on this modeling approach if you’re interested.

having worked on whole brain modeling the last 15 years and european infra for supporting this kinda research, this is a terrible buzzword salad. the pdf is on par with a typical m…

HH is kinda the opposite of LIF on the abstraction spectrum.

The pigeon experiment is a great one to learn from not just about programming or software, but about life in general. Where are you getting your next dopamine hit? Is it random? Ma…

> CPUs have the memory capacity advantage perhaps also more precisely they also have quite an advantage on anything that needs and plays nicely with caches? when I sliced my proble…

My approach to this is to write a bunch of tiny “kernels” which are obvious to SIMD and then inline them all, and it does a pretty good job on x86 and arm https://github.com/maedoc…

> People won't even pay for most of these pocket distractions If someone is paying, the transaction, by construction reinforces the psychological boundaries that obliteration elimi…

I think “a cloud never dies” is more apt for this sentiment

How would you want to host or update the markdown file? Sending an email for instance? Or run your own host?

> Unlike most prior efforts, we release not only model weights and inference code, but also the reproducible training data, complete data processing pipeline, rigorous experimental…

Just brainstorming here, but as a parent and someone who subscribed to a weekly CSA, it’d be a big boost to be able to take a picture of what I’ve got and get some ideas about reci…

At the risk of taking some heat, I’d wager a preprint is recognized rightly by the Chinese as a flag planting, we’re first formality, where in the faults may even serve to validate…

I tend to think of science as a distributed consensus process, and that peer review is analogous to a proof of work, and publishers are gatekeeping the distribution of proof of wor…

Was your path towards the decision point a sudden one or a slow burn?

Good question, I only looked briefly at unscented, I just thought ensemble was easy to understand.