Viewing profile — davmre

This sounds more or less unavoidable? Decompilers are inherently security-sensitive. If you take avoiding cyberattack uplift seriously as a goal, I don't see how you get around ess…

The KV cache consists of activation vectors for every attention head at every layer of the model for every token, so it gets quite large. ChatGPT also estimates 60-100GB for full t…

Why can't it be both?

It's true that these are very different activities, but I think most ML researchers would agree that it's actually the creation of ImageNet that sparked the deep learning revolutio…

There actually has been some recent work on digitizing smell, most notably Osmo, which was founded by some ex-Google ML researchers: https://www.salon.com/2025/01/05/digital-smell-…

Even if you charge $10/hr, or whatever the market rate would be for street parking spots, you still need an enforcement mechanism to prevent people overstaying. In general, the ide…

Senators, especially committee chairmen, have quite a bit of implicit leverage, beyond the direct leverage of subpoenas or directly cutting funding to an offending agency. Any give…

If you enjoyed this article then you must watch the A Capella Science music video on the same subject: https://youtube.com/watch?v=TzN148WQ2OQ By far the catchiest song about eel m…

The public interest is in judging the trial process , not in judging the defendant. Suppose the government charges you with murder, searches your house, and finds your sex toy coll…

Regardless of the effects, I don't think the case against MS was brought with the intent to "punish" MS through the trial process. The government brought the case because it though…

Sure, there's a strong public interest in having proceedings on record. US civil cases are supposed to have a presumption of openness, which the judge weighs against other interest…

If there's a general standard of transparency applied to all companies, fine. There are costs to increasing transparency, but certainly you could argue for that policy. The argumen…

> The government doesn't have to win an antitrust trial in order to create competition. As the saying goes, "the process is the punishment." Regardless of what you think of Google …

Scholarly consensus is that the "Gospel of Matthew" was not written by the apostle Matthew and the "Gospel of John" was not written by the apostle John: https://en.wikipedia.org/wi…

They're not proposing to apply tensor decomposition to an existing collection of weights. It's an architecture in which the K, V, and Q tensors are constructed as a product of fact…

You're totally right there must be supervision; it's just a matter of how the term is used. "Supervised learning" for LLMs generally means the system sees a full response (eg from …

Backprop itself doesn't invert the computation, but it does give you the direction for an incremental move towards the inverse (a 'nudge' as the article puts it). That is, given a …

Nitpicking, but for a technical audience it's worth noting that ibogaine is not at all a 'potent' psychedelic in the pharmacological sense of the term. A typical therapeutic dose i…

> Altman was initially going to cooperate and even offered to help, until Brian Chesky & Ron Conway riled him up I don't think the article supports this. All we know is that sama a…

Counterpoint: SSRIs were transformative for my depression. Side effects were minor and manageable (eg, Wellbutrin worked well to prevent any sexual dysfunction). I was on them for …

Prophet has gotten a lot of attention since being released in 2017, I think because the idea of a fully automatic solution is very appealing to people. One of the original develope…

Before trying MDMA I had mostly written it off as a feel-good drug: an artificial high like cocaine or meth, useful only for escapism. Why bother chasing that sort of experience? B…

For what it's worth, Jax (github.com/google/jax) now lets you use XLA to compile Numpy code. It'd be cool to see how that would stack up in a modern comparison.