Viewing profile — adw

What is the error rate of human programmers? Anyone who tells you that either human or A.I. code is magically exempt from issues is selling you something.

Other post-train mechanisms have meaningful bandwidth for introducing new information to the model (on-policy distillation is more or less the other extreme). RLVR aligns the model…

This paper is less dramatic than you think it is and really just re-explains what RLVR does. Let's stipulate that what pretraining does is train next token prediction over a gigant…

She went to UCL which is also a tier one university, though.

One of the coolest things about seeing a show at the Fillmore is getting the posters they hand out. A number of bands sell, or have their artists, sell show posters (which then bec…

I mean, they kind of have, but mostly by finding an infinite money glitch.

They’re skint too. It’s something you would really like the research council to take on.

The living-costs stipend for an EPSRC PhD student is around £20k so it's about ten percent of that... big commitment for a student to make!

The usual answer is "config macros", because if you don't give people something Turing complete they'll just m4 their way into Turing completeness and that isn't really an improvem…

Another intuition is that near a minimum you can Taylor expand the function and show that the higher order coefficients (past the square) are negligible.

It is common for big workplaces to have multiple unions and essentially all unions are sectoral and role-specific rather than company specific. Take the NHS; it will have to deal w…

> you cannot go to a bank and ask them to help you acquire something 100x worth your cap. you literally can, it's the entire point of eg management buyouts

It's just an acronym, "parameter-efficient fine tuning". LoRA is one method, prefix tuning is another, there are more.

> So much precision is required that session musicians are playing most of the things you hear, not the actual artists. In pop music this has been true since the 60s. For independe…

Leverage. They’re essentially an 80s style junk bond LBO house.

kexp.org in Seattle and San Francisco for a start.

https://podcasts.apple.com/us/podcast/machine-learning-stree... is a pretty good primer on METR, what it measures, and its limitations.

arXiV is not intended to be your blog. You should be held to a zero-mistake standard when publishing academic work. The people I worry for are the junior researchers who are going …

You are forgetting the albums KG and LW which are both microtonal. I knew exactly what you were saying :-)

You’ve got nine years of experience, so work your network and get referrals. It’s very hard to get mid-career jobs through the front door; most people want someone they trust to vo…

Bunch of Balkan and Turkish music has quarter tones too. (And you’re forgetting KG and LW…)

He did a stupid thing. Doesn’t make him stupid, but the action is. (Also this is a stock phrase.)

When you’re staffing work to a junior, though, often it’s the opposite.

The author knew fine that it was a knob joke ( https://news.ycombinator.com/item?id=26743882 ). In this specific case, play stupid games, get stupid prizes; no-one is asking Le Coq…

Completely unrelated. Recursive Language Models are just "what if we replaced putting all the long text into the context window with a REPL which lets you read parts of the context…