Viewing profile — abel_

This misses the broader ongoing trend. For a few million dollars, of course you can create a startup that builds tools it can use to more efficiently find code vulnerabilities. And…

On the contrary -- the opposite will happen. There's a decent body of research showing that just by training foundation models on their outputs, you amplify their capabilities. Les…

This was done so that the IRL robot manipulation tasks could be done fast enough. In the future, we may always need small models mixed with large models for some tasks (e.g., for s…

There's a neat argument against these models doing interpolation: the manifold of the data is so sparse that it's infinitesimally unlikely for a good predictor to be doing interpol…

I wonder what the net effect of such pieces of writing is. The problem is that these abstract and contextless statements make sense only if they cause the reader to reflect on some…

The problem with software-controlled permissions is that nation-state actors (who have unbounded resources) can snoop on your private matters with significantly greater ease. At le…

While others here have touched on the idea that Codex has changed their coding habits, what I find interesting is that Codex has changed how I write code altogether. For example, I…

As someone else already mentioned, the scaling laws paint a different story empirically: we haven't hit diminishing returns at all, and there's no end in sight. But more anecdotall…

The most pressing dangers of AI most researchers see: - error rate too high - you can trick a classifier with noise - it's racist sometimes Actual dangers of AI: - stop problem - i…

While progress has been made in computer vision, that progress has been relatively narrow up until now, and I think the activation energy required to produce this level of quality …

Interesting! I hadn't heard this perspective before. Sounds like Goodharting [0] applies to sleep too [0] https://en.wikipedia.org/wiki/Goodhart%27s_law

Completely disagree. I agree that the _delivery_ is important, but the interval between when discovering a problem and announcing it should be minimal. There's a huge difference be…

An interesting reflection is how quickly research around TTS/STT has progressed. I remember reading [0] thinking we were a long ways away. And things will get way better with multi…

I think the distortion of the video-finish camera should be considered when making these estimates. There's quite a lot of it happening in the shot. Narrowing down the specific cam…

While I see the value in gratitude as described by the author, the lesson learned still rings with a certain amount of complacence with the situation at hand. Had there been more t…