Viewing profile — scribu

> But isn't it true for JavaScript too? You're right, the equivalent JS script produces the same sequence of outputs. It turns out there is a way to emulate Python's asyncio.create…

> Awaiting a coroutine does not give control back to the event loop. I think this is a subtler point than one might think on first read, which is muddled due to the poorly chosen e…

ChatGPT Plus has that (used to be in the free tier too). You can toggle between versions for each of your messages with little left-right arrows.

I’m confused by the clustering step: > To find the most informative examples, we separately cluster examples labeled clickbait and examples labeled benign, which yields some overla…

It’s interesting that they decided to move all of the architecture-specific image-to-embedding preprocessing into a separate library. Similar to how we ended up with the huggingfac…

This seems to be a system to generate better prompts to be fed into a base multimodal model. Interesting, but title is definitely clickbait.

You could run the build process with chroot or inside Docker, so that the hardcoded paths actually resolve to a designated subdirectory.

From their Notion page: > Skywork-OR1-32B-Preview delivers the 671B-parameter Deepseek-R1 performance on math tasks (AIME24 and AIME25) and coding tasks (LiveCodeBench). Impressive…

“Fill in the gaps by using context” is the hard part. You can’t pre-bake the context into an LLM because it doesn’t exist yet. It gets created through the endless back-and-forth be…

The point is that you’d expect a roughly even distribution of clockwise and counterclockwise spins, not all of them to rotate in the same direction.

If the base models already have the “reasoning” capability, as they claim, then it’s not surprising that they were able to get to SOTA using a relatively negligible amount of compu…

The install speed alone makes it worthwhile for me. It went from minutes to seconds.

The HN submission title is editorialized in a non-helpful way. Why beat a dead horse instead of focusing on what’s actually new in TFA? The linked paper proposes an obvious-in-retr…

Would be curious to know how this stacks up against Coconut [1] which also uses latent space for reasoning. [1] https://arxiv.org/abs/2412.06769

The repo contains only the PDF, not actual runnable code for the RL training pipeline. Publishing a high-level description of the training algorithm is good, but it doesn't count a…

Nice approach! I'm intrigued by the ability to start execution from a particular task. One thing I like about LangGraph is the declarative state merging. In the MapReduce example, …

Actually, there have been attempts to do quantized backprop, but not sure how successfully.

I'm working on something like that. Feel free to email me (address in my bio).

I’m not sure about the Speed chart. I would expect gpt-4-turbo to be faster than plain gpt-4.