> To test that progress, we returned to a task the old swarm had struggled with: building SQLite from scratch, in Rust, from nothing but its documentation. Isn't SQLite's source code in its training data?
not in Rust. might be different enough ...
Agent swarms and the new model economics
31–40 of 159 posts
Re: Agent swarms and the new model economics
#32Re: Agent swarms and the new model economics
#33Re: Agent swarms and the new model economics
#34I find these blog posts (and the originals, with Anthropic's C compiler and Cursor's browser) somewhat funny, as if they have this enormous power to build ... but they can't build something unique or new. Like the software sucks, but look how powerful the process is (the models are indeed powerful). And it's a bit of a shame: by virtue of their position (their embedding in the fabric of venture capitalism), it seems…
Re: Agent swarms and the new model economics
#35Re: Agent swarms and the new model economics
#36How do we know if these models weren’t trained on Turso’s rewrite of SQLite in Rust? It seems both likely that they were and impossible to remove that code from pretraining. Doesn’t that make this just about LLM memorization of the training set? What am I missing?
Re: Agent swarms and the new model economics
#37Earlier quoted context omitted.
Some of this stuff is ludicrous. I finally tried /loop last week and discovered every loop iteration passes the entire context history to the model. So pretty quickly you're running a full 1M context window, without cache, likely just to check if something is ready or needs to be done. It's miserably terrible engineering unless your entire and only goal is to burn tokens.
Wait, why isn't context cached with /loop?
Re: Agent swarms and the new model economics
#38Earlier quoted context omitted.
It's hard not read such quotes and immediately think of the Infinite Monkey Theorem. https://en.wikipedia.org/wiki/Infinite_monkey_theorem
If at the end Shakespeare-level literature is produced, does it matter whether we arrived there by random keystrokes?
Re: Agent swarms and the new model economics
#39That said, I love the work on figuring out these harness coordination jobs. While there are analogs to human management there is also this enticing feeling that, since the models are broadly deterministic, we might be able to get repeatable science-type lessons about managing them with enough testing.
Re: Agent swarms and the new model economics
#40Earlier quoted context omitted.
Some of this stuff is ludicrous. I finally tried /loop last week and discovered every loop iteration passes the entire context history to the model. So pretty quickly you're running a full 1M context window, without cache, likely just to check if something is ready or needs to be done. It's miserably terrible engineering unless your entire and only goal is to burn tokens.
Wait, why isn't context cached with /loop?