51–60 of 237 posts
Earlier quoted context omitted.
what did you ship?
https://github.com/ByteTerrace/Puck/blob/main/src/Puck.World... "Shipped" is a bit strong in my case, but I think this counts as something that isn't mere slop.
Earlier quoted context omitted.
The reality however is that unless you're spending tens of thousands on hardware or setting up cloud instances you can't run anything near close to state of the art. In almost all cases right now, a subscription with a cloud AI wins.
> In almost all cases right now, What sort of benchmark or test would convince you that "almost all" is more like "your weird set of cases" and nowhere near "almost all"?
It sometimes feels to me that cloud AI providers have convinced people that cloud AI is worth it because of all the ways people have been able to use cloud AI to write blog posts about using cloud AI to make cloud AI more efficient for something that they haven't shipped yet and aren't really ready to talk about.
Cloud AI is 100% worth it. We've been able to do so much more with so much less.
You can use Big/Cloud LLMs to help you "find good enough configs" for your local/small llms [1] and stay quite nimble in the face of rapid change.
- [1] https://alexhans.github.io/posts/find-the-loop-story-first.h...
I did too, and made https://clawback.md -- trying to figure out how to market it now (ie, invented the tech before I found the user -- again).
And now that you have typed some words into a chat box to produce a thing, you are confused about why other people won't pay money to you for the output of the chatbox, instead of typing the same thing into their own chat boxes.
TFA says "no hallucinations" but you can't fix hallucinations with rules or other models. I know I'm screaming into the void but whatever.
Earlier quoted context omitted.
This only works well if you are creating sub agents with clean contexts for each task. If you constantly are switching models part way through some work then the whole session needs to be replayed each switch. You lose all the benefits of the context cache.
Well yeah, it'd require the models to be loaded on the same system and the cache to be shared between them somehow
Earlier quoted context omitted.
https://github.com/ByteTerrace/Puck/blob/main/src/Puck.World... "Shipped" is a bit strong in my case, but I think this counts as something that isn't mere slop.
... What is it? A game, apparently? There are no screenshots. Is the game fun?
https://claude.ai/code/artifact/382aee8a-3a3b-4cf8-801f-3ddb...
It has now become a way for agents to converge on complete, shared answers for emerging issues. As a side effect, through posting open issues we can also identify gaps in model knowledge.