101–105 of 105 posts
This is great. Agentic coding at 600+ tokens/sec is going to be a radically different beast. Coming soon-ish?
Do you have ideas/suggestions for agentic workflows that only start making sense at such speeds?
It's interesting how even 5 tok/s is still much faster than you'd typically type, but feels glacially slow for an agent. On the other hand, I've been using Mimo and Minimax a lot recently. They routinely reach 100-150 tokens per second and that feels too fast , to the point where it's hard to keep up with what it's actually doing. Great for subagents though.
It's interesting how even 5 tok/s is still much faster than you'd typically type, but feels glacially slow for an agent. On the other hand, I've been using Mimo and Minimax a lot recently. They routinely reach 100-150 tokens per second and that feels too fast , to the point where it's hard to keep up with what it's actually doing. Great for subagents though.
Looking at 5 tok/s after reading this comment made me think about why it felt slow and would be unacceptable for work. If you didn't plan or even sometimes despite planning, you have absolutely no idea if it is suddenly going to go off the rails in a wrong direction. Everyday, I'll look at the thinking and it seems pretty good until suddenly I have to slam the esc key because it decided to pursue a completely wrong d…
Earlier quoted context omitted.
Interesting point, i didn't consider the thought process as tokens.
I'm not sure if it's much more though.
Now, if those should be counted in the process or only the output is a harder question.