141–150 of 424 posts
"Half the money I spend on advertising is wasted; the trouble is I don't know which half." -John Wanamaker This applies even more strongly to model choosing. I know for a fact that majority of my work doesn't require a very strong model, but separating the trivial and non-trivial tasks is a famously hard problem (if at all decidable).
Seems like they're working to destroy the local LLM argument. Right now Haiku is $1/$5 in/out. You can grind out $12,000 worth of haiku (or arguably, sonnet) class tokens in about 5 months on a Blackwell RTX 6000 96GB especially if using concurrency. BUT, but, if you use a g6e.xlarge on aws it's now more expensive than buying tokens from OpenAI @ $0.20/$1.20. It also destroys "the Mac Mini argument", pushing the ROI…
This feels like the dialup->broadband transition to me. I was already a huge proponent of Luna for things like deep research. Being able to run 5x more for the same cost is simply bananas. We are already running 10 parallel agents for hypothesis generation. I cannot imagine 50. The statistics become much more interesting & powerful when you can run so many samples of the exact same prompt+model without breaking the b…
Very interesting. Can you share more about your hypothesis/research pipeline? I have been using Sol for those types of task because I figured you'd need more reasoning for getting good ideas, but maybe quantity > quality at a certain point?
Phase 1 - Run X copies of Luna in parallel over the user's prompt. The purpose is to generate a diverse set of hypotheses.
Phase 2 - Run Y copies of Terra in parallel to investigate the hypothesis results, with each receiving them in a randomized order.
Phase 3 - Run 1 copy of Sol over investigation reports.
The goal is to ensure that the agent covers more initial starting points before presenting a final conclusion. If you only run a single copy of Sol and it hooks onto something wrong, it might not recover.
Earlier quoted context omitted.
Totally possible that humans aren't actually that intelligent.
As well as the existing intelligence being swayed by emotions, hormones, circadian rhythms, stress, peer pressure, propaganda, and survival instincts.
Earlier quoted context omitted.
We can guess based on the decisions of other inference providers who serve these models.
Do you mean if other providers will cut their prices in turn?
Earlier quoted context omitted.
This is gonna put Sonnet 5 in a really awkward spot.
Sonnet and Haiku were already in an awkward spot, likely by design. Anthropic's big marketing push this year has been entirely focused on getting people to use Opus via a Claude Code subscription, to the point that Sonnet is almost viewed as the poor man's alternative, and from what I've seen, almost nobody uses it. Actually, here's an interesting project for all the vibe coders looking for their next front page post…
> Starting today, GPT‑5.6 Luna, our fastest and most affordable model, will cost 80% less, I don't have the words. I genuinely thought we were in a stage where we were plateauing and going in for 5-10% improvements over months. Seeing spikes like this makes me question about where the floor really is.
But yeah I do'nt want to know what Kimi 3 is pushing buttons inside Anthropic, OpenAI and Google.
Besides any floor: For every year the tokens get faster and cheaper, we will see new things like properly working AI factories which mimic expert teams. A lot more parallism as well.
I don't buy it.
There have been recent weeks where some of the mid-level models (Hy3, Laguna M.1) are free (true for parts of June and July, see Hy3 in Cyan) . Even then the total token usage appears to be reaching a steady-state.
https://openrouter.ai/rankings#top-models
^ the first graph is tokens per week across all models
I guess we just can only throw ideas at an LLM at a certain rate.
I still have ideas and now I can have an LLM vibe code what I want, but I'm not going to let an agent just run unattended for longer than a few minutes or a few bucks for hobby projects.
So maybe it is a matter of lowering the cost of an LLM so I can let it churn for hours at a cost of pennies... But I suspect demand for tokens is very price-elastic.