> $0.20 per million input tokens and $1.20 per million output tokens for Luna
This is... ridiculously cheap. Amazing!
Advancing the price-performance frontier with GPT‑5.6
231–240 of 424 posts
Re: Advancing the price-performance frontier with GPT‑5.6
#232Earlier quoted context omitted.
Very interesting. Can you share more about your hypothesis/research pipeline? I have been using Sol for those types of task because I figured you'd need more reasoning for getting good ideas, but maybe quantity > quality at a certain point?
Here is a rough approximation of the pipeline I use: Phase 1 - Run X copies of Luna in parallel over the user's prompt. The purpose is to generate a diverse set of hypotheses. Phase 2 - Run Y copies of Terra in parallel to investigate the hypothesis results, with each receiving them in a randomized order. Phase 3 - Run 1 copy of Sol over investigation reports. The goal is to ensure that the agent covers more initial…
How do you run this phases and parallelization on each?
Via just ... "prompting it"?
Or do you use any tool in the middle to ensure this agent architecture?
Just curious if there is any workflow-like tool in the middle that is helping.
Re: Advancing the price-performance frontier with GPT‑5.6
#233Earlier quoted context omitted.
It's cheaper currently on many of the inference providers. Personally, I'm having surprisingly good results with DeepSeek 4 Pro at home, which is very good value for money: it's not as good as Claude / GPT 5.6 (I have Co-pilot license at work), but it's still really useful for code reviews, validating thoughts, and especially designing / writing unit tests for new (and old before refactoring) functionality. And it's…
I tried out deepseek v4 pro via a couple providers from openrouter, and it's always getting 429s. Are you running it on your own hardware?
Works fine for me via opencode go.
Re: Advancing the price-performance frontier with GPT‑5.6
#234Earlier quoted context omitted.
is kimi that cheap? it's a very expensive model
It's cheaper currently on many of the inference providers. Personally, I'm having surprisingly good results with DeepSeek 4 Pro at home, which is very good value for money: it's not as good as Claude / GPT 5.6 (I have Co-pilot license at work), but it's still really useful for code reviews, validating thoughts, and especially designing / writing unit tests for new (and old before refactoring) functionality. And it's…
I toggle back and forth between deepseek v 4 flash/pro on FireWorks.ai using OpenCode. Easy to toggle, I default to flash.
Re: Advancing the price-performance frontier with GPT‑5.6
#235Earlier quoted context omitted.
It's cheaper currently on many of the inference providers. Personally, I'm having surprisingly good results with DeepSeek 4 Pro at home, which is very good value for money: it's not as good as Claude / GPT 5.6 (I have Co-pilot license at work), but it's still really useful for code reviews, validating thoughts, and especially designing / writing unit tests for new (and old before refactoring) functionality. And it's…
I tried out deepseek v4 pro via a couple providers from openrouter, and it's always getting 429s. Are you running it on your own hardware?
I wish!!
No, I'm using it via OpenRouter in pi.dev - I just used it 30 mins ago... Providers (automatically selected): StreamLake and Baidu Qianfan.
Re: Advancing the price-performance frontier with GPT‑5.6
#236Deepseek Flash is still much cheaper: - lower input/output token pricing - the cached token price is $0.0028/Million tokens, which is like 50-90% of tokens
DeepSeek Flash is a much worse model. Even DeepSeek Pro is much worse.
Re: Advancing the price-performance frontier with GPT‑5.6
#237> Starting today, GPT‑5.6 Luna, our fastest and most affordable model, will cost 80% less, I don't have the words. I genuinely thought we were in a stage where we were plateauing and going in for 5-10% improvements over months. Seeing spikes like this makes me question about where the floor really is.
Vera Rubin will be hitting racks very soon, and this is purported to have a 10x improvement in token throughput per megawatt. Of course, old chips don't get replaced with new chips overnight, but I don't think we're anywhere near the floor yet.
AMD MI400 series is already shipping to customers (basically everybody) and it is crazy fast (8x to 10x faster than the previous gen and beats published Vera numbers in FP8, loses in FP4) and 432 GB per chip. 72 chip unified rack architecture (Helios) already shipping and projected to also beat Vera in NVL72.
MI500 series is supposedly already taping out and they're claiming massive increases (we'll find out end of 2027 prob).
Re: Advancing the price-performance frontier with GPT‑5.6
#238I generally just check the Price/Performance graph on Openrouter: https://openrouter.ai/rankings#performance#benchmarks . Activate the "Show Pareto" toggle on the right. I was still using GLM-5.2 in my personal projects, but this just made Luna a very easy choice.
Hasn't OpenRouter had Luna and Terra on 50% off sale since they launched? I wonder what will happen to that.
It's still 50% off apparently. Listed as $0.10 for input (original price was $1.0 without this reduction or sale)
Re: Advancing the price-performance frontier with GPT‑5.6
#239Earlier quoted context omitted.
is it? i don't know how we measure these things, but here's one measurement that says v4 pro is better than luna: https://artificialanalysis.ai/models/comparisons/gpt-5-6-lun... presumably it's a much bigger model
This has already been updated with the new prices?
The intelligence scores are absolute, not per $.
DeepSeek Pro is more capable than Luna regardless of the cost.