Live data from Hacker News

$500 GPU outperforms Claude Sonnet on coding benchmarks

github.com

61–70 of 311 posts

Re: $500 GPU outperforms Claude Sonnet on coding benchmarks

#61
post #14

Earlier quoted context omitted.

> cheaper than the cost of local electricity only. Can you explain what that means?

I think they mean that the DeepSeek API charges are less than it would cost for the electricity to run a local model. Local model enthusiasts often assume that running locally is more energy efficient than running in a data center, but fail to take the economies of scale into account.

Local enthusiasts don’t have to fear account banning.

Re: $500 GPU outperforms Claude Sonnet on coding benchmarks

#62

I’d encourage devs to use MiniMax, Kimi, etc for real world tasks that require intelligence. The down sides emerge pretty fast: much higher reasoning token use, slower outputs, and degradation that is palpable. Sadly, you do get what you pay for right now. However that doesn’t prevent you from saving tons through smart model routing, being smart about reasoning budgets, and using max output tokens wisely. And optimiz…

Agreed.

They are equivalent of frontier models 8+ months ago.

Re: $500 GPU outperforms Claude Sonnet on coding benchmarks

#63
post #50

Will open source or local llms kill the big AI providers eventually? If so when? I can see maybe basic chat, not sure about coding and images yet

They won't for coding and images, but they will socially. Everyone I know who has invested in home AI use is mostly using it for 'things that might get you banned/limited'.

Re: $500 GPU outperforms Claude Sonnet on coding benchmarks

#64
post #50

Will open source or local llms kill the big AI providers eventually? If so when? I can see maybe basic chat, not sure about coding and images yet

They won't for coding and images, but they will socially. Everyone I know who has invested in home AI use is mostly using it for 'things that might get you banned/limited'.

I'm quite impressed what is possible with just 12 to 16 GB of vram in terms of image generation.

Re: $500 GPU outperforms Claude Sonnet on coding benchmarks

#65

I’d encourage devs to use MiniMax, Kimi, etc for real world tasks that require intelligence. The down sides emerge pretty fast: much higher reasoning token use, slower outputs, and degradation that is palpable. Sadly, you do get what you pay for right now. However that doesn’t prevent you from saving tons through smart model routing, being smart about reasoning budgets, and using max output tokens wisely. And optimiz…

I won’t use anything less than the SOTA. It tried using Opus 4.6 medium and immediately regretted it. High messes up enough.

What were you using 6 months ago?

Re: $500 GPU outperforms Claude Sonnet on coding benchmarks

#66

Earlier quoted context omitted.

I won’t use anything less than the SOTA. It tried using Opus 4.6 medium and immediately regretted it. High messes up enough.

What were you using 6 months ago?

Opus 4.5 ~= Opus 4.6 high. Opus 4.5 was nerfed just before or after the release of 4.6.

Re: $500 GPU outperforms Claude Sonnet on coding benchmarks

#67

I’d encourage devs to use MiniMax, Kimi, etc for real world tasks that require intelligence. The down sides emerge pretty fast: much higher reasoning token use, slower outputs, and degradation that is palpable. Sadly, you do get what you pay for right now. However that doesn’t prevent you from saving tons through smart model routing, being smart about reasoning budgets, and using max output tokens wisely. And optimiz…

I won’t use anything less than the SOTA. It tried using Opus 4.6 medium and immediately regretted it. High messes up enough.

You cannot afford the SOTA.

Re: $500 GPU outperforms Claude Sonnet on coding benchmarks

#68

I’d encourage devs to use MiniMax, Kimi, etc for real world tasks that require intelligence. The down sides emerge pretty fast: much higher reasoning token use, slower outputs, and degradation that is palpable. Sadly, you do get what you pay for right now. However that doesn’t prevent you from saving tons through smart model routing, being smart about reasoning budgets, and using max output tokens wisely. And optimiz…

Minimax 2.7 is fine for most web stuff. It's slightly worse than Claude at backend, but works great for frontend.

They're all slop when the complexity is higher than a mid-tech intermediate engineer though.

Re: $500 GPU outperforms Claude Sonnet on coding benchmarks

#69
post #68

I’d encourage devs to use MiniMax, Kimi, etc for real world tasks that require intelligence. The down sides emerge pretty fast: much higher reasoning token use, slower outputs, and degradation that is palpable. Sadly, you do get what you pay for right now. However that doesn’t prevent you from saving tons through smart model routing, being smart about reasoning budgets, and using max output tokens wisely. And optimiz…

Minimax 2.7 is fine for most web stuff. It's slightly worse than Claude at backend, but works great for frontend. They're all slop when the complexity is higher than a mid-tech intermediate engineer though.

> They're all slop when the complexity is higher than a mid-tech intermediate engineer though.

This right here. Value prop quickly goes out the window when you're building anything novel or hard. I feel that I'm still spending the same amount of time working on stuff, except that now I'm also spending money on models.

Re: $500 GPU outperforms Claude Sonnet on coding benchmarks

#70
post #67

Earlier quoted context omitted.

I won’t use anything less than the SOTA. It tried using Opus 4.6 medium and immediately regretted it. High messes up enough.

You cannot afford the SOTA.

Why is that? The $200 per month subscription comes with a ton of usage.

Opus 4.6 is available on the $20 plan too

Post reply on HN