Live data from Hacker News

$500 GPU outperforms Claude Sonnet on coding benchmarks

github.com

131–140 of 311 posts

Re: $500 GPU outperforms Claude Sonnet on coding benchmarks

#131
post #67

Earlier quoted context omitted.

You cannot afford the SOTA.

Why is that? The $200 per month subscription comes with a ton of usage. Opus 4.6 is available on the $20 plan too

A subscription for coding - no thanks.

Re: $500 GPU outperforms Claude Sonnet on coding benchmarks

#132
post #104

Earlier quoted context omitted.

Opus 4.5 ~= Opus 4.6 high. Opus 4.5 was nerfed just before or after the release of 4.6.

The models don’t change.

I think the conspiracy theories are silly, but equally I think pretending these black boxes are completely stable once they're released is incorrect as well.

Re: $500 GPU outperforms Claude Sonnet on coding benchmarks

#133
post #19

I’d encourage devs to use MiniMax, Kimi, etc for real world tasks that require intelligence. The down sides emerge pretty fast: much higher reasoning token use, slower outputs, and degradation that is palpable. Sadly, you do get what you pay for right now. However that doesn’t prevent you from saving tons through smart model routing, being smart about reasoning budgets, and using max output tokens wisely. And optimiz…

Yup, they do quite poorly on random non-coding tasks: https://aibenchy.com/compare/minimax-minimax-m2-7-medium/moo...

GLM 5 here is significantly better than GPT-5.4

Re: $500 GPU outperforms Claude Sonnet on coding benchmarks

#135

Earlier quoted context omitted.

> The $200 per month subscription comes with a ton of usage. $200 dollars + VAT is half of my rent. I know HN is not a good place to rant on this subject, but I'm often flabbergasted about the number of people here that lives in a bubble with regard to the price of tech. Or just prices in general. I remember someone who said a few years ago (I'm paraphrasing): "You could just use one of the empty room in your house!"…

>I'm often flabbergasted about the number of people here that lives in a bubble with regard to the price of tech Sorry, no. You live in the bubble, the people you think are living in a bubble are actually doing the very opposite and taking advantage of the lack of bubbles in our globally connected world. Today, basically anyone can sell any bullshit to billions of people around the world. We’ve never lived in less of…

I guess all those people who live in not-SF just can't be bothered to succeed!

Re: $500 GPU outperforms Claude Sonnet on coding benchmarks

#137
post #122
post #104

Earlier quoted context omitted.

The models don’t change.

They do. I'm currently seeing a degradation on Opus 4.6 on tasks it could do without trouble a few months back. Obvious I'm a sample of n=1, but I'm also convinced a new model is around the corner and they preemptively nerf their current model so people notice the "improvement".

Make that 2, I told my friends yesterday "Opus got dumb, new model must be coming".

Re: $500 GPU outperforms Claude Sonnet on coding benchmarks

#138

Earlier quoted context omitted.

Why is that? The $200 per month subscription comes with a ton of usage. Opus 4.6 is available on the $20 plan too

> The $200 per month subscription comes with a ton of usage. $200 dollars + VAT is half of my rent. I know HN is not a good place to rant on this subject, but I'm often flabbergasted about the number of people here that lives in a bubble with regard to the price of tech. Or just prices in general. I remember someone who said a few years ago (I'm paraphrasing): "You could just use one of the empty room in your house!"…

For me I pass the token costs off to my clients. Not everyone is a hobbyist burning their own cash on personal projects

Re: $500 GPU outperforms Claude Sonnet on coding benchmarks

#139
post #104

Earlier quoted context omitted.

The models don’t change.

On paper. There's huge financial incentive to quantize the crap out of a good model to save cash after you've hooked in subscriptions.

And there’s an incentive to publish evidence of this to discourage it, do you have any?

Re: $500 GPU outperforms Claude Sonnet on coding benchmarks

#140

Earlier quoted context omitted.

Why is that? The $200 per month subscription comes with a ton of usage. Opus 4.6 is available on the $20 plan too

> The $200 per month subscription comes with a ton of usage. $200 dollars + VAT is half of my rent. I know HN is not a good place to rant on this subject, but I'm often flabbergasted about the number of people here that lives in a bubble with regard to the price of tech. Or just prices in general. I remember someone who said a few years ago (I'm paraphrasing): "You could just use one of the empty room in your house!"…

Work pays.
Post reply on HN