Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: State of the Art of Coding Models, According to Hacker News Commenters

hnup.date

Post reply on HN
Print view View original

51–60 of 96 posts

Re: Show HN: State of the Art of Coding Models, According to Hacker News Commenters

#51

Post by alxhslm »

Frannky wrote: post #33
Frannky wrote: post #32

I am looking for a good alternative to Claude code + opus that is not codex. I tried switching back to opus 4.6. The attitude of 4.7 is what is more problematic. Difficult to enforce checking stuff before answering, and it suppose he knows better than me and reality. Plus all the latest shenanigans they did. Pretty disgusted I am still using them

I have forgotten to add the tendency of not owing problems and taking care and solve immediately but instead deflecting and saying it shouldn't be done now it's not my responsibility etc Just terrible

100% this! So often it complains failing unit tests are not its fault.

Re: Show HN: State of the Art of Coding Models, According to Hacker News Commenters

#53

Post by rane »

Frannky wrote: post #32

I am looking for a good alternative to Claude code + opus that is not codex. I tried switching back to opus 4.6. The attitude of 4.7 is what is more problematic. Difficult to enforce checking stuff before answering, and it suppose he knows better than me and reality. Plus all the latest shenanigans they did. Pretty disgusted I am still using them

You can use other models in Claude Code

https://github.com/raine/claude-code-proxy

https://api-docs.deepseek.com/quick_start/agent_integrations...

Re: Show HN: State of the Art of Coding Models, According to Hacker News Commenters

#54

Post by chewz »

dgacmu wrote: post #23
jdw64 wrote: post #2

Interpreting these metrics is quite interesting. One thing for sure is that while Claude is currently taking the #1 spot in mentions, it carries a lot of negative sentiment due to API pricing policies and frequent server downtime. On the other hand, the runner-up, GPT-5.5, actually seems to have more positive feedback. Personally, my experience with Codex wasn't as good as with Claude Code (Codex freezes on Windows m…

I had a surprisingly positive experience with Gemini optimizing some mathy MPS code. It did far better than claude. Of course, when I tried it on something else it rewrote every line in the file for no good reason, applied changes directly when I told it just to plan, etc. So maybe it has one strength.

Gemini is actually realy good for code review, critique and other tasks. It just cannot be allowed to code himself.

Re: Show HN: State of the Art of Coding Models, According to Hacker News Commenters

#55

Post by [deleted] »

jdw64 wrote: post #2

Interpreting these metrics is quite interesting. One thing for sure is that while Claude is currently taking the #1 spot in mentions, it carries a lot of negative sentiment due to API pricing policies and frequent server downtime. On the other hand, the runner-up, GPT-5.5, actually seems to have more positive feedback. Personally, my experience with Codex wasn't as good as with Claude Code (Codex freezes on Windows m…

[deleted]

Re: Show HN: State of the Art of Coding Models, According to Hacker News Commenters

#56

Post by itsnewme »

gobdovan wrote: post #20

Before harnesses, I'd fix the methodology/claims. A saner methodology would be to see comments that compare two models, say 'gpt5.5>opus4.7' and infer context ('ctx:frontend', for example). For your current methodology, 'opus 4.6 was very smart, opus4.7 is a disappointing upgrade to 4.6' would make normal aspect-based sentiment analysis consider 4.6 is smarter than 4.6. But considering you have <300 mentions total, p…

[dead]

Re: Show HN: State of the Art of Coding Models, According to Hacker News Commenters

#57

Post by swyx »

> Quota exceeded for quota metric 'Read requests' and limit 'Read requests per minute per user' of service 'sheets.googleapis.com' for consumer 'project_number:849324395320'.

maybe cache this thing my guy you're just doing a bunch of reads

---

constructive suggestions

- you have a pretty cheap process here, and HN exposes historical posts by date. perhaps worth running this back the last 2 years to reconstruct a history of sentiment?

- introduce alternative sorts around the net positive/negative sentiments and absolute positive sentiments, similar to State of JS (https://stateofjs.com) - you'll see the gpt outperformance more

- matching of Opus 4.7 and Opus Latest seems sus?

Re: Show HN: State of the Art of Coding Models, According to Hacker News Commenters

#58

Post by itsnewme »

brooksc wrote: post #13

It'd be interesting to also graph this over time to see how sentiment changes from when a model is released to today.

Sentiment probably shifts a lot between release day and a few weeks in, once people hit real edge cases. Would be interesting to see that curve per model.

Re: Show HN: State of the Art of Coding Models, According to Hacker News Commenters

#59

Post by swyx »

ranger_danger wrote: post #7

Just FYI this article seems to define "start of the art" as "popular", as measured by "total mentions and user sentiment", without any bearing on the technical abilities or actual usage of the model.

and assuming all mentions are coding model mentions just because its on hn
Post reply on HN