Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Gemini 2.5 Pro vs. Claude 3.7 Sonnet: Coding Comparison

composio.dev

Post reply on HN
Print view View original

141–150 of 336 posts

Re: Gemini 2.5 Pro vs. Claude 3.7 Sonnet: Coding Comparison

#141

Post by throwup238 »

lionkor wrote: post #126
viscanti wrote: post #54

Earlier quoted context omitted.

If it's not astroturfing, the people who are so vocal about it act in a way that's nearly indistinguishable from it. I keep looking for concrete examples of use cases that show it's better, and everything seems to point back to "everyone is talking about it" or anecdotal examples that don't even provide any details about the problem that Gemini did well on and that other models all failed at.

If I give you hundreds millions of dollars for just making a clone of something that exists (an LLM) and hype the shit out of it, how far would you go?

I would change the world™ and make it a better place®.

Re: Gemini 2.5 Pro vs. Claude 3.7 Sonnet: Coding Comparison

#142

Post by [deleted] »

qwertox wrote: post #13

Gemini is the only model which tells me when it's a good time to stop chatting because either it can't find a solution or because it dislikes my solution (when I actively want to neglect security). And the context length is just amazing. When ChatGPT's context is full, it totally forgets what we were chatting about, as if it would start an entirely new chat. Gemini lacks the tooling, there ChatGPT is far ahead, but a…

[deleted]

Re: Gemini 2.5 Pro vs. Claude 3.7 Sonnet: Coding Comparison

#143

Post by amelius »

phkahler wrote: post #55

Here is a real coding problem that I might be willing to make a cash-prize contest for. We'd need to nail down some rules. I'd be shocked if any LLM can do this: https://github.com/solvespace/solvespace/issues/1414 Make a GTK 4 version of Solvespace. We have a single C++ file for each platform - Windows, Mac, and Linux-GTK3. There is also a QT version on an unmerged branch for reference. The GTK3 file is under 2KLOC.…

FWIW, what I want most in Solvespace is a way to do chamfers and fillets.

And a way to define parameters (not sure if that's already possible).

Re: Gemini 2.5 Pro vs. Claude 3.7 Sonnet: Coding Comparison

#144

Post by joshmlewis »

pests wrote: post #91
bratao wrote: post #5

From my use case, the Gemini 2.5 is terrible. I have a complex Cython code in a single file (1500 lines) for a Sequence Labeling. Claude and o3 are very good in improving this code and following the commands. The Gemini always try to do unrelated changes. For example, I asked, separately, for small changes such as remove this unused function, or cache the arrays indexes. Every time it completely refactored the code a…

> The Gemini always try to do unrelated changes. For example, I asked, separately, for small changes such as remove this unused function For anything like this, I don’t understand trying to invoke AI. Just open the file and delete the lines yourself. What is AI going to do here for you? It’s like you are relying 100% on AI when it’s a tool in your toolset.

Playing devils advocate here, it's because removing a function is not always as simple as deleting the lines. Sometimes there are references to that function that you forgot about that the LLM will notice and automatically update for you. Depending on your prompt it will also go find other references outside of the single file and remove those as well. Another possibility is that people are just becoming used to interacting with their codebase through the "chat" interface and directing the LLM to do things so that behavior carries over into all interactions, even perceived "simple" ones.

Re: Gemini 2.5 Pro vs. Claude 3.7 Sonnet: Coding Comparison

#145

Post by jpadkins »

veselin wrote: post #19

I noticed a similar trends in selling on X. Put a claim, peg on some product A with good sales - Cursor, Claude, Gemini, etc. Then say, the best way to use A is with our best product, guide, being MCP or something else. For some of these I see something like 15k followers on X, but then no LinkedIn page for example. Website is always a company you cannot contact and they do everything.

no linkedIn page is a green flag for me.

Re: Gemini 2.5 Pro vs. Claude 3.7 Sonnet: Coding Comparison

#146

Post by HarHarVeryFunny »

kaiokendev wrote: post #131
HarHarVeryFunny wrote: post #119

I'd like to see an honest attempt by someone to use one of these SOTA models to code an entire non-trivial app. Not a "vibe coding" flappy bird clone or minimal ioS app (call API to count calories in photo), but something real - say 10K LOC type of complexity, using best practices to give the AI all the context and guidance necessary. I'm not expecting the AI to replace the programmer - just to be a useful productivi…

I made this NES emulator with Claude last week [0]. I'd say it was a pretty non-trivial task. It involved throwing a lot of NESDev docs, Disch mapper docs, and test rom output + assembly source code to the model to figure out. [0]: https://kaiokendev.github.io/nes/

How would you characterize the overall structural complexity of the project, and degree of novelty compared to other NES emulators Claude may have seen during training ?

I'd be a bit suspect of an LLM getting an emulator right, when all it has to go on is docs and no ability to test (since pass criteria is "behaves same as something you don't have access to")... Did you check to see the degree to which it may have been copying other NES emulators ?

Re: Gemini 2.5 Pro vs. Claude 3.7 Sonnet: Coding Comparison

#147

Post by HarHarVeryFunny »

lordswork wrote: post #140
HarHarVeryFunny wrote: post #119

I'd like to see an honest attempt by someone to use one of these SOTA models to code an entire non-trivial app. Not a "vibe coding" flappy bird clone or minimal ioS app (call API to count calories in photo), but something real - say 10K LOC type of complexity, using best practices to give the AI all the context and guidance necessary. I'm not expecting the AI to replace the programmer - just to be a useful productivi…

I'm at 3k LOC on a current Rust project I'm mostly vibe coding with my very limited free time. Will share when I hit 10k :)

Would you mind sharing what the project is, and which AI you are using? No sign so far of AI's usefulness slowing down as the complexity increases?

Re: Gemini 2.5 Pro vs. Claude 3.7 Sonnet: Coding Comparison

#148

Post by aleph_minus_one »

martin-t wrote: post #138
neal_ wrote: post #29

I was using gemini 2.5 pro yesterday and it does seem decent. I still think claude 3.5 is better at following instruction then the new 3.7 model which just goes ham messing stuff up. Really disappointed by Cursor and the Claude CLI tool, for me they create more problems then fix. I cant figure out how to use them on any of my projects with out them ruining the project and creating terrible tech debt. I really like th…

Whenever I read about LLMs or try to use them, I feel like I am asleep in a dream where two contradicting things can be true at the same time. On one hand, you have people claiming "AI" can now do SWE tasks which take humans 30 minutes or 2 hours and the time doubles every X months so by Y year, SW development will be completely automated. On the other hand, you have people saying exactly what you are saying. Usually…

> Whenever I read about LLMs or try to use them, I feel like I am asleep in a dream where two contradicting things can be true at the same time.

This is called "paraconsistent logic":

* https://en.wikipedia.org/wiki/Paraconsistent_logic

* https://plato.stanford.edu/entries/logic-paraconsistent/

Re: Gemini 2.5 Pro vs. Claude 3.7 Sonnet: Coding Comparison

#149

Post by aleph_minus_one »

kordlessagain wrote: post #122
phkahler wrote: post #55

Here is a real coding problem that I might be willing to make a cash-prize contest for. We'd need to nail down some rules. I'd be shocked if any LLM can do this: https://github.com/solvespace/solvespace/issues/1414 Make a GTK 4 version of Solvespace. We have a single C++ file for each platform - Windows, Mac, and Linux-GTK3. There is also a QT version on an unmerged branch for reference. The GTK3 file is under 2KLOC.…

What’s the point of a one-to-one GTK3 → GTK4 rewrite when the user experience doesn’t improve at all? Why not modularize the backend and build a better UI with tech that’s actually relevant in 2025?

> Why not modularize the backend and build a better UI with tech that’s actually relevant in 2025?

Doing the second part is to my understanding actually the purpose of the stated task.

Re: Gemini 2.5 Pro vs. Claude 3.7 Sonnet: Coding Comparison

#150

Post by thedangler »

I still can't get any LLM to use my niche API and build out API REST requests for all the endpoints. It just makes stuff up even though it knows the api documentation. As soon as one can do that, I'll be sold. until then I feel like its all coding problems its seen in github or source code somewhere.
Post reply on HN