Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Gemini 2.5 Pro vs. Claude 3.7 Sonnet: Coding Comparison

composio.dev

Post reply on HN
Print view View original

51–60 of 336 posts

Re: Gemini 2.5 Pro vs. Claude 3.7 Sonnet: Coding Comparison

#51

Post by tempoponet »

kingkongjaffa wrote: post #9

Is there a less biased discussion? The OP link is a thinly veiled and biased advert for something called composio and really a biased and overly flowery view of Gemini 2.5 pro. Example: “Everyone’s talking about this model on Twitter (X) and YouTube. It’s trending everywhere, like seriously. The first model from Google to receive such fanfare. And it is #1 in the LMArena just like that. But what does this mean? It me…

I don't see it.

Composio is a tool to help integration of LLM tool calling / MCPs. It really helped me streamline setting up some MCPs with Claude desktop.

I don't see how pushing Gemini would help their business beyond encouraging people to play with the latest and greatest models. There's a 1 sentence call-to-action at the end which is pretty tame for a company blog.

The examples don't even require you to use Composio - they're just talking about prompts fed to different models, not even focused on tool calling, MCPs, or the Composio platform.

Re: Gemini 2.5 Pro vs. Claude 3.7 Sonnet: Coding Comparison

#53

Post by arresin »

iammrpayments wrote: post #33

Theo video detected = opinion rejected Also I generally dislike thinking models for coding and prefer faster models, so if you have something easy gemini 2.0 is good

Absolute golden age YouTube brain rot. I had to disable the youtube sidebar with a custom style because just seeing these thumbnails and knowing some stupid schmuck is clicking on them like an ape when they do touchscreen experiments really lowers my mood.

Re: Gemini 2.5 Pro vs. Claude 3.7 Sonnet: Coding Comparison

#54

Post by viscanti »

kingkongjaffa wrote: post #9

Is there a less biased discussion? The OP link is a thinly veiled and biased advert for something called composio and really a biased and overly flowery view of Gemini 2.5 pro. Example: “Everyone’s talking about this model on Twitter (X) and YouTube. It’s trending everywhere, like seriously. The first model from Google to receive such fanfare. And it is #1 in the LMArena just like that. But what does this mean? It me…

If it's not astroturfing, the people who are so vocal about it act in a way that's nearly indistinguishable from it. I keep looking for concrete examples of use cases that show it's better, and everything seems to point back to "everyone is talking about it" or anecdotal examples that don't even provide any details about the problem that Gemini did well on and that other models all failed at.

Re: Gemini 2.5 Pro vs. Claude 3.7 Sonnet: Coding Comparison

#55

Post by phkahler »

Here is a real coding problem that I might be willing to make a cash-prize contest for. We'd need to nail down some rules. I'd be shocked if any LLM can do this:

https://github.com/solvespace/solvespace/issues/1414

Make a GTK 4 version of Solvespace. We have a single C++ file for each platform - Windows, Mac, and Linux-GTK3. There is also a QT version on an unmerged branch for reference. The GTK3 file is under 2KLOC. You do not need to create a new version, just rewrite the GTK3 Linux version to GTK4. You may either ask it to port what's there or create the new one from scratch.

If you want to do this for free to prove how great the AI is, please document the entire session. Heck make a YouTube video of it. The final test is weather I accept the PR or not - and I WANT this ticket done.

I'm not going to hold my breath.

Re: Gemini 2.5 Pro vs. Claude 3.7 Sonnet: Coding Comparison

#56

Post by davedx »

qwertox wrote: post #13

Gemini is the only model which tells me when it's a good time to stop chatting because either it can't find a solution or because it dislikes my solution (when I actively want to neglect security). And the context length is just amazing. When ChatGPT's context is full, it totally forgets what we were chatting about, as if it would start an entirely new chat. Gemini lacks the tooling, there ChatGPT is far ahead, but a…

I'm still using ChatGPT heavily for a lot of my day-to-day, across multiple projects and random real life tasks. I'm interested in giving Claude and Gemini a good at some point; where is Gemini's tooling lacking, generally?

Re: Gemini 2.5 Pro vs. Claude 3.7 Sonnet: Coding Comparison

#57

Post by nonethewiser »

phkahler wrote: post #55

Here is a real coding problem that I might be willing to make a cash-prize contest for. We'd need to nail down some rules. I'd be shocked if any LLM can do this: https://github.com/solvespace/solvespace/issues/1414 Make a GTK 4 version of Solvespace. We have a single C++ file for each platform - Windows, Mac, and Linux-GTK3. There is also a QT version on an unmerged branch for reference. The GTK3 file is under 2KLOC.…

Break it down into smaller problems.

Re: Gemini 2.5 Pro vs. Claude 3.7 Sonnet: Coding Comparison

#59

Post by esafak »

phkahler wrote: post #55

Here is a real coding problem that I might be willing to make a cash-prize contest for. We'd need to nail down some rules. I'd be shocked if any LLM can do this: https://github.com/solvespace/solvespace/issues/1414 Make a GTK 4 version of Solvespace. We have a single C++ file for each platform - Windows, Mac, and Linux-GTK3. There is also a QT version on an unmerged branch for reference. The GTK3 file is under 2KLOC.…

A chance for all those coding assistant companies like Devin to show their mettle!
Post reply on HN