Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Gemini-2.5-pro-preview-06-05

deepmind.google

Post reply on HN
Print view View original

111–120 of 237 posts

Re: Gemini-2.5-pro-preview-06-05

#111

Post by tacotime »

93po wrote: post #88
wiradikusuma wrote: post #56

I have two issues with Gemini that I don't experience with Claude: 1. It RENAMES VARIABLE NAMES even in places where I don't tell it to change (I pass them just as context). and 2. Sometimes it's missing closing square brackets. Sure I'm a lazy bum, I call the variable "json" instead of "jsonStringForX", but it's contextual (within a closure or function), and I appreciate the feedback, but it makes reviewing the chan…

i've noticed with ChatGPT is will 100% ignore certain instructions and I wonder if it's just an LLM thing. For example, I can scream and yell in caps at ChatGPT to not use em or en dashes and if anything it makes it use them even more . I've literally never once made it successfully not use them, even when it ignored it the first time, and my follow up is "output the same thing again but NO EM or EN DASHES!" i've not…

I wonder if using the character itself in the directions, instead of the name for the character, might help with this.

Something like, "Forbidden character list: [—, –]" or "Do NOT use the characters '—' or '–' in any of your output"

Re: Gemini-2.5-pro-preview-06-05

#112

Post by qeternity »

chollida1 wrote: post #64

I'd start to worry about OpenAI, from a valuation standpoint. The company has some serious competition now and is arguably no longer the leader. its going to be interesting to see how easily they can raise more money. Their valuation is already in the $300B range. How much larger can it get given their relatively paltry revenue at the moment and increasingly rising costs for hardware and electricity. If the next gene…

> At even a $300B valuation a typical wall street analysts would want to value them at 2x sales which would mean they'd expect OpenAI to have $600B in annual sales to account for this valuation when they go public.

Lmfao where did you get this from? Microsoft has less than half of that revenue, and is valued > 10x than OpenAI.

Revenue is not the metric by which these companies are valued...

Re: Gemini-2.5-pro-preview-06-05

#113

Post by Fergusonb »

abraxas wrote: post #32

I found all the previous Gemini models somewhat inferior even compared to Claude 3.7 Sonnet (and much worse than 4) as my coding assistants. I'm keeping an open mind but also not rushing to try this one until some evaluations roll in. I'm actually baffled that the internet at large seems to be very pumped about Gemini but it's not reflective of my personal experience. Not to be that tinfoil hat guy but I smell at lea…

I think they are fairly interchangeable, In Roo Code, Claude uses the tools better, but I prefer gemini's coding style and brevity (except for comments, it loves to write comments) Sometimes I mix and match if one fails or pursues a path I don't like.

Re: Gemini-2.5-pro-preview-06-05

#115

Post by hobofan »

energy123 wrote: post #35
hobofan wrote: post #30

Earlier quoted context omitted.

That's the older 05-06 preview, not the new one from today.

They knew that. The 82.2 comes from the new benchmarks in the OP not from the aider url. The aider url was supplied for comparison.

Ah, thanks for clearing that up!

Re: Gemini-2.5-pro-preview-06-05

#116

Post by Alifatisk »

johnfn wrote: post #12

Impressive seeing Google notch up another ~25 ELO on lmarena, on top of the previous #1, which was also Gemini! That being said, I'm starting to doubt the leaderboards as an accurate representation of model ability. While I do think Gemini is a good model, having used both Gemini and Claude Opus 4 extensively in the last couple of weeks I think Opus is in another league entirely. I've been dealing with a number of gn…

> after a bit Gemini would spin in circles or actually (I've never seen this before!) give up and say it can't do it

No way, is there any way to see the dialog or recreate this scenario!?

Re: Gemini-2.5-pro-preview-06-05

#118

Post by morgannewman »

dist-epoch wrote: post #45
bachmeier wrote: post #38

Earlier quoted context omitted.

> I'm actually baffled that the internet at large seems to be very pumped about Gemini but it's not reflective of my personal experience. Not to be that tinfoil hat guy but I smell at least a bit of astroturf activity around Gemini. I haven't used Claude, but Gemini has always returned better answers to general questions relative to ChatGPT or Copilot. My impression, which could be wrong, is that Gemini is better in…

You should try Grok then. It's by far the best when searching is required, especially if you enable DeepSearch.

[dead]

Re: Gemini-2.5-pro-preview-06-05

#120

Post by tymonPartyLate »

johnfn wrote: post #12

Impressive seeing Google notch up another ~25 ELO on lmarena, on top of the previous #1, which was also Gemini! That being said, I'm starting to doubt the leaderboards as an accurate representation of model ability. While I do think Gemini is a good model, having used both Gemini and Claude Opus 4 extensively in the last couple of weeks I think Opus is in another league entirely. I've been dealing with a number of gn…

I just realized that Opus 4 is the first model that produced "beautiful" code for me. Code that is simple, easy to read, not polluted with comments, no unnecessary crap, just pretty, clean and functional. I had my first "wow" moment with it in a while. That being said it occasionally does something absolutely stupid. Like completely dumb. And when I ask it "why did you do this stupid thing", it replies "oh yeah, you're right, this is super wrong, here is an actual working, smart solution" (proceeds to create brilliant code)

I do not understand how those machines work.

Post reply on HN