Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Gemini 3.1 Pro

blog.google

Post reply on HN
Print view View original

601–610 of 951 posts

Re: Gemini 3.1 Pro

#601

Post by pugio »

nickandbro wrote: post #51

Does well on SVGs outside of "pelican riding on a bicycle" test. Like this prompt: "create a svg of a unicorn playing xbox" https://www.svgviewer.dev/s/NeKACuHj Still some tweaks to the final result, but I am guessing with the ARC-AGI benchmark jumping so much, the model's visual abilities are allowing it to do this well.

Unfortunately it still fails my personal SVG benchmark (educational 2d cross section of the human heart), even after multiple iterations and screenshots feedback. Oh well, back to the (human) drawing board.

Re: Gemini 3.1 Pro

#602

Post by raducu »

spankalee wrote: post #199

I hope this works better than 3.0 Pro I'm a former Googler and know some people near the team, so I mildly root for them to at least do well, but Gemini is consistently the most frustrating model I've used for development. It's stunningly good at reasoning, design, and generating the raw code, but it just falls over a lot when actually trying to get things done, especially compared to Claude Opus. Within VS Code Copi…

> Gemini also frequently gets twisted around, stuck in loops, and unable to make forward progress.

Yes, gemini loops but I've found almost always it's just a matter of interrupting and telling it to continue.

Claude is very good until it tries something 2-3 times, can't figure it out and then tries to trick you by changing your tests instead of your code (if you explicitly tell it not to, maybe it will decide to ask) OR introduce hyper-fine-tuned IFs to fit your tests, EVEN if you tell it NOT to.

Re: Gemini 3.1 Pro

#603

Post by londons_explore »

Decabytes wrote: post #555
sdeiley wrote: post #548

People underrate Google's cost effectiveness so much. Half price of Opus. HALF. Think about ANY other product and what you'd expect from the competition thats half the price. Yet people here act like Gemini is dead weight ____ Update: 3.1 was 40% of the cost to run AA index vs Opus Thinking AND SONNET, beat Opus, and still 30% faster for output speed. https://artificialanalysis.ai/?speed=intelligence-vs-speed&m...

Any tips for working with Gemini through its chat interface? I’ve worked with ChatGPT and Claude and I’ve generally found them pleasant to work with, but everytime I use Gemini the output is straight dookie

make sure you use ai studio (not the vertex one), not the consumer gemini interface. Seems to work better for code there.

Re: Gemini 3.1 Pro

#604

Post by jpcompartir »

spankalee wrote: post #199

I hope this works better than 3.0 Pro I'm a former Googler and know some people near the team, so I mildly root for them to at least do well, but Gemini is consistently the most frustrating model I've used for development. It's stunningly good at reasoning, design, and generating the raw code, but it just falls over a lot when actually trying to get things done, especially compared to Claude Opus. Within VS Code Copi…

Yep, Gemini is virtually unusable compared to Anthropic models. I get it for free with work and use maybe once a week, if that. They really need to fix the instruction following.

Re: Gemini 3.1 Pro

#605

Post by [deleted] »

mclau153 wrote: post #437
nickandbro wrote: post #51

Does well on SVGs outside of "pelican riding on a bicycle" test. Like this prompt: "create a svg of a unicorn playing xbox" https://www.svgviewer.dev/s/NeKACuHj Still some tweaks to the final result, but I am guessing with the ARC-AGI benchmark jumping so much, the model's visual abilities are allowing it to do this well.

can we move on from SVG to 3D models at some point?

[deleted]

Re: Gemini 3.1 Pro

#606

Post by stephen_cagle »

menaerus wrote: post #527
stephen_cagle wrote: post #470

Earlier quoted context omitted.

I also worked at Google (on the original Gemini, when it was still Bard internally) and my experience largely mirrors this. My finding is that Gemini is pretty great for factual information and also it is the only one that I can reliably (even with the video camera) take a picture of a bird and have it tell me what the bird is. But it is just pretty bad as a model to help with development, myself and everyone I know…

I don't know ... as of now I am literally instructing it to solve the chained expression computation problem which incurs a lot of temporary variables, of which some can be elided by the compiler and some cannot. Think linear algebra expressions which yield a lot of intermediate computations for which you don't want to create a temporary. This is production code and not an easy problem. And yet it happily told me wha…

Can't argue with that, I'll move my Bayesian's a little in your direction. With that said, are most other models able to do this? Also, did it write the solution itself or use a library like Eigen?

I have noticed that LLM's seem surprisingly good at translating from one (programming) language to another... I wonder if transforming a generic mathematical expression into an expression template is a similar sort of problem to them? No idea honestly.

Re: Gemini 3.1 Pro

#607

Post by cmrdporcupine »

vidarh wrote: post #508
drbacon wrote: post #484

Earlier quoted context omitted.

I found the Googler!

Nope. The closest I've gotten was rejecting Google recruiters several times. But like everyone else I'm used to Google failing to care about products.

Inside Google we just constantly joked/complained about "old thing is deprecated, new isn't ready yet"

This held for internal APIs, facilities, systems more even than it did for the outside world. Which is terrible.

Re: Gemini 3.1 Pro

#608

Post by ionwake »

karmasimida wrote: post #409
ionwake wrote: post #392

Earlier quoted context omitted.

Can you explain what you mean by its bad at agentic stuff?

Accomplish the task I give to it without fighting me with it. I think this is classic precision/recall issue: the model needs to stay on task, but also infer what user might want but not explicitly stated. Gemini seems particularly bad that recall, where it goes out of bounds

cool thanks for the explanation

Re: Gemini 3.1 Pro

#609

Post by willis936 »

fastball wrote: post #593
sdeiley wrote: post #548

People underrate Google's cost effectiveness so much. Half price of Opus. HALF. Think about ANY other product and what you'd expect from the competition thats half the price. Yet people here act like Gemini is dead weight ____ Update: 3.1 was 40% of the cost to run AA index vs Opus Thinking AND SONNET, beat Opus, and still 30% faster for output speed. https://artificialanalysis.ai/?speed=intelligence-vs-speed&m...

We are not at the moment where price matters. All that matters is performance.

It matters to me. I pay for it and I like using it. I pick my models to keep my spend reigned in.
Post reply on HN