Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Gemini 3.1 Pro

blog.google

Post reply on HN
Print view View original

361–370 of 951 posts

Re: Gemini 3.1 Pro

#361

Post by ukuina »

orbital-decay wrote: post #292
knollimar wrote: post #230

Earlier quoted context omitted.

Is the thinking token stream obfuscated? Im fully immersed

It's just a summary generated by a really tiny model. I guess it also an ad-hoc way to obfuscate it, yes. In particular they're hiding prompt injections they're dynamically adding sometimes. Actual CoT is hidden and entirely different from that summary. It's not very useful for you as a user, though (neither is the summary).

Agree the raw thought-stream is not useful.

It's likely filled with "Aha!" and "But wait!" statements.

Re: Gemini 3.1 Pro

#362

Post by karmasimida »

spankalee wrote: post #199

I hope this works better than 3.0 Pro I'm a former Googler and know some people near the team, so I mildly root for them to at least do well, but Gemini is consistently the most frustrating model I've used for development. It's stunningly good at reasoning, design, and generating the raw code, but it just falls over a lot when actually trying to get things done, especially compared to Claude Opus. Within VS Code Copi…

Gemini just doesn’t do even mildly well in agentic stuff and I don’t know why.

OpenAI has mostly caught up with Claude in agentic stuff, but Google needs to be there and be there quickly

Re: Gemini 3.1 Pro

#363

Post by willis936 »

1024core wrote: post #350
kovek wrote: post #344

Earlier quoted context omitted.

I think that semantically this question is too similar to the car wash one. Changing subjects from car to elephant and car wash to creek does not change the fact that they are subjects. The embeddings will be similar in that dimension.

I understand. But isn't it a sign of "smarts" that one can generalize from analoguous tasks?

Sure it is, but it's a different set of smarts than the kind of gotcha logic puzzle trying to be tested with the car wash question.

Re: Gemini 3.1 Pro

#364

Post by iamdelirium »

merlindru wrote: post #259
WarmWash wrote: post #255

3.1 Pro is the first model to correctly count the number of legs on my "five legged dog" test image. 3.0 flash was the previous best, getting it after a few prompts of poking. 3.1 got it on the first prompt though, with the prompt being "How many legs does the dog have? Count Carefully". However, it didn't get it on the first try with the original prompt (prompt: "How many legs does the dog have?"). It initially said…

your question may have become part of the training data with how much coverage there was around it. perhaps you should devise a new test :P

3.1 Pro has the same Jan 2025 knowledge cutoff as the other 3 series models. So if 3.1 has it in its training data, the other ones would have as well.

Re: Gemini 3.1 Pro

#365

Post by iammattmurphy »

542354234235 wrote: post #245
0_____0 wrote: post #194

Earlier quoted context omitted.

next time you host a party, have people try to draw a bicycle on your whiteboard (you have a whiteboard in your house right? you should, anyway...) human adults are generally quite bad at drawing them, unless they spend a lot of time actually thinking about bicycles as objects

They are, and it is very funny. https://www.behance.net/gallery/35437979/Velocipedia

Fantastic post, thanks for that.

Re: Gemini 3.1 Pro

#367

Post by buttered_toast »

1024core wrote: post #260

It got the car wash question perfectly: You are definitely going to have to drive it there—unless you want to put it in neutral and push! While 200 feet is a very short and easy walk, if you walk over there without your car, you won't have anything to wash once you arrive. The car needs to make the trip with you so it can get the soap and water. Since it's basically right next door, it'll be the shortest drive of you…

I think we need to reevaluate what purpose these sorts of questions serve and why they're important in regards to judging intelligence.

The model getting it correct or not at any given instance isn't the point, the point is if the model ever gets it wrong we can still assume that it still has some semblance of stochasticity in its output, given that a model is essentially static once it is released.

Additionally, hey don't learn post training (except for in context which I think counts as learning to some degree albeit transient), if hypothetically it answers incorrectly 1 in 50 attempts, and I explain in that 1 failed attempt why it is wrong, it will still be a 1-50 chance it gets it wrong in a new instance.

This differs from humans, say for example I give an average person the "what do you put in a toaster" trick and they fall for it, I can be pretty confident that if I try that trick again 10 years later they will probably not fall for it, you can't really say that for a given model.

Re: Gemini 3.1 Pro

#368

Post by DonHopkins »

sho_hn wrote: post #11
sigmar wrote: post #6

blog post is up- https://blog.google/innovation-and-ai/models-and-research/ge... edit: biggest benchmark changes from 3 pro: arc-agi-2 score went from 31.1% -> 77.1% apex-agents score went from 18.4% -> 33.5%

The touted SVG improvements make me excited for animated pelicans.

How about STL files for 3d printing pelicans!

Re: Gemini 3.1 Pro

#369

Post by DonHopkins »

simonw wrote: post #52

Pretty great pelican: https://simonwillison.net/2026/Feb/19/gemini-31-pro/ - took over 5 minutes though, but I think that's because they're having performance teething problems on launch day.

How about STL files for 3d printing pelicans!

Re: Gemini 3.1 Pro

#370

Post by Der_Einzige »

embedding-shape wrote: post #236
benbreen wrote: post #213

Earlier quoted context omitted.

One underrated thing about the recent frontier models, IMO, is that they are obviating the need for image gen as a standalone thing. Opus 4.6 (and apparently 3.1 Pro as well) doesn't have the ability to generate images but it is so good at making SVG that it basically doesn't matter at this point. And the benefit of SVG is that it can be animated and interactive. I find this fascinating because it literally just happ…

> doesn't have the ability to generate images but it is so good at making SVG that it basically doesn't matter at this point Yeah, since the invention of vector images, suddenly no one cares about raster images anymore. Obviously not true, but that's how your comment reads right now. "Image" is very different from "Image", and one doesn't automagically replace the other.

You have no idea how badly I want to be teleported to the alternative world where VECTOR COMPUTING was the dominant form of computers.

We had high framerate (yes it was variable), bright, beautiful displays in the 1980s with the vectrex.

Post reply on HN