Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Gemini 3

blog.google

Post reply on HN
Print view View original

21–30 of 1001 posts

Re: Gemini 3

#21

Post by skerit »

Not the preview crap again. Haven't they tested it enough? When will it be available in Gemini-CLI?

Re: Gemini 3

#22

Post by prodigycorp »

I'm sure this is a very impressive model, but gemini-3-pro-preview is failing spectacularly at my fairly basic python benchmark. In fact, gemini-2.5-pro gets a lot closer (but is still wrong).

For reference: gpt-5.1-thinking passes, gpt-5.1-instant fails, gpt-5-thinking fails, gpt-5-instant fails, sonnet-4.5 passes, opus-4.1 passes (lesser claude models fail).

This is a reminder that benchmarks are meaningless – you should always curate your own out-of-sample benchmarks. A lot of people are going to say "wow, look how much they jumped in x, y, and z benchmark" and start to make some extrapolation about society, and what this means for others. Meanwhile.. I'm still wondering how they're still getting this problem wrong.

edit: I've a lot of good feedback here. I think there are ways I can improve my benchmark.

Re: Gemini 3

#23

Post by csomar »

sd9 wrote: post #4

How long does it typically take after this to become available on https://gemini.google.com/app ? I would like to try the model, wondering if it's worth setting up billing or waiting. At the moment trying to use it in AI Studio (on the Free tier) just gives me "Failed to generate content, quota exceeded: you have reached the limit of requests today for this model. Please try again tomorrow."

It's already available. I asked it "how smart are you really?" and it gave me the same ai garbage template that's now very common on blog posts: https://gist.githubusercontent.com/omarabid/a7e564f09401a64e...

Re: Gemini 3

#25

Post by CjHuber »

Interesting that they added an option to select your own API key right in AI studio‘s input field. I sincerely hope the times of generous free AIstudio usage are not over

Re: Gemini 3

#26

Post by mupuff1234 »

hirako2000 wrote: post #18
__jl__ wrote: post #13

API pricing is up to $2/M for input and $12/M for output For comparison: Gemini 2.5 Pro was $1.25/M for input and $10/M for output Gemini 1.5 Pro was $1.25/M for input and $5/M for output

[flagged]

I assume the model is just more expensive to run.

Re: Gemini 3

#27

Post by sd9 »

mpeg wrote: post #14
sd9 wrote: post #4

How long does it typically take after this to become available on https://gemini.google.com/app ? I would like to try the model, wondering if it's worth setting up billing or waiting. At the moment trying to use it in AI Studio (on the Free tier) just gives me "Failed to generate content, quota exceeded: you have reached the limit of requests today for this model. Please try again tomorrow."

Allegedly it's already available in stealth mode if you choose the "canvas" tool and 2.5. I don't know how true that is, but it is indeed pumping out some really impressive one shot code Edit: Now that I have access to Gemini 3 preview, I've compared the results of the same one shot prompts on the gemini app's 2.5 canvas vs 3 AI studio and they're very similar. I think the rumor of a stealth launch might be true.

Thanks for the hint about Canvas/2.5. I have access to 3.0 in AI Studio now, and I agree the results are very similar.

Re: Gemini 3

#28

Post by Thev00d00 »

nickandbro wrote: post #24

What we have all been waiting for: "Create me a SVG of a pelican riding on a bicycle" https://www.svgviewer.dev/s/FfhmhTK1

That is pretty impressive.

So impressive it makes you wonder if someone has noticed it being used a benchmark prompt.

Post reply on HN