Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Gemini 3 Pro Model Card [pdf]

storage.googleapis.com

Post reply on HN
Print view View original

201–210 of 359 posts

Re: Gemini 3 Pro Model Card [pdf]

#201

Post by remus »

risyachka wrote: post #125
FrequentLurker wrote: post #116

Earlier quoted context omitted.

> Anyone with money can trivially catch up to a state of the art model from six months ago. How come apple is struggling then?

It looks more like a strategic decision tbh. The may want to use 3rd party or just wait for AI to be more stable to see how people actually use it instead of adding slop in the core of their product.

> It looks more like a strategic decision tbh.

Announcing a load of AI features on stage and then failing to deliver them doesn't feel very strategic.

Re: Gemini 3 Pro Model Card [pdf]

#202

Post by Fornax96 »

grodriguez100 wrote: post #173
embedding-shape wrote: post #38

Curiously, this website seems to be blocked in Spain for whatever reason, and the website's certificate is served by `allot.com/emailAddress=info@allot.com` which obviously fails... Anyone happen to know why? Is this website by any change sharing information on safe medical abortions or women's rights, something which has gotten websites blocked here before?

Is it possible to file a complaint with the ISP or directly with Allot ?

That might help.

Re: Gemini 3 Pro Model Card [pdf]

#204

Post by basch »

FrequentLurker wrote: post #116
basch wrote: post #98

Earlier quoted context omitted.

At least at the moment, coming in late seems to matter little. Anyone with money can trivially catch up to a state of the art model from six months ago. And as others have said, late is really a function of spigot, guardrails, branding, and ux, as much as it is being a laggard under the hood.

> Anyone with money can trivially catch up to a state of the art model from six months ago. How come apple is struggling then?

Sit and wait per usual.

Enter late, enter great.

Re: Gemini 3 Pro Model Card [pdf]

#205

Post by basch »

raincole wrote: post #139
basch wrote: post #98

Earlier quoted context omitted.

At least at the moment, coming in late seems to matter little. Anyone with money can trivially catch up to a state of the art model from six months ago. And as others have said, late is really a function of spigot, guardrails, branding, and ux, as much as it is being a laggard under the hood.

Being known as a company that is always six months late than the competitors isn't something to brag about...

I was referring to a new entrant, not perpetual lag

Re: Gemini 3 Pro Model Card [pdf]

#206

Post by machiaweliczny »

Taek wrote: post #193

One benchmark I would really like to see: instruction adherence. For example, the frontier models of early-to-mid 2024 could reliably follow what seemed to be 20-30 instructions. As you gave more instructions than that in your prompt, the LLMs started missing some and your outputs became inconsistent and difficult to control. The latest set of models (2.5 Pro, GPT-5, etc) seem to top out somewhere in the 100 range? T…

20 more IQ would be nuts, 110 ~ top 25%, 130 ~ top 2%, 150 ~ top 0.05%

If you ever played competitive game the difference is insane between these tiers

Re: Gemini 3 Pro Model Card [pdf]

#208

Post by [deleted] »

scrlk wrote: post #23

Benchmarks from page 4 of the model card: | Benchmark | 3 Pro | 2.5 Pro | Sonnet 4.5 | GPT-5.1 | |-----------------------|-----------|---------|------------|-----------| | Humanity's Last Exam | 37.5% | 21.6% | 13.7% | 26.5% | | ARC-AGI-2 | 31.1% | 4.9% | 13.6% | 17.6% | | GPQA Diamond | 91.9% | 86.4% | 83.4% | 88.1% | | AIME 2025 | | | | | | (no tools) | 95.0% | 88.0% | 87.0% | 94.0% | | (code execution) | 100% | -…

[deleted]

Re: Gemini 3 Pro Model Card [pdf]

#209

Post by FrequentLurker »

risyachka wrote: post #125
FrequentLurker wrote: post #116

Earlier quoted context omitted.

> Anyone with money can trivially catch up to a state of the art model from six months ago. How come apple is struggling then?

It looks more like a strategic decision tbh. The may want to use 3rd party or just wait for AI to be more stable to see how people actually use it instead of adding slop in the core of their product.

But apple intelligence is a thing, and they are struggling to deliver on the promises of apple intelligence.
Post reply on HN