Improved Gemini 2.5 Flash and Flash-Lite

#1

Post by meetpateltech » Thu, Sep 25, 2025, 5:20 PM UTC

Improved Gemini 2.5 Flash and Flash-Lite
developers.googleblog.com

Re: Improved Gemini 2.5 Flash and Flash-Lite

#2

Post by scosman » Thu, Sep 25, 2025, 5:45 PM UTC

Ugh. If the model name includes sem_ver version number, increment the version number when making a new release!

Anthropic learned this lesson. Google, Deepseek, Kimi, OpenAI and others keep repeating it. This feels like Gemini_2.5_final_FINAL_FINAL_v2.

Re: Improved Gemini 2.5 Flash and Flash-Lite

#3

Post by newfocogi » Thu, Sep 25, 2025, 5:46 PM UTC

Non-AI Summary:

Both models have improved intelligence on Artificial Analysis index with lower end-to-end response time. Also 24% to 50% improved output token efficiency (resulting in lower cost).

Gemini 2.5 Flash-Lite improvements include better instruction following, reduced verbosity, stronger multimodal & translation capabilities. Gemini 2.5 Flash improvements include better agentic tool use and more token-efficient reasoning.

Model strings: gemini-2.5-flash-lite-preview-09-2025 and gemini-2.5-flash-preview-09-2025

Re: Improved Gemini 2.5 Flash and Flash-Lite

#4

Post by OGEnthusiast » Thu, Sep 25, 2025, 5:47 PM UTC

I'm not even sure how to evaluate what a "better" LLM is, when I've tried running the exact same model (Qwen3) and prompt and gotten vastly different responses on Qwen Chat vs OpenRouter vs running the model locally.

Re: Improved Gemini 2.5 Flash and Flash-Lite

#5

Post by Liwink » Thu, Sep 25, 2025, 5:52 PM UTC

Gemini 2.5 Flash is an impressive model for its price. However, I don't understand why Gemini 2.0 Flash is still popular.

From OpenRouter last week:

* xAI: Grok Code Fast 1: 1.15T

* Anthropic: Claude Sonnet 4: 586B

* Google: Gemini 2.5 Flash: 325B

* Sonoma Sky Alpha: 227B

* Google: Gemini 2.0 Flash: 187B

* DeepSeek: DeepSeek V3.1 (free): 180B

* xAI: Grok 4 Fast (free): 158B

* OpenAI: GPT-4.1 Mini: 157B

* DeepSeek: DeepSeek V3 0324: 142B

Re: Improved Gemini 2.5 Flash and Flash-Lite

#6

Post by 1899-12-30 » Thu, Sep 25, 2025, 5:52 PM UTC

OGEnthusiast wrote: post #4

I'm not even sure how to evaluate what a "better" LLM is, when I've tried running the exact same model (Qwen3) and prompt and gotten vastly different responses on Qwen Chat vs OpenRouter vs running the model locally.

That's a difference in the system prompt, not the model itself.

Re: Improved Gemini 2.5 Flash and Flash-Lite

#7

Post by crazysim » Thu, Sep 25, 2025, 5:53 PM UTC

Liwink wrote: post #5

Gemini 2.5 Flash is an impressive model for its price. However, I don't understand why Gemini 2.0 Flash is still popular. From OpenRouter last week: * xAI: Grok Code Fast 1: 1.15T * Anthropic: Claude Sonnet 4: 586B * Google: Gemini 2.5 Flash: 325B * Sonoma Sky Alpha: 227B * Google: Gemini 2.0 Flash: 187B * DeepSeek: DeepSeek V3.1 (free): 180B * xAI: Grok 4 Fast (free): 158B * OpenAI: GPT-4.1 Mini: 157B * DeepSeek: De…

Maybe the same reason why they kept the name for the 2.5 Flash update.

People are lazy at pointing to the latest name.

Re: Improved Gemini 2.5 Flash and Flash-Lite

#8

Post by koakuma-chan » Thu, Sep 25, 2025, 5:54 PM UTC

Liwink wrote: post #5

Gemini 2.5 Flash is an impressive model for its price. However, I don't understand why Gemini 2.0 Flash is still popular. From OpenRouter last week: * xAI: Grok Code Fast 1: 1.15T * Anthropic: Claude Sonnet 4: 586B * Google: Gemini 2.5 Flash: 325B * Sonoma Sky Alpha: 227B * Google: Gemini 2.0 Flash: 187B * DeepSeek: DeepSeek V3.1 (free): 180B * xAI: Grok 4 Fast (free): 158B * OpenAI: GPT-4.1 Mini: 157B * DeepSeek: De…

Why is Grok so popular

Re: Improved Gemini 2.5 Flash and Flash-Lite

#9

Post by frde_me » Thu, Sep 25, 2025, 5:55 PM UTC

Liwink wrote: post #5

Gemini 2.5 Flash is an impressive model for its price. However, I don't understand why Gemini 2.0 Flash is still popular. From OpenRouter last week: * xAI: Grok Code Fast 1: 1.15T * Anthropic: Claude Sonnet 4: 586B * Google: Gemini 2.5 Flash: 325B * Sonoma Sky Alpha: 227B * Google: Gemini 2.0 Flash: 187B * DeepSeek: DeepSeek V3.1 (free): 180B * xAI: Grok 4 Fast (free): 158B * OpenAI: GPT-4.1 Mini: 157B * DeepSeek: De…

I know we have a lot of workloads at my company on older models no one has bothered to upgrade yet

Re: Improved Gemini 2.5 Flash and Flash-Lite

#10

Post by Mistletoe » Thu, Sep 25, 2025, 5:56 PM UTC

newfocogi wrote: post #3

Non-AI Summary: Both models have improved intelligence on Artificial Analysis index with lower end-to-end response time. Also 24% to 50% improved output token efficiency (resulting in lower cost). Gemini 2.5 Flash-Lite improvements include better instruction following, reduced verbosity, stronger multimodal & translation capabilities. Gemini 2.5 Flash improvements include better agentic tool use and more token-effici…

2.5 Flash is the first time I've felt AI has become truly useful to me. I was #1 AI hater but now find myself going to the Gemini app instead of Google search. It's just better in every way and no ads. The info it provides is usually always right and it feels like I have the whole generalized and accurate knowledge of the internet at my fingertips in the app. It's more intimate, less distractions. Just me and the Gemini app alone talking about kale's ideal germination temperature, instead of a bunch of mommy bloggers, bots, and SEO spam.

Now how long can Google keep this going and cannibalizing how they make money is another question...