Improved Gemini 2.5 Flash and Flash-Lite • Hacker News Board

Re: Improved Gemini 2.5 Flash and Flash-Lite

#81

Post by diego_sandoval » Thu, Sep 25, 2025, 6:58 PM UTC

dorianmariecom wrote: post #68

davidmckayv wrote: post #53

This really captures something I've been experiencing with Gemini lately. The models are genuinely capable when they work properly, but there's this persistent truncation issue that makes them unreliable in practice. I've been running into it consistently, responses that just stop mid-sentence, not because of token limits or content filters, but what appears to be a bug in how the model signals completion. It's been…

chatgpt also has lots of reliability issues

If anyone from OpenAI is reading this, I have two complaints:

1. Using the "Projects" thing (Folder organization) makes my browser tab (on Firefox) become unusably slow after a while. I'm basically forced to use the default chats organization, even though I would like to organize my chats in folders.

2. After editing a message that you already sent,you get to select between the different branches of the chat (1/2, and so on), which is cool, but when ChatGPT fails to generate a response in this "branched conversation" context, it will continue failing forever. When your conversation is a single thread and a ChatGPT message fails with an error, re trying usually works and the chat continues normally.

Re: Improved Gemini 2.5 Flash and Flash-Lite

#82

Post by Imustaskforhelp » Thu, Sep 25, 2025, 6:59 PM UTC

fnordsensei wrote: post #54

Imustaskforhelp wrote: post #32

Earlier quoted context omitted.

I think that the Gemini 3 pro might be next month I am not sure. can I get the sources of your rumour please? (Yes I know that I can search it but I would honestly prefer it if you could share it, thanks in advance!)

Next week is next month.

I swear I forgot :sob:

I AM LAUGHING SO HARD RIGHT NOWWWWW

LMAOOOO

I wish to upvote this twice lol

Re: Improved Gemini 2.5 Flash and Flash-Lite

#83

Post by canadiantim » Thu, Sep 25, 2025, 7:00 PM UTC

simonw wrote: post #74

I added support to these models to my llm-gemini plugin, so you can run them like this (using uvx so no need to install anything first): export LLM_GEMINI_KEY='...' uvx --isolated --with llm-gemini llm -m gemini-flash-lite-latest 'An epic poem about frogs at war with ducks' Release notes: https://github.com/simonw/llm-gemini/releases/tag/0.26 Pelicans: https://github.com/simonw/llm-gemini/issues/104#issuecomment...

Who wins in the end? the frogs? the ducks? or the pelicans?

Re: Improved Gemini 2.5 Flash and Flash-Lite

#84

Post by breakingcups » Thu, Sep 25, 2025, 7:02 PM UTC

jjani wrote: post #42

ashwindharne wrote: post #27

Google seems to be the main foundation model provider that's really focusing on the latency/TPS/cost dimensions. Anthropic/OpenAI are really making strides in model intelligence, but underneath some critical threshold of performance, the really long thinking times make workflows feel a lot worse in collaboration-style tools, vs a much snappier but slightly less intelligent model. It's a delicate balance, because thes…

Can't agree with that. Gemini doesn't lead just on price/performance - ironically it's the best "normie" model most of the time, despite it's lack of popularity with them until very recent. It's bad at agentic stuff, especially coding. Incomparably so compared to Claude and now GPT-5. But if it's just about asking it random stuff, and especially going on for very long in the same conversation - which non-tech users h…

My pet theory without any strong foundation is because OpenAI and Anthropic have trained their models really hard to fit the sycophantic mold of:

    ===============================
    Got it — *compliment on the info you've shared*, *informal summary of task*. *Another compliment*, but *downside of question*.
    ----------
    (relevant emoji) Bla bla bla
    1. Aspect 1
    2. Aspect 2
    ----------

    *Actual answer*

    -----------
    (checkmark emoji) *Reassuring you about its answer because:*

    * Summary point 1
    * Summary point 2
    * Summary point 3

    Would you like me to *verb* a ready-made *noun* that will *something that's helpful to you 40% of the time*?
    ===============================

It's gotta reduce the quality of the answers.

Re: Improved Gemini 2.5 Flash and Flash-Lite

#85

Post by jama211 » Thu, Sep 25, 2025, 7:06 PM UTC

newfocogi wrote: post #3

Non-AI Summary: Both models have improved intelligence on Artificial Analysis index with lower end-to-end response time. Also 24% to 50% improved output token efficiency (resulting in lower cost). Gemini 2.5 Flash-Lite improvements include better instruction following, reduced verbosity, stronger multimodal & translation capabilities. Gemini 2.5 Flash improvements include better agentic tool use and more token-effici…

Thank you for this, seems like an iterative improvement.

Re: Improved Gemini 2.5 Flash and Flash-Lite

#86

Post by codazoda » Thu, Sep 25, 2025, 7:06 PM UTC

bre1010 wrote: post #63

gpm wrote: post #60

Earlier quoted context omitted.

"Improving the efficiency" sounds fine to me (a native English speaker), what's wrong with it in your opinion?

You would just say "improving efficiency". Whereas theirs is like: "Improving the efficiency [... of what?]"

You left out words at the front that are important.

“deliver better quality while also improving the efficiency.”

Reads fine to me. An editor would likely drop “the”.

Re: Improved Gemini 2.5 Flash and Flash-Lite

#87

Post by jama211 » Thu, Sep 25, 2025, 7:06 PM UTC

Seems llm progress really is plateauing. I guess that was to be expected.

Re: Improved Gemini 2.5 Flash and Flash-Lite

#88

Post by [deleted] » Thu, Sep 25, 2025, 7:09 PM UTC

zitterbewegung wrote: post #36

Okay this is a nitpick but why wouldn't you increment a part of the version number to signify that there is an improvement? These releases are confusing.

[deleted]

Re: Improved Gemini 2.5 Flash and Flash-Lite

#89

Post by FergusArgyll » Thu, Sep 25, 2025, 7:09 PM UTC

nextos wrote: post #49

mistic92 wrote: post #29

Earlier quoted context omitted.

Price, 2.0 Flash is cheaper than 2.5 Flash but still very good model.

API usage of Flash 2.0 is free, at least till you hit a very generous bound. It's not simply a trial period. You don't even need to register any payment details to get an API key. This might be a reason for its popularity. AFAIK only some Mistral offerings have a similar free tier?

Yeah, that's my use case. When you want to test some program / script that utilizes an llm in the middle and you just want to make sure everything non-llm related is working. It's free! just try again and again till it "compiles" and then switch to 2.5

Re: Improved Gemini 2.5 Flash and Flash-Lite

#90

Post by CuriouslyC » Thu, Sep 25, 2025, 7:11 PM UTC

mips_avatar wrote: post #48

ashwindharne wrote: post #27

Google seems to be the main foundation model provider that's really focusing on the latency/TPS/cost dimensions. Anthropic/OpenAI are really making strides in model intelligence, but underneath some critical threshold of performance, the really long thinking times make workflows feel a lot worse in collaboration-style tools, vs a much snappier but slightly less intelligent model. It's a delicate balance, because thes…

IMO the race for Latency/TPS/cost is entirely between grok and gemini flash. No model can touch them (especially for image to text related tasks), openai/anthropic seem entirely uninterested in competing for this.

grok-4-fast is a phenomenal agentic model, and gemini flash is great for deep research leaf nodes since it's so cheap, you can segment your context a lot more than you would for pro to ensure it surfaces anything that might be valuable.