Interesting to note that this might be the only model with knowledge cut off as recent as 2025 January
Gemini 2.5 Pro has the same knowledge cutoff specified, but in reality on more niche topics it's still limited to ~middle of 2024.
Gemini 2.5 Flash
21–30 of 582 posts
Re: Gemini 2.5 Flash
#22This is cool, but rate limits on all of these preview models are PITA
Agreed, it's not even possible to run an eval dataset. If someone from google see this please at least increase the burst rate limit
Re: Gemini 2.5 Flash
#23Absolutely decimated on metrics by o4-mini, straight out of the gate, and not even that much cheaper on output tokens (o4-mini's thinking can't be turned off IIRC).
It's good to see some actual competition on this price range! A lot of Flash 2.5's edge will depend on how well the dynamic reasoning works. It's also helpful to have _significantly_ lower input token cost for a large context use cases.
Re: Gemini 2.5 Flash
#24Gemini flash models have the least hype, but in my experience in production have the best bang for the buck and multimodal tooling. Google is silently winning the AI race.
Sorry, but no. Gemini isn't the fastest horse, yet.
And it's use within their ecosystem means it isn't geared to the masses outside of their bubble. They are not leading the race but they are a contender.
Re: Gemini 2.5 Flash
#25OpenAI might win the college students but it looks like Google will lock in enterprise.
Is there really lock in with AI models?
I built a product that uses and LLM and I got curious about the quality of the output from different models. It took me a weekend to go from just using OpenAI's API to having Gemini, Claude, and DeepSeek all as options and a lot of that time was research on what model from each provider that I wanted to use.
Re: Gemini 2.5 Flash
#26Interesting to note that this might be the only model with knowledge cut off as recent as 2025 January
Isn't Grok 3 basically real time now?
Re: Gemini 2.5 Flash
#27Gemini flash models have the least hype, but in my experience in production have the best bang for the buck and multimodal tooling. Google is silently winning the AI race.
i have a high volume task i wrote an eval for and was pleasantly surprised at 2.0 flash's cost to value ratio especially compared to gpt4.1-mini/nano
accuracy | input price | output price
Gemini Flash 2.0 Lite: 67% | $0.075 | $0.30
Gemini Flash 2.0: 93% | $0.10 | $0.40
GPT-4.1-mini: 93% | $0.40 | $1.60
GPT-4.1-nano: 43% | $0.10 | $0.40
excited to to try out 2.5 flash
Re: Gemini 2.5 Flash
#28OpenAI might win the college students but it looks like Google will lock in enterprise.
Funny you should say that. Google just announced today that they are giving all college students one year of free Gemini advanced. I wonder how much that will actually move the needle among the youth.
My guess is that they will use it and still call it "ChatGPT"...
Re: Gemini 2.5 Flash
#29Bad day is going on google. First the decleration of illegal monopoly.. and now... Google’s latest innovation: programmable overthinking. With Gemini 2.5 Flash, you too can now set a thinking_budget—because nothing says "state-of-the-art AI" like manually capping how long it’s allowed to reason. Truly the dream: debugging a production outage at 2am wondering if your LLM didn’t answer correctly because you cheaped out…
Google's Gemini 2.5 pro model is incredibly strong, it's en par and at times better than Claude 3.7 in coding performance, being able to ingest entire videos into the context is something I haven seen elsewhere either. Google AI products have been anywhere between bad (Bard) to lackluster (Gemini 1.5), but 2.5 is a contender, in all dimensions. Google is also the only player that owns the entire stack, from research, software , data, compute hardware. I think they were slow to start but they've closed the gap since.
Re: Gemini 2.5 Flash
#30Gemini flash models have the least hype, but in my experience in production have the best bang for the buck and multimodal tooling. Google is silently winning the AI race.
The API is free, and it's great for everyday tasks. So yes there is no better bang for the buck.