Gemini 2.5 Flash • Hacker News Board

Re: Gemini 2.5 Flash

#41

Post by statements » Thu, Apr 17, 2025, 7:49 PM UTC

arnaudsm wrote: post #6

Gemini flash models have the least hype, but in my experience in production have the best bang for the buck and multimodal tooling. Google is silently winning the AI race.

Absolutely agree. Granted, it is task dependent. But when it comes to classification and attribute extraction, I've been using 2.0 Flash with huge access across massive datasets. It would not be even viable cost wise with other models.

Re: Gemini 2.5 Flash

#42

Post by rfw300 » Thu, Apr 17, 2025, 7:50 PM UTC

ein0p wrote: post #18

Absolutely decimated on metrics by o4-mini, straight out of the gate, and not even that much cheaper on output tokens (o4-mini's thinking can't be turned off IIRC).

o4-mini does look to be a better model, but this is actually a lot cheaper! It's ~7x cheaper for both input and output tokens.

Re: Gemini 2.5 Flash

#43

Post by dcre » Thu, Apr 17, 2025, 7:50 PM UTC

drusepth wrote: post #36

BoredPositron wrote: post #30

Earlier quoted context omitted.

The API is free, and it's great for everyday tasks. So yes there is no better bang for the buck.

Wait, the API is free? I thought you had to use their web interface for it to be free. How do you use the API for free?

You can get an API key and they don't bill you. Free tier rate limits for some models (even decent ones like Gemini 2.0 Flash) are quite high.

https://ai.google.dev/gemini-api/docs/pricing

https://ai.google.dev/gemini-api/docs/rate-limits#free-tier

Re: Gemini 2.5 Flash

#44

Post by [deleted] » Thu, Apr 17, 2025, 7:51 PM UTC

drusepth wrote: post #36

BoredPositron wrote: post #30

Earlier quoted context omitted.

The API is free, and it's great for everyday tasks. So yes there is no better bang for the buck.

Wait, the API is free? I thought you had to use their web interface for it to be free. How do you use the API for free?

[deleted]

Re: Gemini 2.5 Flash

#45

Post by punkpeye » Thu, Apr 17, 2025, 7:52 PM UTC

punkpeye wrote: post #38

Layvier wrote: post #22

Earlier quoted context omitted.

Agreed, it's not even possible to run an eval dataset. If someone from google see this please at least increase the burst rate limit

It is not without rate limits, but we do have elevated limits for our accounts through: https://glama.ai/models/gemini-2.5-flash-preview-04-17 So if you just want to run evals, that should do it. Though the first couple of days after a model comes out are usually pretty rough because everyone try to run their evals.

What I am noticing with every new Gemini model that comes out is that the time to first token (TTFT) is not great. I guess it is because they gradually transfer computer power from old models to new models as the demand increases.

Re: Gemini 2.5 Flash

#46

Post by xnx » Thu, Apr 17, 2025, 7:52 PM UTC

arnaudsm wrote: post #6

Gemini flash models have the least hype, but in my experience in production have the best bang for the buck and multimodal tooling. Google is silently winning the AI race.

Shhhh. You're going to give away the secret weapon!

Re: Gemini 2.5 Flash

#47

Post by xnx » Thu, Apr 17, 2025, 7:53 PM UTC

Workaccount2 wrote: post #28

gundmc wrote: post #19

Earlier quoted context omitted.

Funny you should say that. Google just announced today that they are giving all college students one year of free Gemini advanced. I wonder how much that will actually move the needle among the youth.

My guess is that they will use it and still call it "ChatGPT"...

Chat Gemini Pretrained Transformer

Re: Gemini 2.5 Flash

#48

Post by Tiberium » Thu, Apr 17, 2025, 7:54 PM UTC

brightball wrote: post #26

statements wrote: post #12

Interesting to note that this might be the only model with knowledge cut off as recent as 2025 January

Isn't Grok 3 basically real time now?

That's the web version (which has tools like search plugged in), other models in their official frontends (Gemini on gemini.google.com, GPT/o models on chatgpt.com) are also "real time". But when served over API, most of those models are just static.

Re: Gemini 2.5 Flash

#49

Post by danielbln » Thu, Apr 17, 2025, 7:54 PM UTC

hmaxwell wrote: post #8

I did some testing this morning: Prompt: "can you find any mistakes on my codebase? I put one in there on purpose" + 70,000 tokens of codebase where in one line I have an include for a non-existent file. Claude 3.7 Sonnet (Try 1 - new chat) Claimed it Found a race condition in the api of the admin interface that would be triggered if two admins were to change the room order at the same time. Claude suggested I group…

Those responses are very Claude, to. 3.7 has powered our agentic workflows for weeks, but I've been using almost only Gemini for the last week and feel the output is better generally. It's gotten much better at agentic workflows (using 2.0 in an agent setup was not working well at all) and I prefer its tuning over Clause's, more to the point and less meandering.

Re: Gemini 2.5 Flash

#50

Post by xbmcuser » Thu, Apr 17, 2025, 7:55 PM UTC

For a non programmer like me google is becoming shockingly good. It is giving working code the first time. I was playing around with it asked it to write code to scrape some data of a website to analyse. I was expecting it to write something that would scrape the data and later I would upload the data to it to analyse. But it actually wrote code that scraped and analysed the data. It was basic categorizing and counting of the data but I was not expecting it to do that.