I did some testing this morning: Prompt: "can you find any mistakes on my codebase? I put one in there on purpose" + 70,000 tokens of codebase where in one line I have an include for a non-existent file. Claude 3.7 Sonnet (Try 1 - new chat) Claimed it Found a race condition in the api of the admin interface that would be triggered if two admins were to change the room order at the same time. Claude suggested I group…
Gemini 2.5 Flash
31–40 of 582 posts
Re: Gemini 2.5 Flash
#32Gemini flash models have the least hype, but in my experience in production have the best bang for the buck and multimodal tooling. Google is silently winning the AI race.
Absolutely. So many use cases for it, and it's so cheap/fast/reliable
Re: Gemini 2.5 Flash
#33OpenAI might win the college students but it looks like Google will lock in enterprise.
Re: Gemini 2.5 Flash
#3450% price increase from Gemini 2.0 Flash. That sounds like a lot, but Flash is still so cheap when compared to other models of this (or lesser) quality. https://developers.googleblog.com/en/start-building-with-gem...
del
Re: Gemini 2.5 Flash
#35Gemini flash models have the least hype, but in my experience in production have the best bang for the buck and multimodal tooling. Google is silently winning the AI race.
Absolutely. So many use cases for it, and it's so cheap/fast/reliable
Not only in benchmarks[0], but in my own production usage.
Re: Gemini 2.5 Flash
#36Gemini flash models have the least hype, but in my experience in production have the best bang for the buck and multimodal tooling. Google is silently winning the AI race.
The API is free, and it's great for everyday tasks. So yes there is no better bang for the buck.
Re: Gemini 2.5 Flash
#37OpenAI might win the college students but it looks like Google will lock in enterprise.
Is there really lock in with AI models? I built a product that uses and LLM and I got curious about the quality of the output from different models. It took me a weekend to go from just using OpenAI's API to having Gemini, Claude, and DeepSeek all as options and a lot of that time was research on what model from each provider that I wanted to use.
It's actually pretty dangerous for the industry to have this much vertical integration. Tech could end up like the car industry.
Re: Gemini 2.5 Flash
#38This is cool, but rate limits on all of these preview models are PITA
Agreed, it's not even possible to run an eval dataset. If someone from google see this please at least increase the burst rate limit
https://glama.ai/models/gemini-2.5-flash-preview-04-17
So if you just want to run evals, that should do it.
Though the first couple of days after a model comes out are usually pretty rough because everyone try to run their evals.
Re: Gemini 2.5 Flash
#39Re: Gemini 2.5 Flash
#40Earlier quoted context omitted.
The API is free, and it's great for everyday tasks. So yes there is no better bang for the buck.
Wait, the API is free? I thought you had to use their web interface for it to be free. How do you use the API for free?