Which model does gemini.goolge.com use when I choose 2.5 flash here?
Improved Gemini 2.5 Flash and Flash-Lite
101–110 of 285 posts
Re: Improved Gemini 2.5 Flash and Flash-Lite
#102I'm not even sure how to evaluate what a "better" LLM is, when I've tried running the exact same model (Qwen3) and prompt and gotten vastly different responses on Qwen Chat vs OpenRouter vs running the model locally.
I can't speak to qwen, but something interesting with Deepseek is that the official API supports almost no parameters, while the vllm hosts on openrouter do. The experience you get with the rehosters is wildly different since you can use samplers.
Re: Improved Gemini 2.5 Flash and Flash-Lite
#103Earlier quoted context omitted.
Yeah, the speed and price are why I use it. I find that any LLM is garbage at writing code unless it gets constant high-entropy feedback (e.g. an MCP tool reporting lint errors, a test, etc.) and the quality of the final code depends a lot more on how well the LLM was guided than the quality of the model. A bad model with good automated tooling and prompts will beat a good model without them, and if your goal is to b…
This is so far off my experience. Grok 4 fast is straight trash, it literally isn’t even close to decent code for what I tried. Meanwhile Sonnet is miles better - but even still, Opus while I guess technically being only slightly better, in practice is so much better that I find it hard to use Sonnet at all.
Not Grok 4, the code variant of Grok. I think it's different - I agree with you Grok 4 kind of sucks.
Re: Improved Gemini 2.5 Flash and Flash-Lite
#104This really captures something I've been experiencing with Gemini lately. The models are genuinely capable when they work properly, but there's this persistent truncation issue that makes them unreliable in practice. I've been running into it consistently, responses that just stop mid-sentence, not because of token limits or content filters, but what appears to be a bug in how the model signals completion. It's been…
The latest comment on that issue is someone saying there's a fix available for you to try.
Re: Improved Gemini 2.5 Flash and Flash-Lite
#105[dead]
Re: Improved Gemini 2.5 Flash and Flash-Lite
#106Earlier quoted context omitted.
My one big problem with OpenRouter is that, as far as I can tell, they don't provide any indication of how many companies are using each model. For all I know there are a couple of enormous whales on there who, should they decide to switch from one model to another, will instantly impact those overall ratings. I'd love to have a bit more transparency about volume so I can tell if that's what is happening or not.
Granted, due to OpenRouter's 5.5% surcharge, any enormous whales have a strong financial incentive to use the provider's API directly. A "weekly active API Keys" faceted by models/app would be a useful data point to measure real-world popularity though.
They kinda have that already, no? https://openrouter.ai/apps?url=https%3A%2F%2Faider.chat%2F
Re: Improved Gemini 2.5 Flash and Flash-Lite
#107Earlier quoted context omitted.
Granted, due to OpenRouter's 5.5% surcharge, any enormous whales have a strong financial incentive to use the provider's API directly. A "weekly active API Keys" faceted by models/app would be a useful data point to measure real-world popularity though.
They kinda have that already, no? https://openrouter.ai/apps?url=https%3A%2F%2Faider.chat%2F
Aggregating by tokens causes the problem simonw mentions in that one poweruser can skew the chart too much.
Re: Improved Gemini 2.5 Flash and Flash-Lite
#108Earlier quoted context omitted.
API usage of Flash 2.0 is free, at least till you hit a very generous bound. It's not simply a trial period. You don't even need to register any payment details to get an API key. This might be a reason for its popularity. AFAIK only some Mistral offerings have a similar free tier?
Yeah, that's my use case. When you want to test some program / script that utilizes an llm in the middle and you just want to make sure everything non-llm related is working. It's free! just try again and again till it "compiles" and then switch to 2.5
wow this would be great for a webapp/site that just needs a basic/performant LLM for some basic tasks.
Re: Improved Gemini 2.5 Flash and Flash-Lite
#109This really captures something I've been experiencing with Gemini lately. The models are genuinely capable when they work properly, but there's this persistent truncation issue that makes them unreliable in practice. I've been running into it consistently, responses that just stop mid-sentence, not because of token limits or content filters, but what appears to be a bug in how the model signals completion. It's been…
Unfortunately Gemini isn't the only culprit here. I've had major problems with ChatGPT reliability myself.
Re: Improved Gemini 2.5 Flash and Flash-Lite
#110Earlier quoted context omitted.
This is so far off my experience. Grok 4 fast is straight trash, it literally isn’t even close to decent code for what I tried. Meanwhile Sonnet is miles better - but even still, Opus while I guess technically being only slightly better, in practice is so much better that I find it hard to use Sonnet at all.
Not Grok 4, the code variant of Grok. I think it's different - I agree with you Grok 4 kind of sucks.
I meant to say code actually my bad, I found it significantly worse.