This should make an excellent choice for arbiter in llm-consortium, mercury-2 was pretty good. One of the main drawbacks of the multi-model system is the added latency of the llm judge, but having a model run at 1100tps goes a long a way to alleviate that.
Mercury 2.5
11–20 of 58 posts
Re: Mercury 2.5
#12interesting:
Quality: 40% increase in intelligence from Mercury 2. Comparable to cost-optimized frontier models like GPT-5.6 Luna (Low), Gemini 3.5 Flash-Lite, and Claude Haiku 4.5.
available : https://openrouter.ai/inception/mercury-2.5
Re: Mercury 2.5
#13Anyone here use Mercury 2.0? Curious what your experience with the model is.
Re: Mercury 2.5
#14I like the text output on logical and historical content that I sampled so far
Re: Mercury 2.5
#15They are comparing it to 2 and 3 version old flash/fast versions of models but purely for tok/s. Then only comparing it to Mercury 2 on intelligence. This is very misleading and I suspect this model is basically useless.
Re: Mercury 2.5
#16Anyone here use Mercury 2.0? Curious what your experience with the model is.
I used it for testing my voice agent. It was basically what I expected. Good fast model but "generic" or "vanilla" is how i would describe its personality emulation capability as. Gemma models still outperform it in that department. As far as technicals, one thing i found annoying is cash use was not that good, it missed more then i liked, i contacted support and they were fast and responsive and said they were working on that issue, maybe they solved it with 2.5? Anyways, im prolly gonna try 2.5 again see if anything different, but cant deny the speed, thats the biggest thing this company has going for this offering as if you are in the business of classical cascaded voice agent systems, latency is number one priority and this thing is fast....
Re: Mercury 2.5
#17[deleted]
Re: Mercury 2.5
#18I'd imagine at this point they are likely an acquisition target if they can get a halfway decent model. I can't imagine having diffusion sub-agents (or sub-sub-agents) in an orchestration wouldn't be beneficial.
I'm less bullish, this model and previous are halfway decent and you can do diffusion sub-agents and sub-agent-agents today, and there hasn't been a sea change, or anything noticeable or well-known. Economically, there's ~no moat, diffusion models aren't a mysterious untame-able force.
Re: Mercury 2.5
#19[flagged]
Re: Mercury 2.5
#20I love this it is so fucking fast!