Live data from Hacker News

The mysterious Hy3 LLM is topping OpenRouter Model Rankings by a large margin

minimaxir.com

21–30 of 116 posts

Re: The mysterious Hy3 LLM is topping OpenRouter Model Rankings by a large margin

#21
I’ve tested this model on four of my benchmarks:

https://github.com/lechmazur/buyout_game 10th out 36.

https://github.com/lechmazur/pact/ 14th out 25.

https://github.com/lechmazur/nyt-connections/ 60th out 81.

https://github.com/lechmazur/debate 16th out of 29.

Re: The mysterious Hy3 LLM is topping OpenRouter Model Rankings by a large margin

#22

Earlier quoted context omitted.

Haha does it get bonus points for the extra button, or does it fail because html != SVG?

Any bonus points for the color sre immediately subtracted because the "animate wheels" button leaves the wheels stationary and makes the sun rotate.

I wonder if it is actually animating the wheels as well, but just managed to match up the spin rate to the gap size.

Re: The mysterious Hy3 LLM is topping OpenRouter Model Rankings by a large margin

#23

Earlier quoted context omitted.

Haha does it get bonus points for the extra button, or does it fail because html != SVG?

Any bonus points for the color sre immediately subtracted because the "animate wheels" button leaves the wheels stationary and makes the sun rotate.

Hy3 is a Scandinavian model, and is leaking that out via Norse mythology about Sol being a wheel!

Re: The mysterious Hy3 LLM is topping OpenRouter Model Rankings by a large margin

#24
post #3

So basically, Hy3 is the cheapest decent model on OpenRouter, unless you use DeepSeek as the provider for DeepSeek V4 Flash, in which case DeepSeek's insane caching wins out. (And Hy3 is close-ish on the benchmarks.)

You need to use DeepSeek API directly to gain the extra caching benefits. The DeepSeek provider on OpenRouter is only the 5th-cheapest for V4 Flash, so you have to specify DeepSeek provider when calling OpenRouter. But DeepSeek's API discounts on its models only applies if you call DeepSeek directly. So anyone using OpenRouter to call DeepSeek models is actually losing quite a bit of money.

> The DeepSeek provider on OpenRouter is only the 5th-cheapest for V4 Flash

You might have the default settings on your account, which limit Deepseek as a provider. If you disable that feature you see them on openrouter as well (and they serve it at the same cost as their own API).

Re: The mysterious Hy3 LLM is topping OpenRouter Model Rankings by a large margin

#25
Tried this extensively in OpenCode, never used it once since Gemma 4 came out, got into thought loops and did stupid edits I didn't ask for more often than the local 31b model. One of the worst "frontier" models I've ever tried.

Re: The mysterious Hy3 LLM is topping OpenRouter Model Rankings by a large margin

#26
post #19

For the life of me I will never understand the thought process that leads you to say "we don't really know who developed this LLM but I'm going to feed all of my business's data to it"

> I'm going to feed all of my business's data to it Your business data is probably worthless, even considered harmful for the pretrain corpus. Your interactions and decision making process are most valuable parts of the whole business.

I assure you my business's data is not remotely worthless which is why there are pretty strict laws and regulations about what we can do with it

Re: The mysterious Hy3 LLM is topping OpenRouter Model Rankings by a large margin

#27

Earlier quoted context omitted.

If you are ok with everything being fed into it being stored forever I guess it’s no problem. I don’t see how you trust them if you don’t know them.

Who is "them" here? The developers and the hosts are not the same.

(And either one is a threat vector)

Re: The mysterious Hy3 LLM is topping OpenRouter Model Rankings by a large margin

#28

Earlier quoted context omitted.

Haha does it get bonus points for the extra button, or does it fail because html != SVG?

Any bonus points for the color sre immediately subtracted because the "animate wheels" button leaves the wheels stationary and makes the sun rotate.

That depends on the perspective. If you're on the Sun, the wheels rotate around you.

Re: The mysterious Hy3 LLM is topping OpenRouter Model Rankings by a large margin

#29

Earlier quoted context omitted.

You need to use DeepSeek API directly to gain the extra caching benefits. The DeepSeek provider on OpenRouter is only the 5th-cheapest for V4 Flash, so you have to specify DeepSeek provider when calling OpenRouter. But DeepSeek's API discounts on its models only applies if you call DeepSeek directly. So anyone using OpenRouter to call DeepSeek models is actually losing quite a bit of money.

> The DeepSeek provider on OpenRouter is only the 5th-cheapest for V4 Flash You might have the default settings on your account, which limit Deepseek as a provider. If you disable that feature you see them on openrouter as well (and they serve it at the same cost as their own API).

I just checked my settings and I have everything enabled. https://openrouter.ai/deepseek/deepseek-v4-flash?sort=price (per-1M price) shows DeepSeek provider as #5. https://openrouter.ai/deepseek/deepseek-v4-flash/pricing?sor... (effective price) shows them as #3. The effective price will change your total cost since each provider has a different price for input vs output vs cache, so what's #1 and #5 for one person could be #5 and #1 for somebody else, depending on their workload.

However, I just double checked, and OpenRouter's pricing page for Flash v4 with DeepSeek provider shows a cache hit rate of $0.0028, which is the same as on DeepSeek's official API pricing page ($0.0028), so they do seem to be the same price, (assuming DeepSeek is able to pin your specific OpenRouter requests to the same DeepSeek server). OpenRouter adds 5% to that cost, but still it might be cheaper than the other providers.

Also just found out OpenRouter has a new feature "Response Caching" where they can cache identical requests and return them immediately with no billing. The entire request must be identical, though, not just a prefix, and you have to enable this feature. I don't know who would need to send multiple identical requests, but it's better than nothing?

Post reply on HN