Viewing profile — nabakin

Are you running qwen3.6-27b on one 3090 with your KV cache at q4? Ime there is significant long-context recall accuracy degradation at that precision. I prefer putting the KV cache…

Then you can sandbox

I think they were mistaken or maybe they were just referring to inference because I don't see anyone making that claim and it would be quite the news.

Probably because you said you used DeepSeek. People don't want to see AI in the comments and don't trust AI responses.

Yes, that's the footnote from citation [5].

> Also, note that there's zero CUDA dependency. It runs entirely on Huawei chips. That is a huge claim to make with no evidence. I researched what you said, and I have found no sta…

> When it comes to information transfer and processing, light can do things that electricity can’t. Photons — particles of light — are far zippier than electrons at working their w…

Dunno but there's a PR for it. Probably also more performant than Modular.

If OP meant they have the fastest implementation of Gemma 4 on Blackwell at the moment, I guess that is technically true. I doubt that will hold up when TensorRT-LLM finishes their…

I know Arc AGI 2 has a private test set and they have a good amount of results[0] but it's not a conventional benchmark. Looking around, SWE Rebench seems to have decent protection…

It's easy to game and human evaluation data has its trade-offs, but it's way easier to fake public benchmark results. I wish we had a source of high quality private benchmark resul…

Faster than TensorRT-LLM on Blackwell? Or do you not consider TensorRT-LLM open source because some dependencies are closed source?

It's referring to the Lmsys Leaderboard/Lmarena/Arena.ai[0]. It's very well-known in the LLM community for being one of the few sources of human evaluation data. [0] https://arena.…

Public benchmarks can be trivially faked. Lmarena is a bit harder to fake and is human-evaluated. I agree it's misleading for them to hyper-focus on one metric, but public benchmar…

And nowadays we have Debian running in a VM on Android [1] [1] https://www.zdnet.com/article/how-to-use-the-new-linux-termi...

I would consider it reasonable if this was 4x TTFT and Throughput, but it seems like it's only for TTFT.

And right to repair

Ty this is great

TIL Europe still has some presence in the Americas. Thought all of that was gone with the Monroe Doctrine

Fyi it doesn't look like this post is listed on the frontpage anymore, even with the points it has. Not sure if it's intentional

Ty!

I understand they are similar, but I think this post adds new information to the situation. Regardless, appreciate your help moderating the site.

Oops, that's correct, ty

Google Translate link: https://translate.google.com/translate?tl=en&hl=en&u=https:/... Additional context: https://grapheneos.social/deck/@GrapheneOS/11557599710445618... https://g…