71–80 of 125 posts
Earlier quoted context omitted.
Careful with that benchmark. It's LLMs grading other LLMs.
Well if lmsys showed anything, it's that human judges are measurably worse. Then you have your run of the mill multiple choice tests that grade models on unrealistic single token outputs. What does that leave us with?
I get tempted to buy a couple of these, but I just feel like the amortization doesn’t make sense yet. Surely in the next few years this will be orders of magnitude cheaper.
Before committing to purchasing two of these, you should look at the true speeds that few people post. Not just the "it works". We're at a point where we can run these very large models "at home", and it is great! But true usage is now with very large contexts, both in prompt processing, and token generations. Whatever speeds these models get at "0" context is very different than what they get at "useful" context, es…
Kimi K2 is a really weird model, just in general. It's not nearly as smart as Opus 4.5 or 5.2-Pro or whatever, but it has a very distinct writing style and also a much more direct "interpersonal" style. As a writer of very-short-form stuff like emails, it's probably the best model available right now. As a chatbot, it's the only one that seems to really relish calling you out on mistakes or nonsense, and it doesn't h…
In their AMA moonshot said it was mainly finetuning
Kimi K2 is a really weird model, just in general. It's not nearly as smart as Opus 4.5 or 5.2-Pro or whatever, but it has a very distinct writing style and also a much more direct "interpersonal" style. As a writer of very-short-form stuff like emails, it's probably the best model available right now. As a chatbot, it's the only one that seems to really relish calling you out on mistakes or nonsense, and it doesn't h…
Kimi K2 is a really weird model, just in general. It's not nearly as smart as Opus 4.5 or 5.2-Pro or whatever, but it has a very distinct writing style and also a much more direct "interpersonal" style. As a writer of very-short-form stuff like emails, it's probably the best model available right now. As a chatbot, it's the only one that seems to really relish calling you out on mistakes or nonsense, and it doesn't h…
> I get the feeling that it was trained very differently from the other models It's actually based on a deepseek architecture just bigger size experts if I recall correctly.
Earlier quoted context omitted.
I think you’re missing the whole point, which is not using cloud compute.
Because of privacy reasons? Yeah I’m not going to spend a small fortune for that to be able to use these types of models.
Kimi K2 is a very impressive model! It's particularly un-obsequious, which makes it useful for actually checking your reasoning on things. Some especially older ChatGPT models will tell you that everything you say is fantastic and great. Kimi -on the other hand- doesn't mind taking a detour to question your intelligence and likely your entire ancestry if you ask it to be brutal.
Earlier quoted context omitted.
Autonomy generally, not just privacy. You never know what the future will bring, AI will be enshittified and so will hubs like huggingface. It’s useful to have an off grid solution that isn’t subject to VCs wanting to see their capital returned.
> You never know what the future will bring, AI will be enshittified and so will hubs like huggingface. If anyone wants to bet that future cloud hosted AI models will get worse than they are now, I will take the opposite side of that bet. > It’s useful to have an off grid solution that isn’t subject to VCs wanting to see their capital returned. You can pay cloud providers for access to the same models that you can ru…
OK. How do we set up this wager?
I'm not knowledgeable about online gambling or prediction markets, but further enshittification seems like the world's safest bet.
Earlier quoted context omitted.
How do you feel K2 Thinking compares to Opus 4.5 and 5.2-Pro?
? The user directly addresses this.