41–50 of 125 posts
Earlier quoted context omitted.
As long as you're willing to wait up to an hour for your GPU to get scheduled when you do want to use it.
I don’t understand what you’re saying. What’s preventing you from using eg OpenRouter to run a query against Kimi-K2 from whatever provider?
Earlier quoted context omitted.
> As a chatbot, it's the only one that seems to really relish calling you out on mistakes or nonsense, and it doesn't hesitate to be blunt with you. My experience is that Sonnet 4.5 does this a lot as well, but this is more often than not due to a lack of full context, eg accusing the user of not doing X or Y when it just wasn’t told that was already done, and proceeding to apologize. How is Kimi K2 in this regard? I…
> Isn’t “instruction following” the most important thing you’d want out of a model in general, No. And for the same reason that pure "instruction following" in humans is considered a form of protest/sabotage. https://en.wikipedia.org/wiki/Work-to-rule
Everyone should be working-to-rule all the time.
Kimi K2 is a really weird model, just in general. It's not nearly as smart as Opus 4.5 or 5.2-Pro or whatever, but it has a very distinct writing style and also a much more direct "interpersonal" style. As a writer of very-short-form stuff like emails, it's probably the best model available right now. As a chatbot, it's the only one that seems to really relish calling you out on mistakes or nonsense, and it doesn't h…
It's also the only model that consistently nails my favorite AI benchmark: https://clocks.brianmoore.com/
I get tempted to buy a couple of these, but I just feel like the amortization doesn’t make sense yet. Surely in the next few years this will be orders of magnitude cheaper.
Earlier quoted context omitted.
> Isn’t “instruction following” the most important thing you’d want out of a model in general, No. And for the same reason that pure "instruction following" in humans is considered a form of protest/sabotage. https://en.wikipedia.org/wiki/Work-to-rule
I don’t understand the point you’re trying to make. LLMs are not humans. From my perspective, the whole problem with LLMs (at least for writing code) is that it shouldn’t assume anything, follow the instructions faithfully, and ask the user for clarification if there is ambiguity in the request. I find it extremely annoying when the model pushes back / disagrees, instead of asking for clarification. For this reason,…
You'd just be endlessly talking to the chatbots. Humans are really bad at expressing ourselves precisely, which is why we have formal languages that preclude ambiguity.
Earlier quoted context omitted.
I can't help you then. You can find a close analogue in the OSS/CIA Simple Sabotage Field Manual. [1] For that reason, I don't trust Agents (human or ai, secret or overt :-P) who don't push back. [1] https://www.cia.gov/static/5c875f3ec660e092cf893f60b4a288df/... esp. Section 5(11)(b)(14): "Apply all regulations to the last letter." - [as a form of sabotage]
How is asking for clarification before pushing back a bad thing?
Sometimes pushback is appropriate, sometimes clarification. The key thing is that one doesn't just blindly follow instructions; at least that's the thrust of it.
Earlier quoted context omitted.
As long as you're willing to wait up to an hour for your GPU to get scheduled when you do want to use it.
I don’t understand what you’re saying. What’s preventing you from using eg OpenRouter to run a query against Kimi-K2 from whatever provider?
EDIT: Thanks for downvoting what is literally one of the most important reasons for people to use local models. Denying and censoring reality does not prevent the bubble from bursting.
Earlier quoted context omitted.
I don’t think it will ever make sense; you can buy so much cloud based usage for this type of price. From my perspective, the biggest problem is that I am just not going to be using it 24/7. Which means I’m not getting nearly as much value out of it as the cloud based vendors do from their hardware. Last but not least, if I want to run queries against open source models, I prefer to use a provider like Groq or Cerebr…
my issue is once you have it in your workflow I'd be pretty latency sensitive. imagine those record-it-all apps working well. eventually you'd become pretty reliant on it. I don't want to necessarily be at the whims of the cloud
Obviously you’re not going to always inject everything into the context window.
Kimi K2 is a really weird model, just in general. It's not nearly as smart as Opus 4.5 or 5.2-Pro or whatever, but it has a very distinct writing style and also a much more direct "interpersonal" style. As a writer of very-short-form stuff like emails, it's probably the best model available right now. As a chatbot, it's the only one that seems to really relish calling you out on mistakes or nonsense, and it doesn't h…
It's actually based on a deepseek architecture just bigger size experts if I recall correctly.