121–130 of 146 posts
Earlier quoted context omitted.
I'm not running it locally (it's gigantic!) I'm using the API at https://platform.moonshot.ai
What's the point of using an open source model if you're not self-hosting?
* Maybe you don't want to have your conversations used for training. The providers listed on OpenRouter mention whether they do that or not.
Earlier quoted context omitted.
I'm not running it locally (it's gigantic!) I'm using the API at https://platform.moonshot.ai
What's the point of using an open source model if you're not self-hosting?
Open weights is an equivalent of binary driver blobs everyone hates. "Here is an opaque thing, you have to put it on your computer and trust it, and you can't modify it."
I’ve added the api key support to kimi on my agentic coding: https://github.com/tallesborges/zdx
Earlier quoted context omitted.
> Can you share how you're running it? Not OP, but I've been running it through Kagi [1]. Their AI offering is probably the best-kept secret in the market. [1] https://help.kagi.com/kagi/ai/assistant.html
Doesn't list Kimi 2.5 and seems to be chat-only, not API, correct?
Yes, it is chat only, but that list is out of date - Kimi 2.5 (with or without reasoning) is available, as are ChatGPT 5.2, Gemini 3 Pro (Preview), etc
Earlier quoted context omitted.
Out of curiosity, what kind of specs do you have (GPU / RAM)? I saw the requirements and it's a beyond my budget so I am "stuck" with smaller Qwen coders.
I'm not running it locally (it's gigantic!) I'm using the API at https://platform.moonshot.ai
I'm guessing a 256GB Mac Studio, costing $5-6K, but that wouldn't be an outrageous amount to spend for a professional tool if the model capability justified it.
Earlier quoted context omitted.
What's the point of using an open source model if you're not self-hosting?
Open source models costs are determined only by electricity usage, as anyone can rent a GPU qnd host them Closed source models cost x10 more just because they can A simple example is Claude Opus, which costs ~1/10 if not less in Claude Code that doesn't have that price multiplier
Earlier quoted context omitted.
I'm not running it locally (it's gigantic!) I'm using the API at https://platform.moonshot.ai
It is possible to run locally though ... I saw a video of someone running one of the heavily quantized versions on a Mac Studio, and performing pretty well in terms of speed. I'm guessing a 256GB Mac Studio, costing $5-6K, but that wouldn't be an outrageous amount to spend for a professional tool if the model capability justified it.
> running one of the heavily quantized versions
There is night and day difference in generation quality between even something like 8-bit and "heavily quantized" versions. Why not quantize to 1-bit anyway? Would that qualify as "running the model?" Food for thought. Don't get me wrong: there's plenty of stuff you can actually run on 96 GB Mac studio (let alone on 128/256 GB ones) but 1T-class models are not in that category, unfortunately. Unless you put four of them in a rack or something.
It seems to be priced the same and if it’s being hosted somewhere vs run locally it’s still a worse model, the only advantage would be it is not Anthropic or OpenAI.
It is amazing, but "open source model" means "model I can understand and modify" (= all the training data and processes). Open weights is an equivalent of binary driver blobs everyone hates. "Here is an opaque thing, you have to put it on your computer and trust it, and you can't modify it."