Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Kimi-K3 on HuggingFace

huggingface.co

Post reply on HN
Print view View original

391–400 of 588 posts

Re: Kimi-K3 on HuggingFace

#391

Post by brailsafe »

AgentMatt wrote: post #325
mdasen wrote: post #309

Earlier quoted context omitted.

That's an unusually low electric rate for the US - way below the lowest state average which is Idaho at 12.4 cents. It's certainly possible that you are getting 7.5 cents including delivery, but I've had friends say that they're "getting 13 cents per kWh" here in Massachusetts, but that's just the supply rate and the delivery is another ~18 cents. There are parts of states like Grant County Washington that have cheap…

They are most likely not based in the US, but converting to USD to make comparison easier.

Specifying USD is indeed often a service usually offered by people born elsewhere for people born elsewhere. Americans seem rarely know about these mysterious places, where bills can come in all sorts of funny sizes and colours. (kind of joking)

Re: Kimi-K3 on HuggingFace

#392

Post by mock-possum »

gorgmah wrote: post #390
dilliwal wrote: post #373

from the license: If the Licensee or any of its affiliates operates a Model as a Service business, and the aggregate revenue of the Licensee and its affiliates exceeds 20 million US dollars (or the equivalent in other currencies) in total over any consecutive 12 months, the Licensee must enter into a separate agreement with Moonshot AI before using the Software or its derivative works for any commercial purpose.

good find! This sounds a bit like what Meta was doing with the earlier Llama models? There is also this paragraph in their licence that is smart marketing-wise: > 3. If the Software (or any derivative works thereof) is used for any of the Licensee's commercial products or services that have more than 100 million monthly active users, or more than 20 million US dollars (or equivalent in other currencies) in monthly re…

Is that even enforceable?

Re: Kimi-K3 on HuggingFace

#393

Post by [deleted] »

AgentMatt wrote: post #325
mdasen wrote: post #309

Earlier quoted context omitted.

That's an unusually low electric rate for the US - way below the lowest state average which is Idaho at 12.4 cents. It's certainly possible that you are getting 7.5 cents including delivery, but I've had friends say that they're "getting 13 cents per kWh" here in Massachusetts, but that's just the supply rate and the delivery is another ~18 cents. There are parts of states like Grant County Washington that have cheap…

They are most likely not based in the US, but converting to USD to make comparison easier.

[deleted]

Re: Kimi-K3 on HuggingFace

#394

Post by hectdev »

pmxi wrote: post #384
hectdev wrote: post #363

Earlier quoted context omitted.

Genuine question, is the reasoning chain different from clicking the status bar under a reply and watching it "think"? Or selecting the "Thinking" transcript view in Claude Code? (both on the desktop app). Seems to me that is very out in the open

That's a summarized and filtered view of the actual reasoning. OpenAI and Anthropic guard the real reasoning closely. Users have never been able to see it and the API returns an encrypted blob instead of legible reasoning.

Got it. Thanks

Re: Kimi-K3 on HuggingFace

#395

Post by [deleted] »

walrus01 wrote: post #128
light_hue_1 wrote: post #124

Earlier quoted context omitted.

As someone who has worked in two industries that are at the maximal end of data sensitivity and privacy this comes across as a tinfoil hat issue not a real business requirement. In such cases we've always found ways to trade dollars for the privacy we need without having to run our own inference at excruciating slow speeds.

Do you mean by trading dollars for the privacy you need as: a) Contracting with a third-party independent inference provider who will run your choice of model on fast hardware that they own, with all appropriate data security/privacy/contractual/compliance protection in place or b) Contracting with the original creators of the model to run inference via their API and with assurances that all the same data protection…

[deleted]

Re: Kimi-K3 on HuggingFace

#396

Post by whimsicalism »

gorgmah wrote: post #390
dilliwal wrote: post #373

from the license: If the Licensee or any of its affiliates operates a Model as a Service business, and the aggregate revenue of the Licensee and its affiliates exceeds 20 million US dollars (or the equivalent in other currencies) in total over any consecutive 12 months, the Licensee must enter into a separate agreement with Moonshot AI before using the Software or its derivative works for any commercial purpose.

good find! This sounds a bit like what Meta was doing with the earlier Llama models? There is also this paragraph in their licence that is smart marketing-wise: > 3. If the Software (or any derivative works thereof) is used for any of the Licensee's commercial products or services that have more than 100 million monthly active users, or more than 20 million US dollars (or equivalent in other currencies) in monthly re…

Meta had much higher limits and not restricted merely to token resellers

Re: Kimi-K3 on HuggingFace

#398

Post by Der_Einzige »

flyinglizard wrote: post #92
flaburgan wrote: post #78

Earlier quoted context omitted.

It all depends if you count the fixed cost of training or not. And the cost of the hardware.

Or even the basis of the cost of hardware. There are lease deals, capacity traded for equity, various programs by Nvidia, there's absolutely massive depreciation, etc.

Depreciation is massively overrated by Micheal Berry and his ilk.

Everyone keeps thinking those A100s only have 6 more months of life, and yet they're still going for more than they did per hour in 2024.

Show me evidence that A100 prices have collapsed, and maybe GPU depreciation will be relevant to the market.

Re: Kimi-K3 on HuggingFace

#399

Post by great_psy »

horsawlarway wrote: post #295
pembrook wrote: post #225

Earlier quoted context omitted.

I see these conspiratorial arguments all the time and I think people massively overestimate the value of the average users tokens. The problems with frontier models (design taste, ability to solve novel/difficult problems, etc) cannot be solved by throwing more slop from the average user at it. Actually, most of the main deficiencies in current models stem from the fact that their data sets aren’t curated and special…

I don't think the goal of this data is necessarily model improvement. I think it's marketing, advertising, and product refinement. Ex: all the things Google wants your search data for. It's somewhat silly to think the value of that data has changed much. Advertisers want to know what's popular and getting clicks and attention. Competitors want to know what features are getting used in their markets. In the simplest c…

I wonder how much less useful it is if I use those models for open code or similar. What are you really learning about me, other than the fact that I am a technical person, which you could know by the fact that I signed up for open router to start with.

Re: Kimi-K3 on HuggingFace

#400

Post by thundergolfer »

sreekanth850 wrote: post #22

how feasible its will be to run on modal or deepinfra? anyone here tried and tested such large models running?

Modal eng here. Getting the model running is quite challenging, but its accessible right now on Modal via Endpoints: https://modal.com/blog/kimi-k3-by-moonshot-now-available-on-...
Post reply on HN