Running Kimi K3 on MI355X at Better Performance per Dollar Than B300
1–10 of 119 posts
Re: Running Kimi K3 on MI355X at Better Performance per Dollar Than B300
#2AI slop
Re: Running Kimi K3 on MI355X at Better Performance per Dollar Than B300
#3This part sounds like AI assisted setting this up and benchmarking it:
>The fix was trivially simple: zero-pad the head count 12→16, run the fast kernel, and extract the real 12 heads from the output.
I've recently used a frontier AI (ChatGPT 5.6 Sol on ultra) to set up a much smaller local model, and the performance optimizations it introduced left the model totally incoherent. (The model just repeats a single character, etc.)
When I see a line like the one I just quoted, it leaves me wondering if the setup is still coherent like a stock install of Kimi K3 on supported hardware.
Did they run any benchmarks on it to see if it is still correct?
Re: Running Kimi K3 on MI355X at Better Performance per Dollar Than B300
#4If you do good work you should at least take the time to review the slop that details that work for slopiness. Otherwise it's hard to take it seriously. Especially the prefill section.
Re: Running Kimi K3 on MI355X at Better Performance per Dollar Than B300
#5AI slop
Yeah I think they at least put some light effort into making it readable though. Obviously slop but not quite as bad as most slop articles.
Re: Running Kimi K3 on MI355X at Better Performance per Dollar Than B300
#6[flagged]
Re: Running Kimi K3 on MI355X at Better Performance per Dollar Than B300
#7Lol, such a lazily written article by wafer.ai
GPUs. 8× MI355X (TP8) B300 (TP8+DCP8)
Decode tok/s per stream 118 tok/s 172 tok/s
Peak aggregate. 952 tok/s 1,568 tok/s
Peak aggregate per GPU 119 tok/s 196 tok/s
On every row the B300 beat the MI355X
The B200 is being forcefully compared against something which is not gonna fit within it's memory in a single node & not much details about multi-node interconnectivity, disagg or not. As expected of a shoddy slop.
The only point it won is of cost per hour is one aggregation website for rentals, the premium a B300 commands against the $3/hr AMD chip which no provider has in abundance. Never bothered to do TCO of owning the hardware either.
Re: Running Kimi K3 on MI355X at Better Performance per Dollar Than B300
#8Re: Running Kimi K3 on MI355X at Better Performance per Dollar Than B300
#9Wafer is making themselves synonymous with slop in the inference space. Exaggerated unfair comparisons in all their results, twitter hype posts with alarm emojis etc.
> $2.50/GPU-hr for the MI355X, $6.00 for the B300, and $4.25 for the B200.
This is not an accurate price comparison for real terms.
Re: Running Kimi K3 on MI355X at Better Performance per Dollar Than B300
#10I wish they wouldn't call them "open source models". They aren't open source. They didn't publish the training data. They didn't publish the tools they used to train the model.
They published the weights. It's an "open weight model", a term that it seems nearly everyone has agreed is appropriate. Why is this company not using it?