Viewing profile — florianleibert

hi! open sourced a serving config for Kimi K2.6 from 90 tok/s 508 tok/s on 8xMI300X. Same weights / 0 quality loss. Scaling is linear @15.8 tok/s per slot latency is constant. REpo…

For years, the lock-in was dead simple: CUDA. Want top-tier performance? You wrote CUDA. Do that once, and you were all-in on NVIDIA. The ecosystem compounded—libraries, tooling, d…

This is pretty cool.

There is also a tutorial on the Spinnaker website. https://www.spinnaker.io/guides/tutorials/codelabs/dcos-sour...

Here is a tutorial on the easiest way to run Tensorflow: https://dcos.io/blog/2017/tutorial-deep-learning-with-tensor...

Here is another good tutorial - about Tensorflow on DC/OS: https://mesosphere.com/blog/2017/05/11/deep-learning-tensorf...