Viewing profile — marcobambini

Developing a programming language from scratch was a project that literally drained every ounce of energy I had for years. Every moment of every day, of every month, was devoted to…

Thanks guys for all the comments, I am going to rewrite the README (without using an LLM)

We are backed by the SQLite author, and we have the right to use the SQLite name. Please do your homework before writing such comments. We used an Elastic license for some projects…

I wrote tons of software, even a programming language by hand https://github.com/marcobambini/gravity . I'm using my skills to orchestrate LLMs and agents, and I can write better c…

It is not yet available, the only way is to download the official Kimi K3 model and then convert it: # 1. preflight: reachable? how big? does it fit? tools/fetch_weights.sh --dest …

We tried to use Metal, but for that specific project it was slower than just using NEON ARM optimizations. It is all documented in the docs.

Right, we trade speed for the ability to run a 2.7T-parameter model while preserving accuracy. It is a first version, and we plan to improve the inference performance.

M5 Pro

Kimi K3 has 2.78 trillion parameters and ships as 1.42 TB of weights. It clearly does not fit in the memory of a laptop. But K3 is a Mixture-of-Experts model. For each token, only …