Viewing profile — vforno

Thanks for this benchmark have you used the last commit? We made some changes from mtp int 4 to much more! If you like, leave an issue so we can work on it! Thank you so much!

Yes you can use ./coli chat

Thanks for kind words!

Maybe some from intel can read and we can try? :)

Yes accurate!

Really thanks!!

Thanks We're working on it!

I have a small laptop. If you have more disks available, you could really do some testing. When you have some benchmarks, submit a pull request or issue so we can maybe work on the…

We're working on it right now with a pull request that will also arrive for opencode!

That's possibly a good idea! We can work on it!

Thanks really thanks!

if you like, colibrì always needs to improve so if you have ideas or anything else you are welcome for pull request issues and also benchmarks!

It’s a good question. In theory MPI could distribute experts across nodes. In practice, for small clusters the added network latency usually hurts more than it helps. Better suited…

Really thanks!

No because I have only 32gb of ram too low

Maybe we can see some integration!

Really thanks!!

In the readme you can see benchmark which everyone with different hardware is running Colibrì, and I have to say I've seen great times! I'm always doing more to improve!

I'd love to! Right now I only have a very consumer-grade computer that I've had fun with! We'll see!

What causes problems is the rewriting in this case are only read while writing is the cache! However, I'm working to improve more and more and make some parts lighter!

Antirez is the number one!thanks really thanks!

Thank you so much, it's true! It all started with this spirit!

A few days ago I found myself trying out GLM 5.2 and was really positively impressed. The capabilities and security I was getting from this LLM are similar to those I've gotten fro…