Viewing profile — richiejp

Getting any performance improvement over vLLM is just a bonus although the RAM reductions are very nice. The main point is that we find deploying Python based projects to be a pain…

I can only assume you are talking about LocalAI (not vllm.cpp) which is modular and contains adapters for many different AI engines written in various languages. LocalAI's core is …

https://github.com/mudler/LocalAGI

Recently I posted on here my automata implementation: https://news.ycombinator.com/item?id=42401976 It seems like hackers liked it and I got some interesting comments, so I decided…

Yes it does. Even discarding arguments that different rules in the same class are the same automaton and multiple cells are the same automaton, the article includes reversible and …

could you provide a link to the code?

It's definitely under rated that data locality may matter more than time or space complexity. Most software though is doing really dumb stuff on I/O, or just doing work that doesn'…