Viewing profile — snakepit

Still have to update it for snakepit 0.11.0, but I did start a vLLM wrapper for Elixir https://hex.pm/packages/vllm

This is helpful. Someone should create a similar benchmark for the BEAM. This is also a good reminder to continue working on snakepit [1] and snakebridge [2]. Plenty remains before…

This doesn't reflect the current reality. Tech companies acquire questionable third-party data without consent and exploit it however they see fit.

In many ways, we're past the point of no return. So-called ubiquitous technical surveillance is largely the norm, often encroaching by design beyond the boundaries of expected dece…

AI and ML ecosystem in Elixir. Solo mission currently. Early stage. Backlogged. Open to help: contact@nsai.online

Incredibly helpful. This article helped me to identify significant fundamental shortcomings in my first attempt to design an agent/tool arbitration protocol: https://github.com/nsh…

I'm working on an ML platform in Elixir. Orchestrating CPU-intensive Python processes is central to the project, so I created a session based pooler called `snakepit` [1]. The late…