Viewing profile — samosx

Just merged and released the [Infinity support PR](https://github.com/substratusai/kubeai/pull/197) in KubeAI, adding Infinity as an embedding engine. So you can get embeddings on …

Having a hard time with estimating how much GPU memory that LLM needs to serve it? What kind of GPUs to use and how many? Wrote a blog post to demystify the process of GPU memory u…

Thanks for the feedback! All resources are namespaced right now, except there is an issue the notebook plugin where namespaces are indeed broken: https://github.com/substratusai/su…

Very simple prototype that uses stackoverflow API to get questions and chatGPT to answer them and store the results in postgres or sqlite using Peewee ORM.

OP here. You're right the solution is based on the existing documented full text search solutions. You can technically only sent the data you need indexed and the ID instead of sen…

Feedback welcome, what feature would you want so this tool is helpful for you?