eek! it's a tiny rust LLM proxy in ~1k loc
1–2 of 2 posts
Re: eek! it's a tiny rust LLM proxy in ~1k loc
#2I wrote this while looking for a lightweight version of litellm, and, after much frustration at all the npm projects with huge blankets (quilts, even) of dependencies. Eek! isn't the most comprehensive solution, but it will get you quick access to open models without the need to worry about auditing thousands and thousands of lines of code.