Viewing profile — ij23

LiteLLM maintainer here. Some context on why we are doing this Over the past year we've heard the same thing from our users and community, they want the fastest and litest AI gatew…

We built this library because agent harnesses were too fragmented and we needed a simple abstraction to call multiple coding-agent SDKs. lite-harness has one function - query() imp…

[dead]

Hi all, Ishaan from LiteLLM here (LiteLLM maintainer) The compromised PyPI packages were litellm==1.82.7 and litellm==1.82.8. Those packages have now been removed from PyPI. We hav…

OpenAI's multi-agent framework swarm only supports models from OpenAI. OpenSwarm uses LiteLLM to add support for any LLM AnthropicAI, MistralAI, Ollama, Huggingface, GroqInc, Repli…

Canary is awesome! we use Canary for our doc search at LiteLLM (you can see it here: https://docs.litellm.ai/docs/ ) It's really useful to be able to specify the search space for a…

hi i'm the maintainer of litellm - we persist rate limits, they're written to a DB: https://docs.litellm.ai/docs/proxy/virtual_keys - LiteLLM Proxy IS Exactly Compatible with the O…

I'm the LiteLLM maintainer, can you elaborate what you're looking for us to do here?

Hello Hacker News, Stop relying on benchmarks and easily test LLMs in production. Try it here: https://admin.litellm.ai/ LiteLLM allows you to simplify calling any LLM as a drop in…

[dead]