Viewing profile — detente18

1. I think rust is the better long term solution over go. Especially for a gateway. You can see other proxy's (e.g. cloudflare's pingora - https://blog.cloudflare.com/how-we-built-…

this is pretty interesting. nice work!

We built this Dockerfile because we wanted a simple harness server to run our agents and get memory, durable sessions, cron scheduling, and a vault, out of the box.

Update 2 (03/25/2026): - We will be holding a townhall on Friday to review the incident and share next steps ( https://lnkd.in/gsbTdCe7 ) - We can confirm a bad version of Trivy se…

I deleted it, to be safe.

It was the PYPI_PUBLISH token which was in our github project as an env var, that got sent to trivvy. We have deleted all our pypi publishing tokens. Our accounts had 2fa, so it's …

Update: - Impacted versions (v1.82.7, v1.82.8) have been deleted from PyPI - All maintainer accounts have been changed - All keys for github, docker, circle ci, pip have been delet…

LiteLLM maintainer here, this is still an evolving situation, but here's what we know so far: 1. Looks like this originated from the trivvy used in our ci/cd - https://github.com/s…

Should we expect the current API ( https://docs.goodfire.ai/introduction ) to be good for prod or is it for testing only? I see that the sampling API is OpenAI-compatible (nice!). …

I wish you could filter by startup name. Would be curious to know where we (litellm) ended up

Saw you just support claude for now. If your backend code is in Python, happy to add support for other models (OpenAI/Gemini/etc.) via a consistent API interface like LiteLLM - htt…

Was looking at adding this to litellm - https://docs.litellm.ai/docs/providers but the website crashed on me while reviewing the docs. Is this stable yet?

Your changelog is neat - is this custom built or via some embeddable tool?

Interesting - how do you use LiteLLM + OpenRouter here? I would assume they're alternatives

Just saw `from litellm import completion` code Thank you for using litellm + all your issues on our repo! @Ey7NFZ3P0nzAe - litellm maintainer

It's interesting to see how short-lived some of these were (e.g. HumanEval).

Interesting — does your backend server use Python? I couldn't find much about it on your site. It would be great to see this tested with more commercial LLMs (O1 / Amazon Nova, / L…

+1 on the github issues. It's very useful to have this on the litellm docs

nice! thanks for using litellm! - maintainer :)

Hey, are you just looking for litellm - https://github.com/BerriAI/litellm context - i'm the repo maintainer

LiteLLM proxy (100+ LLMs in OpenAI format) is exactly compatible with the OpenAI endpoint. Here's how to call it with the openai sdk: ``` import openai client = openai.OpenAI( api_…

Here's the template I'm using - https://github.com/BerriAI/litellm/blob/5ca8b23e22139a4f49bd... Anything I'm doing incorrectly?

nice - is this using LiteLLM for making the completion calls?