Litelm: LiteLLM Without the Bloat

Post by tway235 » Sat, Sep 12, 2026, 1:58 AM UTC

Post by nperez » Sat, Sep 12, 2026, 3:06 AM UTC

Post by [deleted] » Sat, Sep 12, 2026, 4:15 AM UTC

yujonglee wrote: post #33

datadrivenangel wrote: post #16

Earlier quoted context omitted.

LiteLLM's problem isn't really features, it's how bloated all the features are, and specifically how AI maximalist and janky their dev practices are.

thanks for the feedback. genuinely curious what you think we could be doing better, especially around our dev practices. Would love to hear specifics.

Post by nylonstrung » Sat, Sep 12, 2026, 7:17 AM UTC

Centigonal wrote: post #4

This is a cool project, and the idea of using LLMs to selectively extract features from open source projects is an interesting concept. The only thing I take issue with is the phrase "LiteLLM Without the Bloat." A lot of the features that have been removed (like cost tracking, streaming, caching) are... kind of the core value proposition of LiteLLM for many of their users.

Post by znpy » Sat, Sep 12, 2026, 7:58 AM UTC

nylonstrung wrote: post #47

Centigonal wrote: post #4

This is a cool project, and the idea of using LLMs to selectively extract features from open source projects is an interesting concept. The only thing I take issue with is the phrase "LiteLLM Without the Bloat." A lot of the features that have been removed (like cost tracking, streaming, caching) are... kind of the core value proposition of LiteLLM for many of their users.

IIRC it's 700mb with all deps included, to me that's clear bloat given you could accomplish it with a fraction of that