Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Litelm: LiteLLM Without the Bloat

github.com

Post reply on HN
Print view View original

11–20 of 73 posts

Re: Litelm: LiteLLM Without the Bloat

#11

Post by sv123 »

OutOfHere wrote: post #6
Centigonal wrote: post #4

This is a cool project, and the idea of using LLMs to selectively extract features from open source projects is an interesting concept. The only thing I take issue with is the phrase "LiteLLM Without the Bloat." A lot of the features that have been removed (like cost tracking, streaming, caching) are... kind of the core value proposition of LiteLLM for many of their users.

LiteLLM doesn't quite live up to its name. With all those features, there is nothing "lite" about it. It is essential for a project to live up to its name. Imagine Sqlite adding heavy features from Postgresql, e.g. row-level security.

But imagine Sqlite not supporting joins or window functions... sure they are useful but look how many LOC it adds! Who is the arbiter of what Lite actually means?

Re: Litelm: LiteLLM Without the Bloat

#13

Post by ravenstine »

khalic wrote: post #3

I strongly recommend the authors rewrite the readme by hand. It’s kind of a snif test for how much care someone put into this project.

Really? I mean, yeah, it's probably written by an LLM, but it's hardly the worst that I've seen. Looks way more straight forward than the modern README featuring a ton of badges, emojis, confusing out-of-context screenshots, "trust me bro" installation instructions, vague elevator pitches, "used by netflix, nasa, disney, good morning america, alex jones, the church of scientology", and other verbiage to create the illusion that the author won't immediately get bored and abandon their glorified dissertation piece. They all scream "give me your github stars" whereas this one doesn't. But I still get what you mean when it comes to the particular 'isms.

Re: Litelm: LiteLLM Without the Bloat

#16

Post by datadrivenangel »

OutOfHere wrote: post #6
Centigonal wrote: post #4

This is a cool project, and the idea of using LLMs to selectively extract features from open source projects is an interesting concept. The only thing I take issue with is the phrase "LiteLLM Without the Bloat." A lot of the features that have been removed (like cost tracking, streaming, caching) are... kind of the core value proposition of LiteLLM for many of their users.

LiteLLM doesn't quite live up to its name. With all those features, there is nothing "lite" about it. It is essential for a project to live up to its name. Imagine Sqlite adding heavy features from Postgresql, e.g. row-level security.

LiteLLM's problem isn't really features, it's how bloated all the features are, and specifically how AI maximalist and janky their dev practices are.

Re: Litelm: LiteLLM Without the Bloat

#19

Post by gcgbarbosa »

arjie wrote: post #17

This is a 30 minute project with a frontier LLM. I don’t see why anyone would use anyone else’s router. Techniques are valuable today. Libraries are not.

Actually not. There are so many edge cases. Also these routers are only useful if they have a minimal layer of observability.

Yes, LLMs can do a great job at writing semi-working MVP. Turning it into a usable project still requires a team.

Yeah, maybe for your toy project you can use a LLM written tool.

Also, I am not saying LiteLLM is good either.

Re: Litelm: LiteLLM Without the Bloat

#20

Post by [deleted] »

ravenstine wrote: post #13
khalic wrote: post #3

I strongly recommend the authors rewrite the readme by hand. It’s kind of a snif test for how much care someone put into this project.

Really? I mean, yeah, it's probably written by an LLM, but it's hardly the worst that I've seen. Looks way more straight forward than the modern README featuring a ton of badges, emojis, confusing out-of-context screenshots, "trust me bro" installation instructions, vague elevator pitches, "used by netflix, nasa, disney, good morning america, alex jones, the church of scientology", and other verbiage to create the il…

[deleted]
Post reply on HN