Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: Any-LLM – Lightweight router to access any LLM Provider

github.com

Post reply on HN
Print view View original

51–60 of 72 posts

Re: Show HN: Any-LLM – Lightweight router to access any LLM Provider

#51

Post by Shark1n4Suit »

piker wrote: post #18

This looks awesome. Why Python? Probably because most of the SDKs are python, but something that could be ported across languages without requiring an interpreter would have been really amazing.

That's the key question. It feels like many of these tools are trying to solve a systems-level problem (cross-language model execution) at the application layer (with a Python library).

A truly universal solution would likely need to exist at a lower level of abstraction, completely decoupling the application's language from the model's runtime. It's a much harder problem to solve there, but it would be a huge step forward.

Re: Show HN: Any-LLM – Lightweight router to access any LLM Provider

#55

Post by bdhcuidbebe »

daveguy wrote: post #54
bdhcuidbebe wrote: post #53

What is mozilla-ai? Seems like reputation parasitism.

It is an official Mozilla Foundation subsidiary. Their website is here: https://www.mozilla.ai/

Interesting. I made my comment after visiting their repo and website. Didnt see a pixel worth of the mozilla brand there, hence my comment.

On a second visit I notice a link to mozilla.org on their footer.

Still doesent ring official by me from being a veteran mozilla user (netscape, mdn, firefox) but ok, thanks for the explanation.

Re: Show HN: Any-LLM – Lightweight router to access any LLM Provider

#56

Post by swyx »

pzo wrote: post #38
swyx wrote: post #15

Earlier quoted context omitted.

portkey as well which is both js and open source https://www.latent.space/p/gateway

why provide link if there is not a single portkey keyword there?

its my interview w portkey folks which has more thoughts on the category

Re: Show HN: Any-LLM – Lightweight router to access any LLM Provider

#57

Post by swyx »

otabdeveloper4 wrote: post #47
swyx wrote: post #29

Earlier quoted context omitted.

can you double click a little bit? many files in professional repos are 1000s of lines. LoC in it self is not a code smell.

LiteLLM is the worst code I have ever read in my life. Quite an accomplishment, lol.

ok still not helpful in giving substantial criticism

Re: Show HN: Any-LLM – Lightweight router to access any LLM Provider

#58

Post by JohnPDickerson »

bdhcuidbebe wrote: post #53

What is mozilla-ai? Seems like reputation parasitism.

Common question, thanks for asking! We’re a public benefit corporation focused on democratizing access to AI tech, on enabling non-AI experts to benefit from and control their own AI tools, and on empowering the open source AI ecosystem. Our majority shareholder is the Mozilla Foundation - the other shareholders being our employees, soon :). As access to knowledge and people shifts due to AI, we’re working to make sure people retain choice, ownership, privacy, and dignity.

We're very small compared to the Mozilla mothership, but moving quickly to support open source AI in any way we can.

Re: Show HN: Any-LLM – Lightweight router to access any LLM Provider

#59

Post by daveguy »

bdhcuidbebe wrote: post #55
daveguy wrote: post #54

Earlier quoted context omitted.

It is an official Mozilla Foundation subsidiary. Their website is here: https://www.mozilla.ai/

Interesting. I made my comment after visiting their repo and website. Didnt see a pixel worth of the mozilla brand there, hence my comment. On a second visit I notice a link to mozilla.org on their footer. Still doesent ring official by me from being a veteran mozilla user (netscape, mdn, firefox) but ok, thanks for the explanation.

I agree it's not very clear. They would do well to mention it somewhere besides the main site footer because it would probably help adoption / community / testing too. That said, any company with a lawyer wouldn't let that stand as a name-squat for long.

Re: Show HN: Any-LLM – Lightweight router to access any LLM Provider

#60

Post by JohnPDickerson »

bdhcuidbebe wrote: post #55
daveguy wrote: post #54

Earlier quoted context omitted.

It is an official Mozilla Foundation subsidiary. Their website is here: https://www.mozilla.ai/

Interesting. I made my comment after visiting their repo and website. Didnt see a pixel worth of the mozilla brand there, hence my comment. On a second visit I notice a link to mozilla.org on their footer. Still doesent ring official by me from being a veteran mozilla user (netscape, mdn, firefox) but ok, thanks for the explanation.

Good feedback. Some of this is intentional - as an independent and growing ~20-person company, we're able to operate more quickly than the larger Mozilla organizations, and we're purposefully distancing ourselves from the associated bureaucracy that comes with any large organization. We are very much in line with the Mozilla ethos around personal ownership, privacy, control, and agency. We're figuring out how to best push on those principles in the world of AI, and appreciate feedback and contributions from the community.
Post reply on HN