Live data from Hacker News

OpenLLM

github.com

61–70 of 175 posts

Re: OpenLLM

#61

Suppose I’ve written code that calls the OpenAI API. Is there some library that helps me easily switch to a local/other LLM. I.e a library that (ideally) provides the same OpenAI interface for several models, or if not then at least the same interface.

There's the OpenedAI-API extension for text-generation-webui: https://github.com/oobabooga/text-generation-webui/tree/main...

Re: OpenLLM

#62
post #45

Earlier quoted context omitted.

Side question : why are people working on open source project communicating through discord a lot noawadays ? are discord conversations persisted and indexed on search engines ?

Because it's easy, free and it just works. Very few people actually care about indexing the conversations.

[deleted]

Re: OpenLLM

#63
post #45

Earlier quoted context omitted.

Side question : why are people working on open source project communicating through discord a lot noawadays ? are discord conversations persisted and indexed on search engines ?

Because it's easy, free and it just works. Very few people actually care about indexing the conversations.

So all knowledge is lost and questions have to be asked and answered again and again?

Re: OpenLLM

#65
post #63

Earlier quoted context omitted.

Because it's easy, free and it just works. Very few people actually care about indexing the conversations.

So all knowledge is lost and questions have to be asked and answered again and again?

That didn't stop IRC being popular in the 1990s.

There has long been a place in the ecosystem for ephemeral chat. Often alongside non-ephemeral things like written documentation.

Re: OpenLLM

#66

Do we know how LLMs available in OpenLLM and other open source LLMs compare to different versions of GPT models? I know there’s a leaderboard on huggingface: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderb... but it doesn’t contain GPT models.

The GPT4/ChatGPT ones are in the source visible: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderb...

Re: OpenLLM

#68
post #63

Earlier quoted context omitted.

So all knowledge is lost and questions have to be asked and answered again and again?

That didn't stop IRC being popular in the 1990s. There has long been a place in the ecosystem for ephemeral chat. Often alongside non-ephemeral things like written documentation.

Also monks being the only ones who can read and write didn't stop religion to be popular in middle ages.

/s

C'mon

Re: OpenLLM

#69

Suppose I’ve written code that calls the OpenAI API. Is there some library that helps me easily switch to a local/other LLM. I.e a library that (ideally) provides the same OpenAI interface for several models, or if not then at least the same interface.

Langchain offers abstraction across many LLMs, including OpenAI’s.

Re: OpenLLM

#70
post #63

Earlier quoted context omitted.

Because it's easy, free and it just works. Very few people actually care about indexing the conversations.

So all knowledge is lost and questions have to be asked and answered again and again?

Maybe it doesn't matter because this type of knowledge is relevant for current week only?
Post reply on HN