Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: I made a self-hosted ChatGPT UI

github.com

Post reply on HN
Print view View original

1–10 of 54 posts

Re: Show HN: I made a self-hosted ChatGPT UI

#2

Post by neilv »

> Chat with GPT is an open-source, unofficial ChatGPT app with extra features and more ways to customize your experience. It connects ChatGPT with ElevenLabs to give ChatGPT a realistic human voice.

Looks like only GUI aspects of the UI are self-hosted, but that the text and speech aspects of the UI (and the bulk of the computation and IP) are provided by two SaaS services.

Self-hosted (and some degree of open) ML models are what a lot of people might want, so we should probably be careful when saying "self-hosted" right now, to not disappoint people or confuse discussion when talking about what we want.

Re: Show HN: I made a self-hosted ChatGPT UI

#3

Post by whartung »

neilv wrote: post #2

> Chat with GPT is an open-source, unofficial ChatGPT app with extra features and more ways to customize your experience. It connects ChatGPT with ElevenLabs to give ChatGPT a realistic human voice. Looks like only GUI aspects of the UI are self-hosted, but that the text and speech aspects of the UI (and the bulk of the computation and IP) are provided by two SaaS services. Self-hosted (and some degree of open) ML mo…

I honestly am not that familiar with this space. How realistic is it that someone could self-host a ChatGPT instance?

Assuming the model was available, how big are the models and what kind of hardware is necessary to run the instance?

Re: Show HN: I made a self-hosted ChatGPT UI

#4

Post by benatkin »

neilv wrote: post #2

> Chat with GPT is an open-source, unofficial ChatGPT app with extra features and more ways to customize your experience. It connects ChatGPT with ElevenLabs to give ChatGPT a realistic human voice. Looks like only GUI aspects of the UI are self-hosted, but that the text and speech aspects of the UI (and the bulk of the computation and IP) are provided by two SaaS services. Self-hosted (and some degree of open) ML mo…

I think it's within the broad meaning of self-hosting. One thing it means is that there's no random new company that you have to trust with your data.

Re: Show HN: I made a self-hosted ChatGPT UI

#5

Post by corobo »

neilv wrote: post #2

> Chat with GPT is an open-source, unofficial ChatGPT app with extra features and more ways to customize your experience. It connects ChatGPT with ElevenLabs to give ChatGPT a realistic human voice. Looks like only GUI aspects of the UI are self-hosted, but that the text and speech aspects of the UI (and the bulk of the computation and IP) are provided by two SaaS services. Self-hosted (and some degree of open) ML mo…

It says self-hosted ChatGPT UI in the title, was that different when you posted?

Re: Show HN: I made a self-hosted ChatGPT UI

#6

Post by wincy »

whartung wrote: post #3
neilv wrote: post #2

> Chat with GPT is an open-source, unofficial ChatGPT app with extra features and more ways to customize your experience. It connects ChatGPT with ElevenLabs to give ChatGPT a realistic human voice. Looks like only GUI aspects of the UI are self-hosted, but that the text and speech aspects of the UI (and the bulk of the computation and IP) are provided by two SaaS services. Self-hosted (and some degree of open) ML mo…

I honestly am not that familiar with this space. How realistic is it that someone could self-host a ChatGPT instance? Assuming the model was available, how big are the models and what kind of hardware is necessary to run the instance?

I think you’d need 2x A100 GPUs, which is $4.18 an hour on Runpod. If I was super bored I’d probably be willing to drop $50 for 10 hours to mess around with it.

https://www.runpod.io/gpu-instance/pricing

Re: Show HN: I made a self-hosted ChatGPT UI

#7

Post by nirav72 »

neilv wrote: post #2

> Chat with GPT is an open-source, unofficial ChatGPT app with extra features and more ways to customize your experience. It connects ChatGPT with ElevenLabs to give ChatGPT a realistic human voice. Looks like only GUI aspects of the UI are self-hosted, but that the text and speech aspects of the UI (and the bulk of the computation and IP) are provided by two SaaS services. Self-hosted (and some degree of open) ML mo…

Probably should just call it OpenAI/ChatGPT Client.

Re: Show HN: I made a self-hosted ChatGPT UI

#9

Post by prenoob »

What I think i need is something like this, but in bookmarklet form. I click it, it prompt()s me for the prompt and displays the output in a textarea so i can quickly paste it. Thinking of it it should be possible to put the output straight into the clipboard, right? The use case of course would be email/forum communication. The problem is that you have to make a UI to embed the API key into the code, because pasting it into an urlencoded script is bound to be a pain.
Post reply on HN