Live data from Hacker News

Ch.at – A lightweight LLM chat service accessible through HTTP, SSH, DNS and API

ch.at

1–10 of 75 posts

Re: Ch.at – A lightweight LLM chat service accessible through HTTP, SSH, DNS and API

#3
I see this is using GPT4o, any plans for something more sustainable? Would be interesting to see an https://openfreemap.org for LLMs.

Perhaps via an RNN like in https://huggingface.co/spaces/BlinkDL/RWKV-Gradio-2

Or even just leverage huggingface gradio spaces? (most are Gradio apps that expose APIs https://www.gradio.app/guides/view-api-page)

Re: Ch.at – A lightweight LLM chat service accessible through HTTP, SSH, DNS and API

#4

I see this is using GPT4o, any plans for something more sustainable? Would be interesting to see an https://openfreemap.org for LLMs. Perhaps via an RNN like in https://huggingface.co/spaces/BlinkDL/RWKV-Gradio-2 Or even just leverage huggingface gradio spaces? (most are Gradio apps that expose APIs https://www.gradio.app/guides/view-api-page )

I wonder if a 1B model could be close to free to host. That's an eventuality, but I wonder how long it'll take for that to be real.

Re: Ch.at – A lightweight LLM chat service accessible through HTTP, SSH, DNS and API

#5
post #4

I see this is using GPT4o, any plans for something more sustainable? Would be interesting to see an https://openfreemap.org for LLMs. Perhaps via an RNN like in https://huggingface.co/spaces/BlinkDL/RWKV-Gradio-2 Or even just leverage huggingface gradio spaces? (most are Gradio apps that expose APIs https://www.gradio.app/guides/view-api-page )

I wonder if a 1B model could be close to free to host. That's an eventuality, but I wonder how long it'll take for that to be real.

A 1B model at 2-bit quantization is about the size of the average web page anymore. With some WebGPU support you could run such a model in a browser.

I'm half joking. Web pages are ludicrously fat these days.

Re: Ch.at – A lightweight LLM chat service accessible through HTTP, SSH, DNS and API

#6

I find the fact that in this day people can own two letter domains absolutely staggering, based on rarity, those should be worth millions I guess?

I mean, ch.at is a incredible domain hack. But not sure it's worth millions. If it was ch.com could get mid six figures and up. But either way absolutely amazing domain.

Re: Ch.at – A lightweight LLM chat service accessible through HTTP, SSH, DNS and API

#7

I find the fact that in this day people can own two letter domains absolutely staggering, based on rarity, those should be worth millions I guess?

There was a time that I owned a one letter domain with a two letter country code.

The cost was about 600 USD and was fun, but problematic as it failed to be accepted as valid email address on many websites.

Post reply on HN