Ch.at – A lightweight LLM chat service accessible through HTTP, SSH, DNS and API • Hacker News Board

Re: Ch.at – A lightweight LLM chat service accessible through HTTP, SSH, DNS and API

#71

Post by MuffinFlavored » Mon, Aug 11, 2025, 3:26 AM UTC

sunnybeetroot wrote: post #52

etaioinshrdlu wrote: post #29

Author here, was a bit surprised to see this here. I thought there needed to be a good zero-JS LLM site for computer people, and we thought it would be fun to add various other protocols. The short domain hack of "ch.at" was exciting because it felt like the natural domain for such a service. It has not been expensive to operate so far. If it ever changes we can think about rate limiting it. We used GPT4o because it…

Do you mind if I know how much you paid for the domain, brilliant find.

.at is Austria TLD, in case anybody was wondering

Re: Ch.at – A lightweight LLM chat service accessible through HTTP, SSH, DNS and API

#72

Post by reverius42 » Mon, Aug 11, 2025, 8:59 AM UTC

giantrobot wrote: post #5

ivape wrote: post #4

Earlier quoted context omitted.

I wonder if a 1B model could be close to free to host. That's an eventuality, but I wonder how long it'll take for that to be real.

A 1B model at 2-bit quantization is about the size of the average web page anymore. With some WebGPU support you could run such a model in a browser. I'm half joking. Web pages are ludicrously fat these days.

Something like this? https://github.com/huggingface/transformers.js-examples/tree...

Re: Ch.at – A lightweight LLM chat service accessible through HTTP, SSH, DNS and API

#73

Post by giantrobot » Mon, Aug 11, 2025, 2:56 PM UTC

reverius42 wrote: post #72

giantrobot wrote: post #5

Earlier quoted context omitted.

A 1B model at 2-bit quantization is about the size of the average web page anymore. With some WebGPU support you could run such a model in a browser. I'm half joking. Web pages are ludicrously fat these days.

Something like this? https://github.com/huggingface/transformers.js-examples/tree...

That was the exact thing I was thinking of but couldn't remember the project name. Thanks!

Re: Ch.at – A lightweight LLM chat service accessible through HTTP, SSH, DNS and API

#74

Post by Khaine » Tue, Aug 12, 2025, 2:27 AM UTC

This is cool. It reminds me of the early internet where there were things like you could watch star wars over telnet[1]

[1] https://cyrillevarin.medium.com/relive-the-star-wars-magic-w...

Re: Ch.at – A lightweight LLM chat service accessible through HTTP, SSH, DNS and API

#75

Post by elationate » Mon, Aug 18, 2025, 8:33 PM UTC

zoobab wrote: post #43

Via email?

I will actually make that literally happen.

Put an issue here: https://github.com/Deep-ai-inc/ch.at/issues

Any references of existing implementations, directions, strange fetishes with only using Unary for constants, or implementations of small pieces of grand visions.. put an issue!