Earlier quoted context omitted.
I wonder if a 1B model could be close to free to host. That's an eventuality, but I wonder how long it'll take for that to be real.
I’m planning to deploy a 1B model, feed it all the documents I’ve ever written, host it on a $149 mini-PC in my bedroom, and enable you to chat with it. I’ve released similar projects before. I’ll drop a post about my plans in the coming days and I’ll build and document it about two weeks later if there’s enough interest. joeldare.com
Ch.at – A lightweight LLM chat service accessible through HTTP, SSH, DNS and API
21–30 of 75 posts
Re: Ch.at – A lightweight LLM chat service accessible through HTTP, SSH, DNS and API
#22Re: Ch.at – A lightweight LLM chat service accessible through HTTP, SSH, DNS and API
#23I find the fact that in this day people can own two letter domains absolutely staggering, based on rarity, those should be worth millions I guess?
They paid about $50k for ch.at. I have a single letter country code domain (3 characters total, x.xx). There are still some single letter country code domains available to register, you could get one for under $1k USD if you want one. Here’s a reseller with a variety: https://1-single-letter-domains.com/ These guys run a bunch of services on x.xx domains: https://o.ee/services/ like c.im, r.nf, p.lu.
Re: Ch.at – A lightweight LLM chat service accessible through HTTP, SSH, DNS and API
#24Re: Ch.at – A lightweight LLM chat service accessible through HTTP, SSH, DNS and API
#25been using it on a plane for the past one month. it's a great way to do some light reading and learning about obscure topics. dig @ch.at "why is gua musang the king of durian" TXT +short
host -t TXT "what is your name?" ch.at
Re: Ch.at – A lightweight LLM chat service accessible through HTTP, SSH, DNS and API
#26Re: Ch.at – A lightweight LLM chat service accessible through HTTP, SSH, DNS and API
#27I find the fact that in this day people can own two letter domains absolutely staggering, based on rarity, those should be worth millions I guess?
They paid about $50k for ch.at. I have a single letter country code domain (3 characters total, x.xx). There are still some single letter country code domains available to register, you could get one for under $1k USD if you want one. Here’s a reseller with a variety: https://1-single-letter-domains.com/ These guys run a bunch of services on x.xx domains: https://o.ee/services/ like c.im, r.nf, p.lu.
Re: Ch.at – A lightweight LLM chat service accessible through HTTP, SSH, DNS and API
#28It seems like the only internet protocols they didn't implement were the ones designed for chat. How could they forget about IRC, XMPP and SIP?
Re: Ch.at – A lightweight LLM chat service accessible through HTTP, SSH, DNS and API
#29It has not been expensive to operate so far. If it ever changes we can think about rate limiting it.
We used GPT4o because it seemed like a decent general default model. Considering adding an openrouter interface to a smorgasbord of additional LLMS.
One day, on a plane with WiFi before paying, I noticed that DNS queries were still allowed and thought it would be nice to chat with an LLM over it.
We are not logging anything but OpenAI must be...
Re: Ch.at – A lightweight LLM chat service accessible through HTTP, SSH, DNS and API
#30I find the fact that in this day people can own two letter domains absolutely staggering, based on rarity, those should be worth millions I guess?
There are still quite a few XX.XX left, but mostly just under obscure cTLDs (unless you are willing to consider IDN/Unicode domains under .ws or similar)