Ask HN: Who else is self-hosting AI and apps at home/office?

#1

Post by jconley » Fri, Feb 07, 2025, 5:01 PM UTC

I've been playing around with this the last couple years, slowly adding to my pile of hardware in the cabinet. Who else? I currently have a Synology NAS, a couple mini-pcs, a gaming rig with GPU.

- Running an ETH node

- Running my own DropBox

- Archiving emails

- Backing up photos

- Dual honed internet w/Starlink

- My own local AI assistant with access to all of it

Who's with me?

Re: Ask HN: Who else is self-hosting AI and apps at home/office?

#2

Post by [deleted] » Fri, Feb 07, 2025, 5:02 PM UTC

[deleted]

Re: Ask HN: Who else is self-hosting AI and apps at home/office?

#3

Post by zoezoezoezoe » Fri, Feb 07, 2025, 5:37 PM UTC

100% I love self-hosting all my services, self-hosting means freedom. I'm using old parts from my PC, email, nextcloud, tor node, game servers, and, yes, even AI stuff with the gpu I threw in there.

Re: Ask HN: Who else is self-hosting AI and apps at home/office?

#4

Post by jconley » Fri, Feb 07, 2025, 5:39 PM UTC

zoezoezoezoe wrote: post #3

100% I love self-hosting all my services, self-hosting means freedom. I'm using old parts from my PC, email, nextcloud, tor node, game servers, and, yes, even AI stuff with the gpu I threw in there.

awesome! how do you do email delivery? i still have to route things through an external service to get that to really work. oh yeah, i gave my son access and he hosts Rust and Minecraft servers.

i'm looking into doing security cam + AI. just canceled my Nest subscription.

Re: Ask HN: Who else is self-hosting AI and apps at home/office?

#5

Post by monomial » Fri, Feb 07, 2025, 6:42 PM UTC

I self-host everything I can. Unfortunately email is a bit tough these days but I should start archiving it locally. What tools are you using for that?

I haven't done much experimenting with local AI models yet - probably need some newer hardware for that to be worthwhile.

Re: Ask HN: Who else is self-hosting AI and apps at home/office?

#6

Post by jconley » Fri, Feb 07, 2025, 7:32 PM UTC

monomial wrote: post #5

I self-host everything I can. Unfortunately email is a bit tough these days but I should start archiving it locally. What tools are you using for that? I haven't done much experimenting with local AI models yet - probably need some newer hardware for that to be worthwhile.

I wrote some code with an IMAP lib. Wasn't too happy with out of the box things.

The smaller Deepseek models are most interesting for self hosting LLM's at the moment. Impressive! Many other ML Things need a lot less compute, though. Like facial recognition, spam filtering, etc.

Re: Ask HN: Who else is self-hosting AI and apps at home/office?

#7

Post by mettamage » Sun, Feb 09, 2025, 12:04 AM UTC

How have you done the last one? I have stuff running on ollama but not with "access to all of it"