151–160 of 162 posts
Earlier quoted context omitted.
I don't know if I can post the email here hopefully hn doesn't filter it out: service at sharpai.org
Thanks, I sent you an email with a couple of bugs I ran into and screenshots.
https://github.com/SharpAI/DeepCamera/releases/download/v202...
I have always envisioned a ai server being part of a family's major purchases e.g. when they buy a house, appliance, etc. they also buy a 'ai system'. Machine hardware evolution is slowing down, pretty soon you can buy one big ass server that will last potentially decades as it would be purpose built for ai. Things like 'context based home security' yeah thats just, automatic, free, part of the ai system. Everyone wi…
I think this is likely, but in a slightly different way - I think we're going to start seeing more LLMs baked into silicon a la Taalas' ASIC. ie, something like this fake future apple device page: https://speculate-mai.pages.dev/
Earlier quoted context omitted.
I love this conundrum. I have a good analogy. 10 years ago, I was convinced that a 24-inch 1080p monitor at arm's length was perfection. There could never be any reason to improve over it. I could do everything I ever wanted to, to a standard I would never need to improve upon. Yet here we are. The simplest and most obvious improvement is a 24" 4k monitor at 200% scaling. Basically, better in every way. There's a dis…
At some point specs don’t matter. I don’t wonder about the processor in my thermostat either. I don’t know how many horsepower my XC90 has. I don’t know the rated power of my chainsaw. All I care about is: do they work, are they ‘safe’, are they comfortable, etc.
Earlier quoted context omitted.
I don’t think there’s anything different between what you’re suggesting and a homelab. Most people do not have a homelab and are happy to offload services like photo storage or security to remote providers.
I think that attitude is (very) slowly changing though and might not be the default forever. My elderly parents have asked me about "local backups" of their cloud stuff, their Facebook history etc.. If they're thinking about the risks/tradeoffs of being in the cloud.. I think people use the cloud because there's no better/easier option today . But at some point there might be. A home appliance (which may be similar t…
Earlier quoted context omitted.
You’re kindof undermining your own point. Ten years later the only thing you’d need to upgrade for your home server might be the GPU - because a new use-case emerged. Okay? Spend $500-$1000 on an eGPU. Problem solved. Will that eGPU setup last another ten years? If all it’s doing is processing security video and routing claw-like tasks, then yes.
Not sure I follow why - that the server from 10 years ago would be completely unfit for purpose now should not imply the one you buy today would therefore be the right hardware 10 years from now. Unless you can somehow guarantee we've reached the final set of new requirements we will ever have just these last few years the GPUs you buy today will probably be just as irrelevant to the new requirements a decade from no…
Another data point? All the GPUs i’m looking at buying for my home llm explorations is +5 years old.
Earlier quoted context omitted.
Home labs feel wholly different and requires custom setup and maintenance. A home appliance like a toaster would be in the case of an AI server are ready to go appliance that’s preloaded and confined and connect to everything in your home and help you manage it likely by just voice chat or some amount of interface.
What you’re describing is more likely to manifest as a proprietary product from someone like Samsung or Ring (likely both!) than an open standard AI server that integrates with everything in your home automatically. This is exactly like what we have today with security systems and smart appliances. You have managed services and you have Home Assistant in your homelab.
In a way, it already exists at an equipment level - a Mac Mini or Mac Studio is very power efficient and adding capabilities to it is at an app level.
Since a solution like this would be at the level of a group of apps, that might be something to bridge.
Earlier quoted context omitted.
I think that attitude is (very) slowly changing though and might not be the default forever. My elderly parents have asked me about "local backups" of their cloud stuff, their Facebook history etc.. If they're thinking about the risks/tradeoffs of being in the cloud.. I think people use the cloud because there's no better/easier option today . But at some point there might be. A home appliance (which may be similar t…
There’s no better option today because it’s impossible to make it a better experience. That machine at home will need upgrades, it could fail, it costs thousands, it sucks lots of power. There is no mass market appeal.
My Raspberry Pi pi-hole is a Pi 2b that has been running for over 5 years and it's totally fine. It has automatic security upgrades turned on but nothing else, and it doesn't need any time or attention. It just does its job.
I have a Homelab that's a mini-PC that's quiet and does not suck lots of power and is tucked away neatly in a closet.
I think it would be completely possible to provide an appliance-like machine that would not have the problems you're outlining.
Impossible is absolutely the wrong qualifier.