Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

MacBook M5 Pro and Qwen3.5 = Local AI Security System

sharpai.org

Post reply on HN
Print view View original

101–110 of 162 posts

Re: MacBook M5 Pro and Qwen3.5 = Local AI Security System

#101

Post by runako »

Octoth0rpe wrote: post #85
jmalicki wrote: post #46

Earlier quoted context omitted.

Perhaps if we truly run out of steam on the process node front?

Even if that happened tomorrow, I suspect we'd have _at least_ a decade of people tweaking/optimizing designs on the same node to squeeze meaningful performance upgrades out. Eg, coming up with hardware support for new int/float formats that make more sense for the models of 2029, running matrix operators on ram chips directly, etc.

I remember back in the early 2000s when people thought we were running out of steam on the advancements front. This was roughly around the time when CPU clocks stopped getting faster. Pentium hit 3GHz in 2005, Intel Core Ultra 5 performance cores are generally around this exact speed 20 years later.

Since at least the 640kb quip, betting against progress or the appetite for progress has been a losing bet.

Re: MacBook M5 Pro and Qwen3.5 = Local AI Security System

#102

Post by jjcm »

psyclobe wrote: post #28

I have always envisioned a ai server being part of a family's major purchases e.g. when they buy a house, appliance, etc. they also buy a 'ai system'. Machine hardware evolution is slowing down, pretty soon you can buy one big ass server that will last potentially decades as it would be purpose built for ai. Things like 'context based home security' yeah thats just, automatic, free, part of the ai system. Everyone wi…

I think this is likely, but in a slightly different way - I think we're going to start seeing more LLMs baked into silicon a la Taalas' ASIC.

ie, something like this fake future apple device page: https://speculate-mai.pages.dev/

Re: MacBook M5 Pro and Qwen3.5 = Local AI Security System

#104

Post by jjcm »

This is fantastic, but IMO it misses the most important part of a home security system from a business PoV - the ability to issue an alarm certificate. These are required for insurance discounts, as well as for making certain claims in the event of loss.

This is the classic issue in tech right now - it's becoming easier to build the systems, but the compliance/legal hurdles are still real, slow, and human. Even if the monitoring is best in class (which I'd argue it likely is - this is a fantastic application of AI), if the compliance isn't there it wont be a real product.

Re: MacBook M5 Pro and Qwen3.5 = Local AI Security System

#105

Post by kennywinker »

zamadatix wrote: post #72
psyclobe wrote: post #28

I have always envisioned a ai server being part of a family's major purchases e.g. when they buy a house, appliance, etc. they also buy a 'ai system'. Machine hardware evolution is slowing down, pretty soon you can buy one big ass server that will last potentially decades as it would be purpose built for ai. Things like 'context based home security' yeah thats just, automatic, free, part of the ai system. Everyone wi…

If you bought a big ass server for your home 10 years ago it probably wouldn't have even have had a GPU/AI accelerator at all. If it did, it would have been something with wimpy compute and VRAM because you needed the video encoder/decoder for security cameras or the like. I'm not sure that really gives confidence hardware has really slowed down enough to invest in it for decades. Single core CPU performance has but…

You’re kindof undermining your own point. Ten years later the only thing you’d need to upgrade for your home server might be the GPU - because a new use-case emerged. Okay? Spend $500-$1000 on an eGPU. Problem solved. Will that eGPU setup last another ten years? If all it’s doing is processing security video and routing claw-like tasks, then yes.

Re: MacBook M5 Pro and Qwen3.5 = Local AI Security System

#106

Post by aegis_camera »

jjcm wrote: post #104

This is fantastic, but IMO it misses the most important part of a home security system from a business PoV - the ability to issue an alarm certificate. These are required for insurance discounts, as well as for making certain claims in the event of loss. This is the classic issue in tech right now - it's becoming easier to build the systems, but the compliance/legal hurdles are still real, slow, and human. Even if th…

I see, I think the bar is really hight, right?

Re: MacBook M5 Pro and Qwen3.5 = Local AI Security System

#109

Post by zamadatix »

kennywinker wrote: post #105
zamadatix wrote: post #72

Earlier quoted context omitted.

If you bought a big ass server for your home 10 years ago it probably wouldn't have even have had a GPU/AI accelerator at all. If it did, it would have been something with wimpy compute and VRAM because you needed the video encoder/decoder for security cameras or the like. I'm not sure that really gives confidence hardware has really slowed down enough to invest in it for decades. Single core CPU performance has but…

You’re kindof undermining your own point. Ten years later the only thing you’d need to upgrade for your home server might be the GPU - because a new use-case emerged. Okay? Spend $500-$1000 on an eGPU. Problem solved. Will that eGPU setup last another ten years? If all it’s doing is processing security video and routing claw-like tasks, then yes.

Not sure I follow why - that the server from 10 years ago would be completely unfit for purpose now should not imply the one you buy today would therefore be the right hardware 10 years from now. Unless you can somehow guarantee we've reached the final set of new requirements we will ever have just these last few years the GPUs you buy today will probably be just as irrelevant to the new requirements a decade from now.

Of course one can always upgrade components piecewise as requirements change, but I don't see why you need to invest in a big ass server to do that. It'd be cheaper to go that route everyone has for decades at this point - upgrade with normal sized stuff as needed and not try to make it an up front multi-decade home investment out of it.

On the flip-side, if you intentionally plan to lock in the capabilities to the kinds of things one can run today and know you'll never therefore need to upgrade it then you can get whatever sized system makes sense for today's needs. You just need to be really sure you'll not be interested in "the next big thing" when it comes too.

Re: MacBook M5 Pro and Qwen3.5 = Local AI Security System

#110

Post by ar_lan »

anoopengineer wrote: post #48
jagged-chisel wrote: post #41

Earlier quoted context omitted.

And it's not going to happen any time soon because there's no recurring revenue to be gained from users/homeowners for such a thing.

With that logic, there wouldn't be anyone selling refrigerators or dishwashers.

I wouldn't be surprised if there was some plan to generate a subscription model for appliances.
Post reply on HN