Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

MacBook M5 Pro and Qwen3.5 = Local AI Security System

sharpai.org

Post reply on HN
Print view View original

51–60 of 162 posts

Re: MacBook M5 Pro and Qwen3.5 = Local AI Security System

#51

Post by aegis_camera »

0xbadcafebee wrote: post #23

This is a very flashy page that's glossing over some pretty boring things. - This is a benchmark for "home security" workflows. I.e., extremely simple tasks that even open weight models from a year ago could handle. - They're only comparing recent Qwen models to SOTA. Recent Qwen models are actually significantly slower than older Qwen models, and other open weight model families. - Specific tasks do better with spec…

Thanks a lot for your feedback :) I've noticed the slow down of QWEN3.5, so I turned it off thinking mode, the thinking mode even count words like ( 1 count 2 the 3 words, lol which is very funny ).

You are very correct, I just have 2 days of the MBP PRO 64GB on hands, so the test is just covering LLM part -- the logic handling.

For VLM, LFM is the best, even 450M works, I'll update soon :) Thanks again for your deep understanding of LLM/VLM domain and your suggestion.

Re: MacBook M5 Pro and Qwen3.5 = Local AI Security System

#52

Post by aegis_camera »

anoopengineer wrote: post #48
jagged-chisel wrote: post #41

Earlier quoted context omitted.

And it's not going to happen any time soon because there's no recurring revenue to be gained from users/homeowners for such a thing.

With that logic, there wouldn't be anyone selling refrigerators or dishwashers.

:)

Re: MacBook M5 Pro and Qwen3.5 = Local AI Security System

#53

Post by qsera »

anoopengineer wrote: post #48
jagged-chisel wrote: post #41

Earlier quoted context omitted.

And it's not going to happen any time soon because there's no recurring revenue to be gained from users/homeowners for such a thing.

With that logic, there wouldn't be anyone selling refrigerators or dishwashers.

I take it that you have never come across the idea of "planned obsolescence"..

Re: MacBook M5 Pro and Qwen3.5 = Local AI Security System

#54

Post by HanClinto »

psyclobe wrote: post #28

I have always envisioned a ai server being part of a family's major purchases e.g. when they buy a house, appliance, etc. they also buy a 'ai system'. Machine hardware evolution is slowing down, pretty soon you can buy one big ass server that will last potentially decades as it would be purpose built for ai. Things like 'context based home security' yeah thats just, automatic, free, part of the ai system. Everyone wi…

Reminds me of the mainframe in The Moon is a Harsh Mistress.

Re: MacBook M5 Pro and Qwen3.5 = Local AI Security System

#55

Post by nateb2022 »

psyclobe wrote: post #28

I have always envisioned a ai server being part of a family's major purchases e.g. when they buy a house, appliance, etc. they also buy a 'ai system'. Machine hardware evolution is slowing down, pretty soon you can buy one big ass server that will last potentially decades as it would be purpose built for ai. Things like 'context based home security' yeah thats just, automatic, free, part of the ai system. Everyone wi…

I disagree. Let's take the M1 vs the M5 (https://www.macrumors.com/2025/11/10/apple-silicon-m1-to-m5-...):

  - 6× faster CPU/GPU performance
  - 6× faster AI performance
  - 7.7× faster AI video processing
  - 6.8× faster 3D rendering
  - 2.6× faster gaming performance
  - 2.1× faster code compiling
Over the span of 5 years.

Plus, realistically what makes an "ai" server different from a computer? This "lineage info of the family may be passed down through generations" sounds nice but do you know anyone passing down a Commodore 64 or Apple II that remains in daily use? I fail to see how "ai" would protect something from obsolescence.

Re: MacBook M5 Pro and Qwen3.5 = Local AI Security System

#56

Post by HanClinto »

Havoc wrote: post #10

I would think a quantized 27b should be doable in mac world too?

Yeah, but it can be a bit of a tight squeeze if you don't have at least 24gb (preferably 32gb+) of memory.

Especially if you want other apps to run at the same time, I think it's safer to stick with something more like 9b. You can see a table with quantized sizes here [0] -- yes, there are smaller quants than Q4_K_XL, but then you're down in the weeds with nickel-and-diming things, and if you want to even keep something like a (memory-hungry) instance of VSCode running, good luck.

IMO -- if 9b is doing the job, stick with 9b.

0 - https://github.com/ggml-org/LlamaBarn/pull/63

Re: MacBook M5 Pro and Qwen3.5 = Local AI Security System

#57

Post by aegis_camera »

0xbadcafebee wrote: post #23

This is a very flashy page that's glossing over some pretty boring things. - This is a benchmark for "home security" workflows. I.e., extremely simple tasks that even open weight models from a year ago could handle. - They're only comparing recent Qwen models to SOTA. Recent Qwen models are actually significantly slower than older Qwen models, and other open weight model families. - Specific tasks do better with spec…

You are right. I have Mac mini M2 16GB, it does hold all the cameras I have. Small models like QWEN 9B + LFM 450M handle their security job nicely with Will extend the test to more model and thanks again for your insight.

Re: MacBook M5 Pro and Qwen3.5 = Local AI Security System

#58

Post by trout_scout »

jagged-chisel wrote: post #41
psyclobe wrote: post #28

I have always envisioned a ai server being part of a family's major purchases e.g. when they buy a house, appliance, etc. they also buy a 'ai system'. Machine hardware evolution is slowing down, pretty soon you can buy one big ass server that will last potentially decades as it would be purpose built for ai. Things like 'context based home security' yeah thats just, automatic, free, part of the ai system. Everyone wi…

And it's not going to happen any time soon because there's no recurring revenue to be gained from users/homeowners for such a thing.

There's potential case for a subscription model to keep security updated for the connection to the users' phones as well as on going support for less tech savvy users (e.g. "I told my assistant to turn on my smart dishwasher and it turned on the my smart washing machine instead"). I'd imagine the HN crowd would lean toward a open source version though.

Re: MacBook M5 Pro and Qwen3.5 = Local AI Security System

#59

Post by beoberha »

psyclobe wrote: post #28

I have always envisioned a ai server being part of a family's major purchases e.g. when they buy a house, appliance, etc. they also buy a 'ai system'. Machine hardware evolution is slowing down, pretty soon you can buy one big ass server that will last potentially decades as it would be purpose built for ai. Things like 'context based home security' yeah thats just, automatic, free, part of the ai system. Everyone wi…

I don’t think there’s anything different between what you’re suggesting and a homelab. Most people do not have a homelab and are happy to offload services like photo storage or security to remote providers.

Re: MacBook M5 Pro and Qwen3.5 = Local AI Security System

#60

Post by aegis_camera »

llm_nerd wrote: post #30

Neat, but why would you want a clumsy LLM to know what happened with your security system? Things happened or they didn't, and that's what dashboards are for. Seems like trying to make a need from the tools. My security system front page shows me every event that happened at my house, and I don't have to interrogate it on every happenstance, and I don't see what the value of that is.

When you are not at home, you can send your message to your dashboard agent for your query. This is one use case I found.
Post reply on HN