Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Indexing a year of video locally on a 2021 MacBook with Gemma4-31B (50GB swap)

blog.simbastack.com

Post reply on HN
Print view View original

81–90 of 151 posts

Re: Indexing a year of video locally on a 2021 MacBook with Gemma4-31B (50GB swap)

#81

Post by overfeed »

iMerNibor wrote: post #35
throwa356262 wrote: post #3

I ran Gemma on a 2015 thinkpad to do something similar. Fortunately, I could upgrade the memory otherwise it would have been a painful exercise. Not gonna lie, llama.cpp had the fans spinning at max speed. But it worked and I got the job done.

> the fans spinning at max speed This always confuses me - don't people want their computations to run as fast as possible and thus inevitably produce more heat that needs to be vented? I suppose sometimes it is just an analogy for "its utilizing 100% of my resources" (which I'm guessing it is here), but I've definitely had people say it as an actual complaint in different contexts

> I've definitely had people say it as an actual complaint in different contexts

I think fan loudness is an outgrowth of conspicuous consumption because a certain OEM decided to make it a marketing bullet-point.

I was equally disappointed by by people - especially device reviewers - banging on the drum that phones made of plastic "didn't feel premium", and we got phones with glass backs that have to be shoved into plastic cases (because plastic is the near-perfect material to protect fragile phones screens and innards)

Re: Indexing a year of video locally on a 2021 MacBook with Gemma4-31B (50GB swap)

#82

Post by Forgeties79 »

bonoboTP wrote: post #44
jaggederest wrote: post #28

Earlier quoted context omitted.

Hey friend, try something in this ballpark, your post has a bunch of painful AI tropes: https://github.com/blader/humanizer You get a pass here because you're doing really cool stuff but it's kinda tough to read past the AI nonsense, and it's relatively easy to screen out "it's not x it's y" kind of things and the bolded bullet points.

I don't dislike those tropes because they are frequent or because they are not pleasing to read intrinsically. I dislike them because it tells me it was made by AI and AI output varies strongly in quality and most of it is low on insight but rings the right bells to make it seem insightful. It indicates a lack of human care. Hiding these clues by another AI pass doesn't solve the core problem. Now you just end up wit…

I dislike them because I find they generally don’t give any useful information OR if the information is in fact useful, it could do it with a fraction of the words.

Vigorous writing is concise.

Re: Indexing a year of video locally on a 2021 MacBook with Gemma4-31B (50GB swap)

#83

Post by asenna »

repparw wrote: post #53
asenna wrote: post #29

Earlier quoted context omitted.

Thanks for this! This is exactly what I was looking for. Tbh, I have a lot of thoughts and ideas and things to share and I do spend time and effort trying to de-AI-ing it but this should help a lot. I'll try it out. In fact, I was expecting getting shit on by HN readers for this but was pleasantly surprised that readers moved past it.

if you care for some feedback about the writing, dropping the link and saying "PR's are open!" would land probably equal or better, and would reduce noise on the message. as sibling said, substance and noise

Agreed.

To be honest, my literal thought process initially when writing was: - I think this is cool, I should probably open source this - No wait, I'm again over planning, no one's gonna read this and the problem is probably too specific to me for anyone to care.

So I just mentioned "lets compare notes if anyone else trying".

Hence you can see from the comment above, I immediately realized I made a mistake when the parent asked for the Skill file. Should've had the link ready. Pleasant surprise.

Re: Indexing a year of video locally on a 2021 MacBook with Gemma4-31B (50GB swap)

#84

Post by dang »

genxy wrote: post #79
dang wrote: post #69

Earlier quoted context omitted.

Could you please not post generated comments to HN? It's not allowed here. See https://news.ycombinator.com/newsguidelines.html#generated and https://news.ycombinator.com/item?id=47340079 . We ban accounts that do this and I don't want to ban you, so please write everything that you post to HN by hand. Of course, it's impossible to know for sure what was LLM processed or not, but we're getting complaints about some o…

The article itself has many AI tells. Can we update the guidelines on AI generated content ?

That's a separate issue and more of a grey area still. We're thinking about it.

Re: Indexing a year of video locally on a 2021 MacBook with Gemma4-31B (50GB swap)

#85

Post by z2 »

embedding-shape wrote: post #22
desro wrote: post #7

> The skill is open at ~/.claude/skills/video-index/. If you're working on something similar (indexing personal archives, getting a local model to do real archival work, building agents that drive editing tools), I'd be glad to compare notes. When your Claude wrote this post they might not have selected the right URL to share, unless your home folder is exposed. Care to share the skill files?

We just got a modern example of the classic message from a friend who just picked up programming, containing: "I just created my own web app, wanna check it out? It's here: http://localhost:8080"

I've been getting this weekly from colleagues. It's very much an epidemic right now! And the port number is indeed almost always a random number between 8000 and 8100.

Re: Indexing a year of video locally on a 2021 MacBook with Gemma4-31B (50GB swap)

#86

Post by asenna »

egorfine wrote: post #9

Thanks for the article! I have a beefy M5 Pro and I'm eagerly looking around for ways to use local models (specifically Gemma4 & Qwen3.6). This is an excellent thing to do. Especially that LLMs excel at batching thus you can index multiple photos and videos in parallel for no performance penalty.

Thanks! Videos is still kinda new to me. But I have a large collection of amazing photos - tens of thousands of RAW images - just lying there spread across the different trip folders.

You know what I REALLY want? Just point this beast at the folders and it tell me which 150 shots are good to process from these 1,500 images. That's the dream!

Although the technology is getting there, it's still a very difficult problem to solve. Taste and art is subjective. Also me as a photographer will always be concerned - "what if my best shot was in one of these rejected shots".

But yeah, I think I'll try to do some more of these experiments soon.

Re: Indexing a year of video locally on a 2021 MacBook with Gemma4-31B (50GB swap)

#87

Post by nchmy »

cortesoft wrote: post #71
bonoboTP wrote: post #44

Earlier quoted context omitted.

I don't dislike those tropes because they are frequent or because they are not pleasing to read intrinsically. I dislike them because it tells me it was made by AI and AI output varies strongly in quality and most of it is low on insight but rings the right bells to make it seem insightful. It indicates a lack of human care. Hiding these clues by another AI pass doesn't solve the core problem. Now you just end up wit…

I feel like human copywriters have been using those same tricks for clickbait articles for years…

Hence I've hated them all since before Ai. But now I'm utterly repulsed by it

Re: Indexing a year of video locally on a 2021 MacBook with Gemma4-31B (50GB swap)

#88

Post by endymi0n »

asenna wrote: post #86
egorfine wrote: post #9

Thanks for the article! I have a beefy M5 Pro and I'm eagerly looking around for ways to use local models (specifically Gemma4 & Qwen3.6). This is an excellent thing to do. Especially that LLMs excel at batching thus you can index multiple photos and videos in parallel for no performance penalty.

Thanks! Videos is still kinda new to me. But I have a large collection of amazing photos - tens of thousands of RAW images - just lying there spread across the different trip folders. You know what I REALLY want? Just point this beast at the folders and it tell me which 150 shots are good to process from these 1,500 images. That's the dream! Although the technology is getting there, it's still a very difficult proble…

there’s a lot of open models out there… I told Claude to do a weighted score on several models and deduplicate by CLIP similarity for an expedition, should be easy to replicate (see below). Sure doesn’t select the absolute best pics from an emotional impact perspective, but it was pretty damn good at me not having to wade through the bottom 80% of mediocre shots and dupes!

—-

“Models scored all 4,487 photos. NIMA rewards technical craft (sharpness, composition), LAION rewards emotional/aesthetic appeal, MUSIQ is more general quality. Combined: 0.4 NIMA + 0.3 LAION + 0.3 MUSIQ, deduped at 0.85 CLIP similarity.

Interesting: the models wildly disagreed on some shots — one photo ranked NIMA #2 globally but LAION #4313.”

Re: Indexing a year of video locally on a 2021 MacBook with Gemma4-31B (50GB swap)

#89

Post by squeaky-clean »

cortesoft wrote: post #71
bonoboTP wrote: post #44

Earlier quoted context omitted.

I don't dislike those tropes because they are frequent or because they are not pleasing to read intrinsically. I dislike them because it tells me it was made by AI and AI output varies strongly in quality and most of it is low on insight but rings the right bells to make it seem insightful. It indicates a lack of human care. Hiding these clues by another AI pass doesn't solve the core problem. Now you just end up wit…

I feel like human copywriters have been using those same tricks for clickbait articles for years…

"My AI writing isn't slop. It's just as good as buzzfeed lists or celebrity gossip articles."

Re: Indexing a year of video locally on a 2021 MacBook with Gemma4-31B (50GB swap)

#90

Post by mlvljr »

egorfine wrote: post #77
busfahrer wrote: post #10

Earlier quoted context omitted.

I have been contemplating a M5 Pro MBP, but for the life for me I wasn't able to find benchmarks for real-world models, do you happen to know how many tokens per second roughly you get with MoE models like Qwen 3.6 35B/A3B or Gemma 4 26B?

Native MCP: For Qwen 35B enabling native MCP on MLX models slows it down by 10%. For Qwen 27B enabling native MCP on MLX models speeds token generation up almost exactly 1.5x. (all tested on M5 pro).

[dead]
Post reply on HN