Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Indexing a year of video locally on a 2021 MacBook with Gemma4-31B (50GB swap)

blog.simbastack.com

Post reply on HN
Print view View original

61–70 of 151 posts

Re: Indexing a year of video locally on a 2021 MacBook with Gemma4-31B (50GB swap)

#61

Post by dist-epoch »

iMerNibor wrote: post #35
throwa356262 wrote: post #3

I ran Gemma on a 2015 thinkpad to do something similar. Fortunately, I could upgrade the memory otherwise it would have been a painful exercise. Not gonna lie, llama.cpp had the fans spinning at max speed. But it worked and I got the job done.

> the fans spinning at max speed This always confuses me - don't people want their computations to run as fast as possible and thus inevitably produce more heat that needs to be vented? I suppose sometimes it is just an analogy for "its utilizing 100% of my resources" (which I'm guessing it is here), but I've definitely had people say it as an actual complaint in different contexts

What people complain is when they visit a blog with two images and the fans are spinning at max speed because the blog has 100 trackers.

Re: Indexing a year of video locally on a 2021 MacBook with Gemma4-31B (50GB swap)

#62

Post by teach »

asenna wrote: post #49
zazibar wrote: post #45

The subject matter is interesting but the amount of slop makes it difficult to read through. Yeah, it's great that you can throw your technical problems at Claude without caring much about the generated output but treating your own writing that you actually want to share with the world the same way is a terrible idea.

Tbh, I did spend a lot of time trying to ground it and de-slopify it - verified nothing was halucinated and went through 10 iterations to get to this. It's almost like wrestling with Claude and I knew it would be tough on HN. But because of the fear of non-perfection, I used to put away things like creating this article or even posting it anywhere. And I do think the article has real value that HN would appreciate (I…

For what it's worth, I really enjoyed this read and almost came here to comment "this is the most enjoyable llm-assisted article I've read in a while"

The tells were unmistakable but it still had a human touch, so I for one am glad you published anyway.

Re: Indexing a year of video locally on a 2021 MacBook with Gemma4-31B (50GB swap)

#63

Post by yellow_postit »

jaggederest wrote: post #28
asenna wrote: post #14

Earlier quoted context omitted.

Ok I scrambled to finalize a name for it and create a new repo for it - https://github.com/Simbastack-hq/framedex PS - I just put this together in the last few mins, removed my personal files and references. So it's not tested properly, please let me know if any issues. It's still an early hack, but I have thousands of still images as well from my camera which I've not processed and I need to do the same analysis for…

Hey friend, try something in this ballpark, your post has a bunch of painful AI tropes: https://github.com/blader/humanizer You get a pass here because you're doing really cool stuff but it's kinda tough to read past the AI nonsense, and it's relatively easy to screen out "it's not x it's y" kind of things and the bolded bullet points.

As someone that naturally used a rule of 3 and em dashes I hate AI for taking that away from me.

Re: Indexing a year of video locally on a 2021 MacBook with Gemma4-31B (50GB swap)

#64

Post by jaggederest »

yellow_postit wrote: post #63
jaggederest wrote: post #28

Earlier quoted context omitted.

Hey friend, try something in this ballpark, your post has a bunch of painful AI tropes: https://github.com/blader/humanizer You get a pass here because you're doing really cool stuff but it's kinda tough to read past the AI nonsense, and it's relatively easy to screen out "it's not x it's y" kind of things and the bolded bullet points.

As someone that naturally used a rule of 3 and em dashes I hate AI for taking that away from me.

Agreed, I find myself avoiding constructs I would use naturally because they read as AI - "not just because other people would judge them, but because I also notice and dislike them".

Re: Indexing a year of video locally on a 2021 MacBook with Gemma4-31B (50GB swap)

#65

Post by busfahrer »

egorfine wrote: post #17
busfahrer wrote: post #10

Earlier quoted context omitted.

I have been contemplating a M5 Pro MBP, but for the life for me I wasn't able to find benchmarks for real-world models, do you happen to know how many tokens per second roughly you get with MoE models like Qwen 3.6 35B/A3B or Gemma 4 26B?

Qwen 3.6 35B running on oMLX 0.3.9rc1: on oMLX I get 86 t/s on Q4 and 74 t/s on Q6. Bear in mind that ttft on MLX is much much faster on M5 Pro as compared to M4 Pro. Also bear in mind that those figures are with NO optimizations whatsoever: no MCP, no DFlash. I am waiting for both to be released for the Qwen models.

Great, thanks! :-) and to mirror another poster: what kind of prompt parsing (prefill) speed do you get for that model? Also how is the speed for the 27B model?

Re: Indexing a year of video locally on a 2021 MacBook with Gemma4-31B (50GB swap)

#66

Post by jaggederest »

repparw wrote: post #53
asenna wrote: post #29

Earlier quoted context omitted.

Thanks for this! This is exactly what I was looking for. Tbh, I have a lot of thoughts and ideas and things to share and I do spend time and effort trying to de-AI-ing it but this should help a lot. I'll try it out. In fact, I was expecting getting shit on by HN readers for this but was pleasantly surprised that readers moved past it.

if you care for some feedback about the writing, dropping the link and saying "PR's are open!" would land probably equal or better, and would reduce noise on the message. as sibling said, substance and noise

That's actually a really good point, blog posts as open source

Re: Indexing a year of video locally on a 2021 MacBook with Gemma4-31B (50GB swap)

#68

Post by cataphract »

gitowiec wrote: post #32

Reading this text feels strange, sentences seems to be detached

I had exactly the same impression, and I recall seeing this style other times recently. First time I thought it was just bad writing skills, now I'm thinking it's AI generated.

Re: Indexing a year of video locally on a 2021 MacBook with Gemma4-31B (50GB swap)

#69

Post by dang »

oceanus wrote: post #67

[flagged]

Could you please not post generated comments to HN? It's not allowed here. See https://news.ycombinator.com/newsguidelines.html#generated and https://news.ycombinator.com/item?id=47340079.

We ban accounts that do this and I don't want to ban you, so please write everything that you post to HN by hand.

Of course, it's impossible to know for sure what was LLM processed or not, but we're getting complaints about some of your posts and, upon inspection, the complaints seem justified.

Post reply on HN