Live data from Hacker News

Indexing a year of video locally on a 2021 MacBook with Gemma4-31B (50GB swap)

blog.simbastack.com

121–130 of 151 posts

Re: Indexing a year of video locally on a 2021 MacBook with Gemma4-31B (50GB swap)

#121
post #84
post #79

Earlier quoted context omitted.

The article itself has many AI tells. Can we update the guidelines on AI generated content ?

That's a separate issue and more of a grey area still. We're thinking about it.

i’m glad to hear this is being considered, thank you for your efforts

Re: Indexing a year of video locally on a 2021 MacBook with Gemma4-31B (50GB swap)

#122
post #85

Earlier quoted context omitted.

I've been getting this weekly from colleagues. It's very much an epidemic right now! And the port number is indeed almost always a random number between 8000 and 8100.

> I've been getting this weekly from colleagues. It's very much an epidemic right now! And the port number is indeed almost always a random number between 8000 and 8100. Really? A bit hard to believe, unless you have many dumb colleagues.

A lot of people here have colleagues who are playing with Claude Code but who have essentially no experience with development at all.

It’s not at all surprising. Not everyone is a developer.

Re: Indexing a year of video locally on a 2021 MacBook with Gemma4-31B (50GB swap)

#123
post #118

Earlier quoted context omitted.

I made a B2C AI app that's fully local (and free) to do AI based contextual file renaming. So if you give it a bunch of screenshots it will try and intelligently name them based upon what is in the screenshot. Same for videos, PDFs, etc. But to your point I haven't even tried charging money as it feels like something Apple is just going to bake in as a feature. https://finalfinalreallyfinaluntitleddocumentv3.com/

This is cool. And yeah love the name! Are you planning to open source it? Or maintain it in the future?

My plan was to just see if anyone wanted to actually use it first. That if I couldn't give it away I'd not invest the time in selling or open sourcing it.

I'd sort of designed it for my own needs first and hadn't thought too far beyond that.

Re: Indexing a year of video locally on a 2021 MacBook with Gemma4-31B (50GB swap)

#125
post #109

Earlier quoted context omitted.

I had exactly the same impression, and I recall seeing this style other times recently. First time I thought it was just bad writing skills, now I'm thinking it's AI generated.

I'm the author, yes it is AI-assisted. You can make AI-generated content without it being slop. Slop, to me at least, is content that's wrong, padded, or generic. I see the cadence / short-sentence issues but if there's something else beyond those, I'd actually want to know what made it feel bad. I would've put off documenting what I did over the weekend but instead, I did document everything, spent quite some time (…

I'm not philosophically against AI or anything, but I think this needed some heavy editing.

I did not even initially think upon seeing this style for the first time that it was AI-written, because I would associate AI-written text as fluffy. This staccato instead looks like the model was told to be terse and informal. I think the informality doesn't help either -- it's not that you can't have a well-written colloquial text, but I think it's harder to pull off.

Here is an example:

> Gemma returned people_count: "many" instead of an integer. My vision prompt literally said integer or the string "many" if >10. Gemma followed instructions correctly; the bug was schema design. The fix was a stricter prompt (integer 0-99 with explicit guidance to estimate) plus a coercion in the parser for the legacy "many" responses. Don't union-type schema fields. Pick always-int or always-string, never "int or this one specific string," because every downstream consumer pays for the choice.

Re: Indexing a year of video locally on a 2021 MacBook with Gemma4-31B (50GB swap)

#126
post #14

Earlier quoted context omitted.

Ok I scrambled to finalize a name for it and create a new repo for it - https://github.com/Simbastack-hq/framedex PS - I just put this together in the last few mins, removed my personal files and references. So it's not tested properly, please let me know if any issues. It's still an early hack, but I have thousands of still images as well from my camera which I've not processed and I need to do the same analysis for…

Hey friend, try something in this ballpark, your post has a bunch of painful AI tropes: https://github.com/blader/humanizer You get a pass here because you're doing really cool stuff but it's kinda tough to read past the AI nonsense, and it's relatively easy to screen out "it's not x it's y" kind of things and the bolded bullet points.

This diminishes the llm performance by making it use random out of band non thinking tokens

Re: Indexing a year of video locally on a 2021 MacBook with Gemma4-31B (50GB swap)

#128
post #101
post #100

Earlier quoted context omitted.

Cheers, I'll give it a try. How are those models at returning structured results? When I was writing the prompts for the analysis step and testing with older Claude models, it would have trouble structuring the XML consistently. Sonnet 4.6 handles it really well.

Use function calling/tool use, not XML output. The models are all trained for that now. Ie, instead of telling it to generate Name 19 whatever give it a function details(name: string, age: int, address: string) That is actually a JSON schema, and the models do great at it. Here's the claude docs, but they are all similar: https://platform.claude.com/docs/en/agents-and-tools/tool-us...

[flagged]
Post reply on HN