Live data from Hacker News

I indexed 669 GB of my GoPro videos using my M1 Max computer and local ML models

news.ycombinator.com

81–90 of 129 posts

Re: I indexed 669 GB of my GoPro videos using my M1 Max computer and local ML models

#83
post #73

A lawyer I know who specialises in rape, and is excellent at getting the obviously guilty exonerated, lost a case last year because of GoPro videos. Her client was recording while committing the abhorrent crime. The criminal would otherwise have got off. From my perspective, the GoPro camera produced a good outcome. Still, one has wonder why anyone to record their criminal actions.

word "her" in this context gave me heavy feelings, what makes one to pick such a career move...

$

Re: I indexed 669 GB of my GoPro videos using my M1 Max computer and local ML models

#84

Earlier quoted context omitted.

You'll need a lora for this, porn content rejection is heavy. Or you'll need a abliterated model, not sure if vision also works. You might want to add something like yolo finetune to detect scenes + face recognition too.

Vision still works perfectly fine in abliterated models.

Just because they don't refuse it doesn't mean they are useful.

I found a few pornographic pictures on the web to hand to Abliterated Gemma4 12B(literally just to test this) and it needs pushing just to accept that people can be naked.

It didn't refuse but it also didn't provide useful descriptions such as "this is a pornographic picture of a woman".

> G4: There is a person lying down in a scientific context, if I had to guess they are a biologist in a classroom

> me: Is she wearing any clothes?

> G4: No.

Also, it is obsessed with penises —seeing them in compositions where there is only a female. I suppose it's been trained to ban dick pics or something.

Prompting may help some but 12B seems to be a bit worse than E4B with the vision/audio model at voice and text reading so maybe that one would do better.

Re: I indexed 669 GB of my GoPro videos using my M1 Max computer and local ML models

#85
Well done! I couldn't understand how you are building reels out of it via the agent. Is it some sort of AI tool calling that takes image links and builds a reel via some video editing tool ? Or +/- time delta around the timestamp returned from the indexed from a given query + join them together?

Re: I indexed 669 GB of my GoPro videos using my M1 Max computer and local ML models

#86

Well done! I couldn't understand how you are building reels out of it via the agent. Is it some sort of AI tool calling that takes image links and builds a reel via some video editing tool ? Or +/- time delta around the timestamp returned from the indexed from a given query + join them together?

Thank you! I'm using RAG, I have every video scene indexed individually in the vector database. When I'm asking the agent, it'll use an Ollama model to understand the request, use the available search tool (searching using transcription text, faces, visual, audio or combined) something like when you use Claude or Chat GPT it'll use the web search tool to find you info online. Then, I can filter out video scenes using the Ollama to better present accurate and unique video scene, then send those video results to Davinci Resolve using their API to create a video timeline using those video clips

Re: I indexed 669 GB of my GoPro videos using my M1 Max computer and local ML models

#87

if anyone is interested in searching large video collections local and offline I suggest taking a look at Jumper https://docs.getjumper.io comes with some nifty features like NLE- integrations, people search, MCP, API etc Disclaimer: one of the co-founders

The link just timed out for me. I'm in Israel, connecting via residential WiFi. All other sites that I regularly use connect just fine.

hmm weird works for me.. what about https://getjumper.io/?

Re: I indexed 669 GB of my GoPro videos using my M1 Max computer and local ML models

#89

Earlier quoted context omitted.

> Aha, it makes total sense. This number sounds much more reasonable than “669 GB”, since the actual total size of processed frames would be like 10-30 GB. The reason why is “669 GB” is the total raw footage size when I'm doing the video processing, I downscaled each frame to 720p to make the video processing much faster and I don't need full original quality in order to get accurate results (as far as I know and exp…

What PAYG providers do people here recommend? Most powerful machine at home is an M1 MBA (16GB), so I too am interested in short term options where I can still benefit from the privacy of local models

Runpod

Re: I indexed 669 GB of my GoPro videos using my M1 Max computer and local ML models

#90
I will be doing these things with local LLMs

Take a fast, small and powerful LLM running locally to index my personal data like images, videos, documents and enrich them and tag with the enriched metadata.

Want to group by people - Search tagged metadata and group it What to search an image by description - tagged metadata What to organize by anything - tagged metadata

This should (hopefully) put an end to my file clutter

Post reply on HN