I wonder how long it would take on faster hardware. I have ten times that much footage, but 67 * 10 hours is a lot of processing.
I might be better off getting something with a beefy GPU on AWS or Google cloud.
I indexed 669 GB of my GoPro videos using my M1 Max computer and local ML models
101–110 of 129 posts
Re: I indexed 669 GB of my GoPro videos using my M1 Max computer and local ML models
#102Something I've enjoyed more than I expected is Google and Apple photos sending me photo memories and compilations of various things in my life and my kids lives over the last decade. I'm really bullish on taking more video of my kids, with the thought that it will become easier and easier for AI to put them into little compilations I can enjoy later.
I wish I could connect Apple photos to my Spotify account and have photo memories connected with songs I listened to at the time :)
Music memories are the best.
I booted up my old PS3 from my uni days (20 years ago?) and found all of the music I had on it because I used it for everything at the time. Some seriously nostalgic music I'd completely forgotten about.
Re: I indexed 669 GB of my GoPro videos using my M1 Max computer and local ML models
#103What models did you use for the stages? I see Qwen2.5-VL-7B-Instruct mentioned as an advanced option, so I assume maybe Qwen2.5-VL-3B-Instruct by default (which is what I also use for a lot of stuff, it is incredibly good at "clean" OCR, but as you maybe indicate not the best at "describing a scene").
EDITED: I didn't realize Whisper was a local model. I never tried transcription before, so I had always figured it was a pay model by OpenAI. I'll have to check it out (although the runtime listed here is a bit daunting).
For that project I'll say I don't see much degradation in embedding quality at much much worse quality than 720p (all the way down to 240p), which speeds things up considerably. Although I don't really do face or object detection, just scene embeddings. To me any process whereby it would take longer to process the video than watch it is probably a no go in general. Obviously a challenge for local-first analysis.
Re: I indexed 669 GB of my GoPro videos using my M1 Max computer and local ML models
#104Related article on indexing videos but with a local text description and using Gemma4: https://blog.simbastack.com/indexed-a-year-of-video-locally/
Re: I indexed 669 GB of my GoPro videos using my M1 Max computer and local ML models
#105Earlier quoted context omitted.
I agree with that, thank you for your feedback. Also, maybe you're not a video editor and you just wanna search your videos. The video editing integrations are optional and you have full control. You can switch between Adobe Premiere Pro, Final cut Pro or Davinci Resolve
cannot wait to incorporate this to my workflow. thanks
That's great, would love to hear your feedback then
Re: I indexed 669 GB of my GoPro videos using my M1 Max computer and local ML models
#106Earlier quoted context omitted.
What PAYG providers do people here recommend? Most powerful machine at home is an M1 MBA (16GB), so I too am interested in short term options where I can still benefit from the privacy of local models
Runpod
Seconding runpod.
They were having availability issues with GPUs (of course) but especially their UI where you'd customise a template only to try to start a pod, the GPU be unavailable and the UI reset forcing you to make the changes all over again.
But they have fixed that since, now starting a pod is more from a live page where as GPU availability status changes it updates in realtime/if your deploy fails you just try again - your customised env vars etc are still there.
Plus they also addressed the GPU availability problem as something they're working to fix and it's understandable seeing as nobody can get their hands on GPUs atm.
Re: I indexed 669 GB of my GoPro videos using my M1 Max computer and local ML models
#107Re: I indexed 669 GB of my GoPro videos using my M1 Max computer and local ML models
#108Earlier quoted context omitted.
You'll need a lora for this, porn content rejection is heavy. Or you'll need a abliterated model, not sure if vision also works. You might want to add something like yolo finetune to detect scenes + face recognition too.
For GP's purpose, can face recognition techniques be repurposed for, um, other body parts recognition? Sometimes the actresses are facing away from camera. There are exposed lips, if that helps.
Yes, for actresses _and_ actors I'm sure you'd get the same level of performance as you would for any facial recognition use case. You can't do facial recognition on someone's back, but I'm sure there are other techniques/models that can be applied, many people have unique marks/features etc.
Re: I indexed 669 GB of my GoPro videos using my M1 Max computer and local ML models
#109Does it work for porn collections too?
[deleted]
Re: I indexed 669 GB of my GoPro videos using my M1 Max computer and local ML models
#110A lawyer I know who specialises in rape, and is excellent at getting the obviously guilty exonerated, lost a case last year because of GoPro videos. Her client was recording while committing the abhorrent crime. The criminal would otherwise have got off. From my perspective, the GoPro camera produced a good outcome. Still, one has wonder why anyone to record their criminal actions.
word "her" in this context gave me heavy feelings, what makes one to pick such a career move...
Why? You're being sexist and I hope you can understand why.