Live data from Hacker News

I indexed 669 GB of my GoPro videos using my M1 Max computer and local ML models

news.ycombinator.com

61–70 of 129 posts

Re: I indexed 669 GB of my GoPro videos using my M1 Max computer and local ML models

#61

Cool build but the example videos you provide at the end are . . . not what I would hope for when thinking about the highlights of 2000+ videos of biking? For example the dog barking video only has one scene repeated two or three times and it's five seconds long?

Fair enough, what would like to see as an example video and I would make it.

For the dog barking videos, those are only the video scenes that I have a dog barking sound in the video.

I'll keep adding more prompts and example videos, keep an eye for that

Re: I indexed 669 GB of my GoPro videos using my M1 Max computer and local ML models

#62

Cool build but the example videos you provide at the end are . . . not what I would hope for when thinking about the highlights of 2000+ videos of biking? For example the dog barking video only has one scene repeated two or three times and it's five seconds long?

Fair enough, what would like to see as an example video and I would make it. For the dog barking videos, those are only the video scenes that I have a dog barking sound in the video. I'll keep adding more prompts and example videos, keep an eye for that

I don't have any preconceptions about specific content I want to see. I'd just think that so many hours of such cool adventures would have greater variety. It made me wonder if your AI really did such a good job of indexing it. It made me think maybe the tech isn't quite ready yet?

Did you ever visit crazyguyonabike.com? A long time ago I had the pleasure of following the journey of a friend of a friend of a friend on that site:

https://www.crazyguyonabike.com/doc/?doc_id=2405

Stuff like that I guess?

Re: I indexed 669 GB of my GoPro videos using my M1 Max computer and local ML models

#64

Something I've enjoyed more than I expected is Google and Apple photos sending me photo memories and compilations of various things in my life and my kids lives over the last decade. I'm really bullish on taking more video of my kids, with the thought that it will become easier and easier for AI to put them into little compilations I can enjoy later.

You don't mind Google using your kids to train their models and advertising algorithms?

Years from now they'll be getting "hey look at BIKE BRANDS' NEWEST CHEAP BIKE REMEMBER WHEN YOU USED TO RIDE BIKE BRAND BIKES"

Re: I indexed 669 GB of my GoPro videos using my M1 Max computer and local ML models

#65
> Many of the videos I captured amazing moments, and sometimes it's kind of hard to watch the full videos to get those moments.

Yep. I had the same problem.

> Then, run the frame analysis pipeline [...] I have a face recognition plugin using my custom faces data, object detection, on-screen text, shot type, and scene description [...] we will have three vector DB collections that have all the information about our videos, like video location metadata, camera name, faces recognized, objects detected, on-screen text, transcription, description of each scene, and many more [...] we can get better indexed data if you use the advanced mode indexing to use the Qwen2.5-VL-7B-Instruct model to understand and describe your video much better, but at a slower indexing speed

Yeah, uhm... ok :)

If anyone else has a similar problem, the real solution is as follows:

1. When recording, if you witness an interesting moment worth saving later, press the power button — this will mark the current moment in the video as a chapter.

2. Find the chapters later when editing and cut them into clips.

3. You're done :)

This has two main benefits over the insanity above:

1. It's trivially simple instead of insanely complex and inefficient.

2. It will reliably catch all the stuff you find interesting, since you're the one doing the marking.

The downsides:

1. Doesn't work retroactively.

2. It may miss interesting stuff if you miss it at the time as well.

3. Only works for this use case.

4. Nerds won't salivate over your usage of cutting edge tech.

Re: I indexed 669 GB of my GoPro videos using my M1 Max computer and local ML models

#68

I was surprised to learn that the M1 Max CPU is an ARM/SoC, comparable to an 11th gen Intel i9 Do I have it right? Would Windows ARM performance be similar for those cpu? ref: https://www.cpubenchmark.net/compare/4585vs4245/Apple-M1-Max...

No comparison. M1 Max has 400GB/s RAM bandwidth while Snapdragon X2 Elite, the latest and greatest , has 228GB/s RAM bandwidth.

Re: I indexed 669 GB of my GoPro videos using my M1 Max computer and local ML models

#69

Something I've enjoyed more than I expected is Google and Apple photos sending me photo memories and compilations of various things in my life and my kids lives over the last decade. I'm really bullish on taking more video of my kids, with the thought that it will become easier and easier for AI to put them into little compilations I can enjoy later.

You don't mind Google using your kids to train their models and advertising algorithms? Years from now they'll be getting "hey look at BIKE BRANDS' NEWEST CHEAP BIKE REMEMBER WHEN YOU USED TO RIDE BIKE BRAND BIKES"

I think most people really don't care, and/or will just adblock those sorts of things when they do arrive.

Re: I indexed 669 GB of my GoPro videos using my M1 Max computer and local ML models

#70
post #6

Does it work for porn collections too?

Asking the important questions

I was meandering through the comments about to leave the topic when my interest suddenly piqued upon reading the word porn.
Post reply on HN