Live data from Hacker News

Automatic supercuts on the command line with Videogrep

lav.io

51–60 of 60 posts

Re: Automatic supercuts on the command line with Videogrep

#52
post #27

I always wanted a markdown-like video editor. I want to chop up my videos and make notes about what is in them. Text based document would be so much easier for this than big clunky Premiere.

No markdown but have you played with Descript?

I liked that at first but the buggyness and cloud lag killed it for me

Re: Automatic supercuts on the command line with Videogrep

#55
post #37

great project! since it relies heavily on subtitle files, and as an alternative to generating your own, which websites would you recommend to find subtitles for videos which are not on youtube i.e. movies and series? preferably ones with ratings systems similar to guitar tabs websites - I can envisage a musical similarity in the variance and quality of user-submitted content e.g. timing, volume, tone, punctuation, ex…

I just started playing around with the transcription part after seeing this blog post. Consider giving it a try. I'm not sure how well most subtitle sources will work with this. I don't think they'll generally embed the word timings needed for picking out fragments (just line timings). The blog post mentions it being the case for `.srt` specifically. Not 100% sure, someone with better understanding of the subtitle fo…

thank you for the info

I hope the subtitles website I am searching for will provide multiple formats and I understand a lot more effort would be required to produce the .vtt with word fragments. running a diff on vosk text and subtitle file text might help to iron out ambiguities

I will at some point try vosk (with parallel!)

Re: Automatic supercuts on the command line with Videogrep

#56
This is very cool! I wonder if Videogrep works better with videos sourced from Youtube (consistent formats, framerates, bitrates) compared to arbitrary sources.

I've used ffmpeg before to chop video bits and merge them before. Mixed results. It'd struggle to cut at exact frames or the audio would go out of sync or the frame rate would get messed up.

I gave up and decided to tackle the problem on the playback side. Like players respect subtitle srt/vtt files, I wish there were a "jumplist" format (like a playlist but "intra-file") that you could place alongside video/audio files, and players would automatically play the media as per markers in the file, managing any prebuffering, etc. for smooth playback.

For a client project, I did this with the Exoplayer lib on Android, which kinda already has an "evented" playback support where you can queue events on the playback timeline. A "jumplist" file is a simple .jls CSV file with the same filename as the video file.

Each line contains: ,,

"extra-features" could be playback speed, pan, zoom, whatever.

Code parses the file and queues events on the playback timeline (On tick 0 jump to first , on each go to next ).

I set it up to buffer the whole file aggressively, but that could be improved. Downside may be that more data is downloaded than is played. Upside is that multiple people can author their own "jumplist" files without time consuming re-encode of media.

Re: Automatic supercuts on the command line with Videogrep

#57

Earlier quoted context omitted.

No markdown but have you played with Descript?

I liked that at first but the buggyness and cloud lag killed it for me

Hmm it’s been pretty stable for me but I also have only used it a handful of times. Inconsistency is definitely not a desirable trait in an NLE!

Re: Automatic supercuts on the command line with Videogrep

#58
post #27

I always wanted a markdown-like video editor. I want to chop up my videos and make notes about what is in them. Text based document would be so much easier for this than big clunky Premiere.

Oh man, this. I want a human readable document (markdown fits the bill) that resembles this:

    ---
    source: 
    ---

    [-]
    ```json
    { optional metadata }
    ```
    ...notes...
And can target different render outputs:

- Various NLE formats

- Mini web app with playback/live annotations (Maybe even with the capability to edit the underlying file)

- Simple webpage with thumbnails and notes

- An actual annotated supercut(!)

I just might build it!

Re: Automatic supercuts on the command line with Videogrep

#59
post #27

I always wanted a markdown-like video editor. I want to chop up my videos and make notes about what is in them. Text based document would be so much easier for this than big clunky Premiere.

In the social sciences this is actually a common use case, so some CAQDAS https://en.wikipedia.org/wiki/Computer-assisted_qualitative_... are using that. See a free one here: https://github.com/ccbogel/QualCoder/wiki/09-Coding-audio-an...
Post reply on HN