Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Serverless Video Transcription inspired by Cyberpunk 2077

github.com

Post reply on HN
Print view View original

11–20 of 84 posts

Re: Serverless Video Transcription inspired by Cyberpunk 2077

#14

Post by oslem »

photoGrant wrote: post #8
totetsu wrote: post #7

>Matching faces to voices relies on simple co-occurence heuristic, and will not work in certain scenarios (e.g. if the whole conversation between two people is recorded from a single angle) This seems like the really hard part. maybe if there was a way to find the time lips moves for a face. or guess gender and age of both face and voice.. or If the audio is a stereo mix, using relative position

There's this that can differentiate speakers https://github.com/CorentinJ/Real-Time-Voice-Cloning

I think you are referring to GE2E [1], which is the speaker identification model used in that project.

[1] https://arxiv.org/abs/1710.10467

Re: Serverless Video Transcription inspired by Cyberpunk 2077

#18

Post by melony »

oslem wrote: post #14
photoGrant wrote: post #8

Earlier quoted context omitted.

There's this that can differentiate speakers https://github.com/CorentinJ/Real-Time-Voice-Cloning

I think you are referring to GE2E [1], which is the speaker identification model used in that project. [1] https://arxiv.org/abs/1710.10467

That's from an eternity ago. Speaker diarization has come a long way.
Post reply on HN