Ask HN: AI Voice Reverse

#1

Post by loregate » Wed, Dec 06, 2023, 11:34 AM UTC

Would it be possible to reverse a AI generated voice if they spoke themselves[0] instead of using TTS[1]?

Since the AI voice is trained shouldn't a reversing AI also be able to seperate the trained data?

[0] https://github.com/RVC-Project/Retrieval-based-Voice-Conversion-WebUI [1] https://elevenlabs.io/speech-synthesis

Re: Ask HN: AI Voice Reverse

#2

Post by upwardbound » Wed, Dec 06, 2023, 11:38 AM UTC

Should be possible in principle, although you're talking about a lot of R&D work to turn this high-level idea into something practical. What do you see as the advantage of this approach / what use case did you have in mind?

Re: Ask HN: AI Voice Reverse

#3

Post by jruohonen » Wed, Dec 06, 2023, 11:40 AM UTC

Can you elaborate the question?

TTS is just text-to-speech, and there is a huge amount of algorithms and tools for speech-to-text (STT).

Re: Ask HN: AI Voice Reverse

#4

Post by loregate » Wed, Dec 06, 2023, 11:52 AM UTC

jruohonen wrote: post #3

Can you elaborate the question? TTS is just text-to-speech, and there is a huge amount of algorithms and tools for speech-to-text (STT).

With TTS this wouldn't be possible, but I read a news headline[0] and wondered whether you could reverse this back to the kidnapper voice.

[0] https://www.theguardian.com/us-news/2023/jun/14/ai-kidnappin...

Re: Ask HN: AI Voice Reverse

#5

Post by jruohonen » Wed, Dec 06, 2023, 11:59 AM UTC

loregate wrote: post #4

jruohonen wrote: post #3

Can you elaborate the question? TTS is just text-to-speech, and there is a huge amount of algorithms and tools for speech-to-text (STT).

With TTS this wouldn't be possible, but I read a news headline[0] and wondered whether you could reverse this back to the kidnapper voice. [0] https://www.theguardian.com/us-news/2023/jun/14/ai-kidnappin...

What a nasty story, but no, you cannot "reverse" a voice from TTS as the input is just text.

Re: Ask HN: AI Voice Reverse

#6

Post by petercooper » Wed, Dec 06, 2023, 12:01 PM UTC

(I spent too much time to listen to talk radio in the 90s to understand this question at first. It's not about temporal reversal, but trying to reveal the original audio behind an AI enhanced/transcoded voice.)

I think so. There's a whole field of voice biometrics working in this area. I've experimented with such tools and you have to work hard to copy someone's vocabulary, timing, and cadence. If you speak or sing in your normal voice and convert it, there are huge tells, somewhat akin to those used in stylometry to identify the owners of sock accounts (indeed, if someone actually used TTS, it mostly becomes a stylometry problem, unless services like ElevenLabs were to add inaudible watermarks or something).