11–20 of 164 posts
This looks extremely similar to what often happened with chat implementations in 3 and 3.5 era: GPT world generate it's answer and then go on and generate the next input by the user as well.
The user's voice is vectorized somehow, and the model is predicting a series of vectors and won't have a sense of "self" to let it recognize it's own voice vs the user's.
This problem appeared during pre-release testing and has since been solved post-generation using an output classifier that verifies responses, according to the system card release. It was predictable that someone would spin this into a black mirror-esque clickbait story.
So Open AI has the capability to deep fake any of its users that use the voice chat capability? Yikes.
So Open AI has the capability to deep fake any of its users that use the voice chat capability? Yikes.
So Open AI has the capability to deep fake any of its users that use the voice chat capability? Yikes.
Anyone can clone a voice with access to a couple of seconds of it.
Earlier quoted context omitted.
Anyone can clone a voice with access to a couple of seconds of it.
A couple seconds? Which project does this?
Earlier quoted context omitted.
Anyone can clone a voice with access to a couple of seconds of it.
We'll have to gradually get used to the notion that a person's voice, like so many other things we once thought of as intimately personal, is just a coordinate in a high-dimensional vector space.
Earlier quoted context omitted.
Anyone can clone a voice with access to a couple of seconds of it.
A couple seconds? Which project does this?
I'm sure you could have used google
https://elevenlabs.io/app/voice-lab
https://app.resemble.ai/users/sign_in
https://github.com/neonbjb/tortoise-tts
https://coqui.ai/blog/tts/open_xtts
it was even possible 5 years ago