Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

OpenVoice: Versatile Instant Voice Cloning

arxiv.org

Post reply on HN
Print view View original

61–70 of 207 posts

Re: OpenVoice: Versatile Instant Voice Cloning

#61

Post by qwertox »

diggan wrote: post #55
qwertox wrote: post #51

And suddenly it becomes a bit weird: https://docs.myshell.ai/tokenomics Tokenomics Disclaimer: MyShell is currently in the testing phase, and the content of the whitepaper may be subject to change in the future. $SHELL is the token used for user incentive, governance and in-app utility. The total supply of $SHELL is 1,000,000,000

And luckily, this submission seems to be about the paper/technology OpenVoice, not about the company MyShell (whatever that is).

License[0]: This repository is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License, which prohibits commercial usage. MyShell reserves the ability to detect whether an audio is generated by OpenVoice, no matter whether the watermark is added or not.

[0] https://github.com/myshell-ai/OpenVoice

Re: OpenVoice: Versatile Instant Voice Cloning

#62

Post by grayhatter »

jamespattn wrote: post #46

Can someone give me a practical use case where this adds a net benefit to society?

No.

The real answer is yes, I could probably come up with some contrived examples, like I lost my voice in a freak LLM accident and now want to clone my old voice. But this doesn't (you don't?) really need a net benefit reason to figure it out and publish it. Because why? I assume, because "this shouldn't exist!" which is just a more palatable wa to phrase "won't someone think of the children".

Society doesn't benefit from ignorance, so given it can exist, what's the problem with it existing? Why does it need a practical reason? Because people will do bad things with it? Duh, but I'd rather everyone know then just the bad guys

Re: OpenVoice: Versatile Instant Voice Cloning

#63

Post by abetusk »

jamespattn wrote: post #46

Can someone give me a practical use case where this adds a net benefit to society?

James Earl Jones, presumably hedging against his eventual demise, has allowed his voice to be used for things like the Star Wars franchise [0].

Small, independent film makers can now use a skeleton crew to voice parts.

I can't imagine it would be anything other than a niche service, but hearing the voice and, potentially, interacting with a chatbot/LLM with the voice of a passed love one.

This is off the top of my head. I would also guess that this technology is a stepping stone for other weird, interesting and profoundly helpful uses.

[0] https://www.theverge.com/2022/9/24/23370097/darth-vader-jame...

Re: OpenVoice: Versatile Instant Voice Cloning

#64

Post by grayhatter »

Lerc wrote: post #52
jamespattn wrote: post #46

Can someone give me a practical use case where this adds a net benefit to society?

Unifying a voice in tutorial videos so that the difference in voice does not distract the learner. Auto non-toxic rephrasing of online chat in video games, let people hear their voice but paraphrase what they said in a manner that doesn't turn the platform into a cesspit. Cloning your own voice so that you can turn a script into audio without 50 takes and then having to remove a million Ums and errs.

> Auto non-toxic rephrasing of online chat in video games, let people hear their voice but paraphrase what they said in a manner that doesn't turn the platform into a cesspit.

that feels very orwellian

Re: OpenVoice: Versatile Instant Voice Cloning

#65

Post by stale2002 »

jamespattn wrote: post #46

Can someone give me a practical use case where this adds a net benefit to society?

Well we could just look at the obvious and existing use cases for text to speech stuff.

Alexa, siri, and similar, are all common place.

Another huge usecase would be anything to do with voice acting. Either in video games, cartoons, or the like.

This would completely democratize voice acting material, and would empower anyone to be able to do this for cheap.

Re: OpenVoice: Versatile Instant Voice Cloning

#66

Post by peddling-brink »

crazysim wrote: post #23
peddling-brink wrote: post #2

GitHub: https://github.com/myshell-ai/OpenVoice Checkpoint: hxxps://myshell-public-repo-hosting.s3.amazonaws.com/checkpoints_1226.zip (Checkpoint link defanged because I’m allergic to direct links to zip files hosted on Amazon. Nor have I reviewed what the file contains.)

Thanks for the link to the repo. It's very useful. As for the checkpoint, I'm not allergic and I don't do security theater: https://github.com/myshell-ai/OpenVoice?tab=readme-ov-file#i... links to https://myshell-public-repo-hosting.s3.amazonaws.com/checkpo...

Why do you call that security theater? I found and provided the information, but didn’t make it clickable. Anyone can decide for themselves to navigate there.

Your comment comes off as passive aggressive.

Re: OpenVoice: Versatile Instant Voice Cloning

#67

Post by paradox460 »

Lerc wrote: post #52
jamespattn wrote: post #46

Can someone give me a practical use case where this adds a net benefit to society?

Unifying a voice in tutorial videos so that the difference in voice does not distract the learner. Auto non-toxic rephrasing of online chat in video games, let people hear their voice but paraphrase what they said in a manner that doesn't turn the platform into a cesspit. Cloning your own voice so that you can turn a script into audio without 50 takes and then having to remove a million Ums and errs.

Real time translation in the speakers own voice.

Re: OpenVoice: Versatile Instant Voice Cloning

#68

Post by c0pium »

bbor wrote: post #34
DandyDev wrote: post #7

Earlier quoted context omitted.

It is open, just not by your definition. You can view, use and modify the code to your hearts content. Sounds pretty open to me!

Well… “use” isn’t exactly free, this the complaint. On a scale of free to not free, “cannot use this for my work” is a pretty big jump to the latter end IMO

Careful, you’re saying the quiet part out loud; freedom is about profiting off the uncompensated work of others.

Re: OpenVoice: Versatile Instant Voice Cloning

#69

Post by dqv »

jamespattn wrote: post #46

Can someone give me a practical use case where this adds a net benefit to society?

If you've ever done voice prompt recordings for a phone system, voice cloning would be super helpful for doing one off tweaks, especially if you have to record a bunch. Instead of rerecording 20 messages, which can sometimes take hours, you can use a clone of your own voice to make the necessary modifications. My friend does a lot of recordings as part of his job and when I showed him the Adobe voice editing preview he got really excited. It has the potential to make tweaks a lot easier, less time consuming, and reduce voice strain.

Re: OpenVoice: Versatile Instant Voice Cloning

#70

Post by treetalker »

paradox460 wrote: post #67
Lerc wrote: post #52

Earlier quoted context omitted.

Unifying a voice in tutorial videos so that the difference in voice does not distract the learner. Auto non-toxic rephrasing of online chat in video games, let people hear their voice but paraphrase what they said in a manner that doesn't turn the platform into a cesspit. Cloning your own voice so that you can turn a script into audio without 50 takes and then having to remove a million Ums and errs.

Real time translation in the speakers own voice.

While listening to the examples given, I noted the cross-language ones. I’m eager to improve my accents in my nonnative languages by cloning my voice and comparing recordings of how I do sound with how I would sound as a native speaker!
Post reply on HN