Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

OpenVoice: Versatile Instant Voice Cloning

arxiv.org

Post reply on HN
Print view View original

91–100 of 207 posts

Re: OpenVoice: Versatile Instant Voice Cloning

#91

Post by abetusk »

paradox460 wrote: post #67
Lerc wrote: post #52

Earlier quoted context omitted.

Unifying a voice in tutorial videos so that the difference in voice does not distract the learner. Auto non-toxic rephrasing of online chat in video games, let people hear their voice but paraphrase what they said in a manner that doesn't turn the platform into a cesspit. Cloning your own voice so that you can turn a script into audio without 50 takes and then having to remove a million Ums and errs.

Real time translation in the speakers own voice.

This is an exceptional use case!

Mr Beast talked about translating his videos to other languages to get more reach. This can be done for people with limited budget or just in general so people can watch videos without needing subtitles.

I wouldn't be surprised if we saw this incorporated into YT in the near future.

Re: OpenVoice: Versatile Instant Voice Cloning

#92

Post by pclmulqdq »

z991 wrote: post #75

I commend the authors on making this easy to try! However it doesn't work very well for me for general voice cloning. I read the first paragraph of the wikipedia page on books and had it generate the next sentence. It's obviously computer generated to my ear. Audio sample: https://storage.googleapis.com/dalle-party/sample.mp3 Cloned voice (converted to mp3): https://storage.googleapis.com/dalle-party/output_en_defaul…

Looking at the website and the examples, it's pretty clearly set up to make stylized anime voices.

Re: OpenVoice: Versatile Instant Voice Cloning

#93

Post by fbdab103 »

z991 wrote: post #75

I commend the authors on making this easy to try! However it doesn't work very well for me for general voice cloning. I read the first paragraph of the wikipedia page on books and had it generate the next sentence. It's obviously computer generated to my ear. Audio sample: https://storage.googleapis.com/dalle-party/sample.mp3 Cloned voice (converted to mp3): https://storage.googleapis.com/dalle-party/output_en_defaul…

Thanks for the real example. Sounded quite generated to my ear as well. Wonder if it can do any better with more source material.

Re: OpenVoice: Versatile Instant Voice Cloning

#94

Post by fbdab103 »

iAkashPaul wrote: post #8

That watermark detection rights at the end is real sus

At least right now, there is a literal add_watermark function, so probably easy enough to remove that surface level. Unless they added something cute to the training data to poison the well.

https://github.com/myshell-ai/OpenVoice/blob/a33963c3d764bee...

Re: OpenVoice: Versatile Instant Voice Cloning

#95

Post by peddling-brink »

dotancohen wrote: post #84
peddling-brink wrote: post #2

GitHub: https://github.com/myshell-ai/OpenVoice Checkpoint: hxxps://myshell-public-repo-hosting.s3.amazonaws.com/checkpoints_1226.zip (Checkpoint link defanged because I’m allergic to direct links to zip files hosted on Amazon. Nor have I reviewed what the file contains.)

What does allergic mean in this context?

That file could contain anything. I don't know the authors or have any idea of their reputation.

I wanted to expose it so people didn't have to comb through the github, but decided to make it unclickable out of an abundance of caution. This appears to have offended people.

I would not have hesitated to link to hugging face. That is a known quantity.

Re: OpenVoice: Versatile Instant Voice Cloning

#97

Post by ben_w »

jokethrowaway wrote: post #90
ben_w wrote: post #76

Earlier quoted context omitted.

I don't know if GDPR (or any of its cousins) applies to you, but this kind of thing sounds exactly like the sort of thing it's supposed to outlaw.

How? Your bank stores personal data covered by gdpr but enabling crappy secure systems is not the domain of gdpr. Most likely this is caused by SCA another European directive that ruined our lives with extra security hoops (for payment providers) for little extra security - or even worse in case of voice password or security questions

A person's voice is, I believe, personal data.

> Processing personal data is generally prohibited, unless it is expressly allowed by law, or the data subject has consented to the processing

- https://gdpr-info.eu/issues/consent/

Re: OpenVoice: Versatile Instant Voice Cloning

#98

Post by smt88 »

diggan wrote: post #60
smt88 wrote: post #49

Earlier quoted context omitted.

> * the notion that anything digital can be easily faked seeps into the wider consciousness the better. Trust nothing.* This is a society-destroying idea. Most of us, especially younger people, only know how to vote, where there are wars, or even what our parents are doing by using digital media. If digital media becomes untrustworthy, everyone will live in a warped and fragile alternate reality that no one can agree…

> Trust nothing > This is a society-destroying idea. Believe it or not, this is how much of the population saw The Internet when it first came close to being mainstream. Everyone and their mother said "Don't believe anything you read on the cybernet", which ended up ironic as everyone and their mother ended up being the ones to believe anything on the cybernet anyways. > everyone will live in a warped and fragile alt…

It's vastly different than today because today (or at least a few years ago), I could trust videos and voices delivered digitally. I can't do that anymore.

Re: OpenVoice: Versatile Instant Voice Cloning

#99

Post by cjbprime »

gpm wrote: post #86
cjbprime wrote: post #83

Earlier quoted context omitted.

And not by opensource.org's definition, which prohibits use restrictions. It's not reasonable to act like OP is being idiosyncratic when this fails to meet the protected definition of "open source".

The term "open source" is not protected, the OSI (opensource.org) attempted and failed to acquire a trademark on that term.

Fair enough. Is there any shared definition of "open source" which permits use restrictions, then?

Re: OpenVoice: Versatile Instant Voice Cloning

#100

Post by satvikpendem »

bbor wrote: post #81
c0pium wrote: post #68

Earlier quoted context omitted.

Careful, you’re saying the quiet part out loud; freedom is about profiting off the uncompensated work of others.

Well ultimately we all need to eat. If someone wants to be compensated in today’s society, they either need to join a gift-based sub-society (see: OSS foundations, NGOs in general) or sell something. Trust me, I totally agree that freedom of information should be a completely separate concern from resource allocation EDIT: I guess there’s a third option, “work another job and use OSS on your off hours”. Which feels……

To your last point, people pay what the market will bear. In this case, it's free, so don't be surprised that if you give something away for free that people, well, take it for free. Importance has nothing to do with it.
Post reply on HN