Live data from Hacker News

Weird A.I. Yankovic: a cursed deep dive into the world of voice cloning

waxy.org

111–120 of 207 posts

Re: Weird A.I. Yankovic: a cursed deep dive into the world of voice cloning

#112

This article only covers the musical aspects of AI voice cloning, but there's another dynamic to AI voice cloning that's more complicated: replacing general voice actors in movies/video games/anime (example: https://www.axios.com/2023/07/24/ai-voice-actors-victoria-at... ) Unlike musicians who can't be replaced without significant postprocessing, have enough money to not be impacted by competition, and have legal mus…

Interesting note: many Vocaloids (most notably Hatsune Miku) are sampled from voice actors rather than singers.

Singers didn't want software clones, but voices actors are fair game.

Re: Weird A.I. Yankovic: a cursed deep dive into the world of voice cloning

#113

This article only covers the musical aspects of AI voice cloning, but there's another dynamic to AI voice cloning that's more complicated: replacing general voice actors in movies/video games/anime (example: https://www.axios.com/2023/07/24/ai-voice-actors-victoria-at... ) Unlike musicians who can't be replaced without significant postprocessing, have enough money to not be impacted by competition, and have legal mus…

What I find interesting is this aspect that eventually, these companies will hire some college kids who needs a couple thousand bucks and a free pizza. Have them read the right scripts. Sign the right 'give everything away' contract and just forever use their voice. Or do it sneaky. Have a voice assistant and in your ToS 'we can use a copy of your voice for anything'. The existing voice actors will be just out of wor…

They don't need that - they already have enough data to generate plausibly human voices that don't sound like anyone in particular.

Voice cloning is a special case, these models are equally good at making new voices.

Re: Weird A.I. Yankovic: a cursed deep dive into the world of voice cloning

#115

This article only covers the musical aspects of AI voice cloning, but there's another dynamic to AI voice cloning that's more complicated: replacing general voice actors in movies/video games/anime (example: https://www.axios.com/2023/07/24/ai-voice-actors-victoria-at... ) Unlike musicians who can't be replaced without significant postprocessing, have enough money to not be impacted by competition, and have legal mus…

I'd be interested. Most likey you'd see a lot of people saying that somehow getting rid of voice actors is good for "progress". Whatever that means. Random aside someone really needs to make a hackernews that focuses more on game development and other arts so blog posts like your talking about would have a proper community to discuss them with.

Replacing voice actors with text-to-speech is good because it lets you do things voice actors can't:

* Create dynamic new voice lines at runtime, for example game characters reacting to new situations.

* Operate at a scale that's infeasible for humans, for example turning every ebook into an audiobook.

Re: Weird A.I. Yankovic: a cursed deep dive into the world of voice cloning

#116

Earlier quoted context omitted.

Voice acting is more than just talking into a microphone. It's a skill not limited to the quality of voice.

A lot of skills are not simple, but computers have taken over them anyways. For example, financial bookkeeping is not just writing and storing the books, it's a professional skill with many tricks to learn. However, databases and spreadsheets have taken the major part from those jobs. Same could be said about programmers who learned the skill of programming Assembly language. Or performing -- vinyl records and CDs ha…

[deleted]

Re: Weird A.I. Yankovic: a cursed deep dive into the world of voice cloning

#117
post #4

My absolute favorite application of this tech so far is The Beach Boys singing 'Hurt'. It's the first time I seriously didn't notice any artifacts, and it just works so well even though it really shouldn't. Enjoy: https://youtu.be/gmNSFqyg_Z8

This account is one of the absolute top tier creators for weird music mixes. The recent deep faking stuff has been shockingly good. I think this is a good example of an "acceptable" use of AI, as long as artists/composers etc rights are all settled.

its always more fun when its a real group of talented people being silly, but I'd listen to an album of weird mashup like this for sure.

Re: Weird A.I. Yankovic: a cursed deep dive into the world of voice cloning

#118

The sampled voices sound neither like Michael Jackson nor Weird Al. A good effort, but a professional impersonator could likely do better on either front.

I know what you mean. Its more noticeable (imo) on the Michael one.... but its definitely in there. I think the pitch correction is to blame for a bit of the weirdness.

Re: Weird A.I. Yankovic: a cursed deep dive into the world of voice cloning

#119

Earlier quoted context omitted.

I'd be interested. Most likey you'd see a lot of people saying that somehow getting rid of voice actors is good for "progress". Whatever that means. Random aside someone really needs to make a hackernews that focuses more on game development and other arts so blog posts like your talking about would have a proper community to discuss them with.

Replacing voice actors with text-to-speech is good because it lets you do things voice actors can't: * Create dynamic new voice lines at runtime, for example game characters reacting to new situations. * Operate at a scale that's infeasible for humans, for example turning every ebook into an audiobook.

Which are, in my view, really minor advantages when compared to the disadvantages. Not only in terms of putting people out of work, but in terms of increasing the artifice of the world around us and decreasing its humanity.

Re: Weird A.I. Yankovic: a cursed deep dive into the world of voice cloning

#120

Earlier quoted context omitted.

Replacing voice actors with text-to-speech is good because it lets you do things voice actors can't: * Create dynamic new voice lines at runtime, for example game characters reacting to new situations. * Operate at a scale that's infeasible for humans, for example turning every ebook into an audiobook.

Which are, in my view, really minor advantages when compared to the disadvantages. Not only in terms of putting people out of work, but in terms of increasing the artifice of the world around us and decreasing its humanity.

"putting people out of work" by automating jobs is also a good thing.

The amount of stuff humans can accomplish is strongly limited by the supply of workers. Automating one job frees them up to do other things.

Post reply on HN