Adobe demos “photoshop for audio,” lets you edit speech as easily as text

I wonder how much better the rendering would be if the audio track were much longer and the software would have more to learn. I don't mean more words for a 1 to 1 match since it's clearly beyond that (pronouncing words that it didn't see), but voice features that weren't in that short track.

Hypothetical question: say it had access to all the episodes from Key & Peele, would the rendering be better to the point you could basically generate an audio track from a script with intonation and all?

It would be interesting if they offered "voice packages" either online or offline so you could just pass text through it and the output would be a Morgan Freeman narration. You'd have a shop for "Cords" the same as iTunes for songs & apps. Maybe game developers will find that interesting, too. Having access to way more voices than they'd have in real life, and on a budget.

Someone could also save their voices for posterity. Many people listen to recordings of loved ones who passed away to remember them. Saving the voice for new content would be something to think about.

If photoshop would give these results, a lot of industries would go belly up.

Nice marketing line, but it's speech recognition which set the begin/end frame in the sample.

I was expecting either "painting" away defects or actually reconstruction a real TTS by using a small sample.

Copied from my comment on an earlier submission on this:

I don't see how the watermarking they talk about is going to succeed in preventing forgeries.

If they're planning to watermark unedited recordings, you have a huge false positive problem because there are billions of hours of legitimate but unwatermarked audio recordings, and will probably continue to be. You can also get false negatives by tampering with a watermark-capable device to get it to watermark something that wasn't recorded from analog. Or you can rerecord edited audio from an analog source and simply claim that your "genuine" recording is slightly noisy.

If they're planning to watermark edited recordings, someone else can implement the same kind of technology but without the watermarking.

Joaquin Phoenix is now going to narrate all of my audio books.

The comparison to photoshop seems a silly stretch, but

> actually reconstruction a real TTS by using a small sample

it actually did this in the demo, if I understand what you're asking. It created brand-new words, using the speakers own voice, from a tiny sample size. (If we believe the demo.)