Live data from Hacker News

Voicebox: Generative AI model for speech that generalizes across tasks

ai.facebook.com

101–110 of 128 posts

Re: Voicebox: Generative AI model for speech that generalizes across tasks

#101

Earlier quoted context omitted.

There’s also a different possible take on this. Voice acting seems to be really bad career, so eliminating that job is desired, if you can deliver same quality/better product for cheaper to customers, without requiring employees to be underpaid. I know it sucks for people in that industry, but technical progress always eliminates jobs. Calculator used to be a job, now it’s a device.

Caveat though: > if you can deliver same quality/better product for cheaper to customers, without requiring employees to be underpaid. This almost never happens. Cheaper? Yes. Same or better quality? Not a chance. Automated solutions tend to allow reducing quality way below what humans workers would want to do, or even could cheaply and reliably (i.e. doing worse job than a careless one takes actual effort/skill). Li…

I think you’re romanticizing quality of human work. World is full of employees who couldn’t care less and will take the path of least resistance to get a paycheck. Removing humans from the loop often directly leads to improved quality. Of course, those are same humans that make decisions about how to use automation, so it’s not a panacea.

There’s tons of things where quality improved immensely due to automation. Engines, drugs, batteries, just to name few.

Re: Voicebox: Generative AI model for speech that generalizes across tasks

#102
post #54

Earlier quoted context omitted.

Not releasing code or weights under the false pretense of misuse.

No, they are referring to the end of the video, where they have a “surprise twist” that the video narration was autogenerated and not a real person.

I mean that wasn’t even slightly non-obvious.

Re: Voicebox: Generative AI model for speech that generalizes across tasks

#103

That little stinger at the end was not as surprising as they thought it was :P It's very cool tech, but it's far from transparent. It has a very obvious "autotune" like sound to it that jumps right out. when they edited that one word it was obvious it had been edited. Again, super cool tech, just not going to replace voice actors or anything.

> It has a very obvious "autotune" To me it has a very obvious "Hindi is my native language" accent. I mean after literally the first sentence: "The research team at Meta is excited to share our work..." . Ouch. The "our work": just ouch. I was wondering why it wasn't a native english speaker presenting the video when the video is precisely about generating speech. The first seven seconds are particularly bad. Don't…

The accent was part of the show. They demonstrated how to create an accent from scratch: sample a voice in the accent's original language (हिंदी, français) and then have that voice read text in the target language (English). Voilà, accent.

Re: Voicebox: Generative AI model for speech that generalizes across tasks

#105

Earlier quoted context omitted.

Caveat though: > if you can deliver same quality/better product for cheaper to customers, without requiring employees to be underpaid. This almost never happens. Cheaper? Yes. Same or better quality? Not a chance. Automated solutions tend to allow reducing quality way below what humans workers would want to do, or even could cheaply and reliably (i.e. doing worse job than a careless one takes actual effort/skill). Li…

I think you’re romanticizing quality of human work. World is full of employees who couldn’t care less and will take the path of least resistance to get a paycheck. Removing humans from the loop often directly leads to improved quality. Of course, those are same humans that make decisions about how to use automation, so it’s not a panacea. There’s tons of things where quality improved immensely due to automation. Engi…

I'm not romanticizing quality of human work. I'm not claiming people give more shit than it seems. I'm claiming that with humans doing the work, quality can only get so low[0] - and automation lets you punch through that floor, achieving much lower quality standards.

Or, put another way:

> Removing humans from the loop often directly leads to improved quality.

Yes, but improved quality for the same price means leaving money on the table, so approximately every business immediately drops quality to the baseline and pockets the difference - and from that point on, competition will optimize the quality further down.

> Of course, those are same humans that make decisions about how to use automation, so it’s not a panacea.

It's not the humans being replaced that make that decision - it's their bosses, who rent or own the automation, that make this call.

> There’s tons of things where quality improved immensely due to automation. Engines, drugs, batteries, just to name few.

Sorta, kinda. In areas with strict regulatory standards? Yes. In areas where automation improves both cost and quality, and the competitive pressure isn't very strong? Sure. With products not yet commoditized? Often enough. When it enables market segmentation? Of course.

But then you have commodities, or automation replacing people directly on the "critical path" of value chain. That's where products and services go to shit. Bonus points if automation allows to engage customers in "self-service" - i.e. outsource work to the customers.

Case in point: automated checkout machines in stores. They reduce jobs, but in theory, they could reduce queues, increase throughput, and make shopping more pleasant - win-win deal for everyone - even the cashiers could be shifted to oversight/support jobs, ensuring increased throughput and more profit for the store, for the same number of employees.

In practice, it turns out the optimal setup for the store is deploying way too few machines, and instead of having dedicated employees for oversight/support of the machines, those responsibilities are just tacked on to the workload of the existing (reduced) work force. As a result, queues are longer, customers are frustrated, overall shopping experience is shit - but the store knows perfectly well the customers will endure it anyway[1].

The market optimizes for profits, not quality or happiness. It's not just greed - money is the lifeblood of companies, and without it they die. As a result, however, competitive pressure ensures that any value or virtue that can be sacrificed to improve profits, will be sacrificed. Those who refuse get outcompeted by those who make that sacrifice. The ratchet turns, and the sacrificed value is lost forever.

--

[0] - There are many limiting factors. If the business is pushing down quality of human work too hard, they'll eventually have to deal with employee frustration, or hit limits imposed by OSHA or labor law, or just a soft limit where producing a fixed amount of goods/services costs X in labor, and there's no point in trying to save 0.1X on quality if it requires workers to put effort, which will make them produce less per unit of time, or increase variability of output, or both.

[1] - There are many reasons for it, including customers being price sensitive to the point of irrationality, usually valuing their free time at 0, and being easy to confuse with constant churn of deals. Stores also know that frustration is a fleeting feeling, while well-crafted product selection makes a store/chain sticky. Notice how automated checkout machines tend to proliferate in grocery stores and drogeries, and are seldom seen anywhere else: that's because they work best in places where customers are susceptible to factors I described earlier - and thus will endure bad experience and still come back for more. It's not like there are alternatives - competitive pressure ensures all competitors offer equally shitty experience. The ratchet made a turn, there is no going back.

Re: Voicebox: Generative AI model for speech that generalizes across tasks

#106
post #56
post #9

I am mostly excited for cheaper audiobooks with consistent voices for different characters.

This is a huge issue in the voice acting community. Been frequent recent discussions over at https://www.reddit.com/r/VoiceActing/ . For what its worth, most of the cost of audiobooks doesn't come from paying talent. For intermediate level actors, the going rate is around $50-$100 per finished hour (PFH) and experienced actors it can be around $250-$300. This page does a decent job of laying out pay structures for au…

Sounds like the voice acting community is going to join the taxi driver community in the near future.

Re: Voicebox: Generative AI model for speech that generalizes across tasks

#107

Earlier quoted context omitted.

There’s also a different possible take on this. Voice acting seems to be really bad career, so eliminating that job is desired, if you can deliver same quality/better product for cheaper to customers, without requiring employees to be underpaid. I know it sucks for people in that industry, but technical progress always eliminates jobs. Calculator used to be a job, now it’s a device.

Caveat though: > if you can deliver same quality/better product for cheaper to customers, without requiring employees to be underpaid. This almost never happens. Cheaper? Yes. Same or better quality? Not a chance. Automated solutions tend to allow reducing quality way below what humans workers would want to do, or even could cheaply and reliably (i.e. doing worse job than a careless one takes actual effort/skill). Li…

I really wonder whether you have seen Midjourney, Stable Diffusion and ChatGPT or any other the recent trendy AI things.

You can't find an illustrator who could "cheaply and reliably" do illustrations at Midjourney's level. You just can't. If you could you would have been the biggest contractor company in the world long time ago.

Re: Voicebox: Generative AI model for speech that generalizes across tasks

#108

Earlier quoted context omitted.

I think you’re romanticizing quality of human work. World is full of employees who couldn’t care less and will take the path of least resistance to get a paycheck. Removing humans from the loop often directly leads to improved quality. Of course, those are same humans that make decisions about how to use automation, so it’s not a panacea. There’s tons of things where quality improved immensely due to automation. Engi…

I'm not romanticizing quality of human work. I'm not claiming people give more shit than it seems. I'm claiming that with humans doing the work, quality can only get so low[0] - and automation lets you punch through that floor, achieving much lower quality standards. Or, put another way: > Removing humans from the loop often directly leads to improved quality. Yes, but improved quality for the same price means leavin…

> Case in point: automated checkout machines in stores.

I don't know where you live, but I've never seen automated checkout machines. I only have seen self checkout machines. It requires the customer to do the cashier' job and that's all.

The only reason it's not good is that it's not automated enough (if at all -- for me the self checkout machine is literally zero automation more than a regular cashier)

Post reply on HN