Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Audiobox: Meta's new foundation research model for audio generation

ai.meta.com

Post reply on HN
Print view View original

11–20 of 90 posts

Re: Audiobox: Meta's new foundation research model for audio generation

#11

Post by 9dev »

logicchains wrote: post #8
9dev wrote: post #6

If I shutdown every voice other than the optimist's one in my head, this, along with other recent AI research, will mark the advent of never-seen-before role play game possibilities. If the current pace of progress continues, we'll see games with complete narrative freedom for players, where you aren't limited to pre-written answers anymore, but can actually talk to in-game characters with your actual voice, goals, a…

>If the current pace of progress continues, we'll see games with complete narrative freedom for players, where you aren't limited to pre-written answers anymore, but can actually talk to in-game characters with your actual voice, goals, and motivations. And those virtual conversation participants can talk back to you, react to your words and actions in a believable, fully immersive manner. That's a dream come true fo…

I'd imagine everyone else has an agenda, a schedule and ordinary life which is pre-written, so the game actually wants to tell an interesting story, but as a player, you can choose to listen or just do all shenanigans in the context of the game you can come up with. If you want to be a farmer instead of defeating the dark overlord, so be it -- until the world ends because the overload has achieved his goals with no resistance, or maybe someone else becomes a hero instead. ...Gosh, the more I think about it the more awesome it gets.

Edit: just one more! Imagine actually having to complete quests in a given amount of time, because the rest of the world continues to revolve. People being mad at you because you left their children to die in the dungeon after arriving a day too late, because you were busy running an errand for someone else.

Re: Audiobox: Meta's new foundation research model for audio generation

#12

Post by CuriouslyC »

spaceman_2020 wrote: post #10
9dev wrote: post #6

If I shutdown every voice other than the optimist's one in my head, this, along with other recent AI research, will mark the advent of never-seen-before role play game possibilities. If the current pace of progress continues, we'll see games with complete narrative freedom for players, where you aren't limited to pre-written answers anymore, but can actually talk to in-game characters with your actual voice, goals, a…

I’m an amateur music producer and vocals are by far the toughest part of making music. I have to find a singer, convince them to work with me (I am an amateur and not particularly good tbh), and book studio space because its very tough to get a clean recording at home. I’m hoping that like digital instruments, I’ll be able to splice in digital voices instead of finding singers.

Save your money and record at home under a blanket.

Re: Audiobox: Meta's new foundation research model for audio generation

#13

Post by novolunt »

I think that for artificial intelligence to become like humans, it should be treated under the same conditions as natural humans. It should be able to see the surrounding environment, listen to the surrounding sounds, smell the surrounding smells, and taste the surrounding food. It should be given Parents and relatives should be given their own partners and their own country. In this way, the artificial intelligence trained in the environment will naturally be more like human beings and have their own emotions.

Re: Audiobox: Meta's new foundation research model for audio generation

#15

Post by grumpymouse »

spaceman_2020 wrote: post #10
9dev wrote: post #6

If I shutdown every voice other than the optimist's one in my head, this, along with other recent AI research, will mark the advent of never-seen-before role play game possibilities. If the current pace of progress continues, we'll see games with complete narrative freedom for players, where you aren't limited to pre-written answers anymore, but can actually talk to in-game characters with your actual voice, goals, a…

I’m an amateur music producer and vocals are by far the toughest part of making music. I have to find a singer, convince them to work with me (I am an amateur and not particularly good tbh), and book studio space because its very tough to get a clean recording at home. I’m hoping that like digital instruments, I’ll be able to splice in digital voices instead of finding singers.

This is already somewhat available (check out Dreamtomics Synthesizer V and the voices like Solaris etc)

Re: Audiobox: Meta's new foundation research model for audio generation

#16

Post by maroonblazer »

> We’re inviting researchers and institutions who have been previously involved in speech research, and who want to pursue responsibility and safety research on the latest Audiobox models, to apply.

It's not clear as to what the expected outcome of this 'responsibility and safety research' effort is. Is the idea to nerf the tech such that it can't be used for morally/ethically nefarious purposes? If so, then is the "speech research" community the group best fit to do that work?

Re: Audiobox: Meta's new foundation research model for audio generation

#17

Post by anonylizard »

9dev wrote: post #6

If I shutdown every voice other than the optimist's one in my head, this, along with other recent AI research, will mark the advent of never-seen-before role play game possibilities. If the current pace of progress continues, we'll see games with complete narrative freedom for players, where you aren't limited to pre-written answers anymore, but can actually talk to in-game characters with your actual voice, goals, a…

It'll affect linear entertainment far before it impacts games seriously (Especially the 'full immersive' games where you chat with AI agents)

AI is still too expensive and performance intensive to run in games cost effectively, and truly powerful AI is probably another 10-100x cost increase.

On the other hand, novels will be rapidly replaced by visual novels. The cost of having a novel fully illustrated and voiced will go down 1000x. A high quality illustration used to cost $500-$1000 (A day's work from a high-tier commercial artist), soon it will be about $0.5. I'm not counting in the author's time to prompt the images, because it would have costed them way more time to communicate with the illustrator anyways.

The entire boundary between novels, comics, cartoons etc will blur. Like if a newly written Harry Potter can have thousands of illustrations set in Hogwarts and be fully voiced, the standards for a movie adaptation will be astronomically high, which will in turn drive AI use in movie production just to keep up.

Re: Audiobox: Meta's new foundation research model for audio generation

#18

Post by dragonwriter »

anonylizard wrote: post #17
9dev wrote: post #6

If I shutdown every voice other than the optimist's one in my head, this, along with other recent AI research, will mark the advent of never-seen-before role play game possibilities. If the current pace of progress continues, we'll see games with complete narrative freedom for players, where you aren't limited to pre-written answers anymore, but can actually talk to in-game characters with your actual voice, goals, a…

It'll affect linear entertainment far before it impacts games seriously (Especially the 'full immersive' games where you chat with AI agents) AI is still too expensive and performance intensive to run in games cost effectively, and truly powerful AI is probably another 10-100x cost increase. On the other hand, novels will be rapidly replaced by visual novels. The cost of having a novel fully illustrated and voiced wi…

> It'll affect linear entertainment far before it impacts games seriously

Maybe. But I think you make the mistake of considering games that combine existung AAA features + AI as where it will first impact games, where I think it will first make its mark in games that don’t use hardware heavily for 3d rendering by opening up new modes of gaming.

> novels will be rapidly replaced by visual novels. The cost of having a novel fully illustrated and voiced will go down 1000x.

The cost if having art made isn't the only reason novels aren't fully illustrated now, and AI doesn't impact any of the others.

Re: Audiobox: Meta's new foundation research model for audio generation

#19

Post by EligibleDecoy »

CuriouslyC wrote: post #12
spaceman_2020 wrote: post #10

Earlier quoted context omitted.

I’m an amateur music producer and vocals are by far the toughest part of making music. I have to find a singer, convince them to work with me (I am an amateur and not particularly good tbh), and book studio space because its very tough to get a clean recording at home. I’m hoping that like digital instruments, I’ll be able to splice in digital voices instead of finding singers.

Save your money and record at home under a blanket.

Closet full of jackets works too. That’s what a lot of podcasters do when traveling

Re: Audiobox: Meta's new foundation research model for audio generation

#20

Post by j45 »

CuriouslyC wrote: post #12
spaceman_2020 wrote: post #10

Earlier quoted context omitted.

I’m an amateur music producer and vocals are by far the toughest part of making music. I have to find a singer, convince them to work with me (I am an amateur and not particularly good tbh), and book studio space because its very tough to get a clean recording at home. I’m hoping that like digital instruments, I’ll be able to splice in digital voices instead of finding singers.

Save your money and record at home under a blanket.

Layered towels are surprisingly capable too
Post reply on HN