Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Audiobox: Meta's new foundation research model for audio generation

ai.meta.com

Post reply on HN
Print view View original

61–70 of 90 posts

Re: Audiobox: Meta's new foundation research model for audio generation

#61

Post by tomduncalf »

spaceman_2020 wrote: post #10
9dev wrote: post #6

If I shutdown every voice other than the optimist's one in my head, this, along with other recent AI research, will mark the advent of never-seen-before role play game possibilities. If the current pace of progress continues, we'll see games with complete narrative freedom for players, where you aren't limited to pre-written answers anymore, but can actually talk to in-game characters with your actual voice, goals, a…

I’m an amateur music producer and vocals are by far the toughest part of making music. I have to find a singer, convince them to work with me (I am an amateur and not particularly good tbh), and book studio space because its very tough to get a clean recording at home. I’m hoping that like digital instruments, I’ll be able to splice in digital voices instead of finding singers.

https://voice-swap.ai/ may be of interest, you can covert your rough singing to use a real singer's voice (apparently! I've not tried it)

Re: Audiobox: Meta's new foundation research model for audio generation

#62

Post by nrjames »

9dev wrote: post #6

If I shutdown every voice other than the optimist's one in my head, this, along with other recent AI research, will mark the advent of never-seen-before role play game possibilities. If the current pace of progress continues, we'll see games with complete narrative freedom for players, where you aren't limited to pre-written answers anymore, but can actually talk to in-game characters with your actual voice, goals, a…

Part of me looks forward to these experiences. A larger part of me already mourns the decline is purely human creativity that they suggest. Perhaps AI models will make the perfect game or music or write the perfect novel. I'm certain they'll be programmed to reproduce the funky jank and humans bring to everything they create. At some level, though, we each have our own story that we want to tell and when there are so many automated voices in the room, it's going to be harder to tell those stories.

Re: Audiobox: Meta's new foundation research model for audio generation

#63

Post by dragonwriter »

chunky1994 wrote: post #35
9dev wrote: post #6

If I shutdown every voice other than the optimist's one in my head, this, along with other recent AI research, will mark the advent of never-seen-before role play game possibilities. If the current pace of progress continues, we'll see games with complete narrative freedom for players, where you aren't limited to pre-written answers anymore, but can actually talk to in-game characters with your actual voice, goals, a…

I used to be an LLM until I took an arrow to the knee. Aside from the joke, I think the barrier would definitely reduce and in-game characters would be contextually far more aware but how do you enforce plot progression in such a truly open world? Can you control the boundary of LLM expression?

> but how do you enforce plot progression in such a truly open world?

I'd imagine a mixture of general prompting/training the LLM on techniques like those used for plot progressiom by human game masters in TTRPGs and guidance via systems tracking progress and injecting contextual prompts based on mechanisms like those used for tracking and guiding plot progression in GM-less/GM-replacement systems (e.g., the Mythic Game Master Emulator) for TTRPGs.

Re: Audiobox: Meta's new foundation research model for audio generation

#64

Post by mmaunder »

beebeepka wrote: post #55
mmaunder wrote: post #49

Earlier quoted context omitted.

Same logic could be applied to Linux by Microsoft in the 90s. In fact, the “It’s for your safety” has been applied to some of the worst things humans have perpetrated including apartheid (which I lived through) and the holocaust. And it’s always those that claim to keep us safe doing the worst. And it continues with perceived dangers providing pretext and moral authority to do bad things.

"If we were to release our kettle and chickens, they would go extinct within a few years." "I just hold on to all the money, 'cause bitches can't be trusted with it. We pool all the kissing money together, see? But if you wanna buy anything, you just talk to the bottom bitch, and then the bottom bitch talks to me. Do you know what I am saying?"

Choose OSS, or put that mouth to work on someone's AI API.

Re: Audiobox: Meta's new foundation research model for audio generation

#65

Post by Pugpugpugs »

s3p wrote: post #41
mmaunder wrote: post #37

I think the release of closed source models right now is a net negative and worth opposing. Right now we’re building a future where the very wealthy and powerful will control access to AI on ethical grounds, while they have uncensored access to the latest and most powerful models. Innovation, high frequency trading, medical breakthroughs, creative output - all of these and more will be enhanced by AI, and you’ll be e…

I mean sure.. but imagine if this were open sourced as is. This is new tech that has barely had time to mature. The possibilities for abuse are endless. I for one am happy that this model isn't being open sourced. This is an excellent way for people to generate all kinds of disturbing and fake audio clips.

Uh yeah, who cares? Give an example of something this audio generator could make that is dangerous.

Re: Audiobox: Meta's new foundation research model for audio generation

#66

Post by QuantumGood »

EligibleDecoy wrote: post #19
CuriouslyC wrote: post #12

Earlier quoted context omitted.

Save your money and record at home under a blanket.

Closet full of jackets works too. That’s what a lot of podcasters do when traveling

They also do pillow forts, e.g. http://PillowFortStudios.com/

Re: Audiobox: Meta's new foundation research model for audio generation

#67

Post by spacemanspiff01 »

9dev wrote: post #11
logicchains wrote: post #8

Earlier quoted context omitted.

>If the current pace of progress continues, we'll see games with complete narrative freedom for players, where you aren't limited to pre-written answers anymore, but can actually talk to in-game characters with your actual voice, goals, and motivations. And those virtual conversation participants can talk back to you, react to your words and actions in a believable, fully immersive manner. That's a dream come true fo…

I'd imagine everyone else has an agenda, a schedule and ordinary life which is pre-written, so the game actually wants to tell an interesting story, but as a player, you can choose to listen or just do all shenanigans in the context of the game you can come up with. If you want to be a farmer instead of defeating the dark overlord, so be it -- until the world ends because the overload has achieved his goals with no r…

What I have been thinking would be really cool and fun to try would be to remake zork with llms, speech to text and text to speech.

I think you might be able to do it with a lot of prompting, and having a database that functions like a wiki for the current and past states of the game world.

If you got really fancy, you could also make it a pseudo MMO where the content of the story you create with a character could be used as the basis for a NPC plotline in other people's worlds, possibly reducing the amount of content needed to be written.

If it got popular you could also use it as a research tool, where you could force some subset of the player population have some interaction, and be able to test and get a dataset for counterfactual reasoning.

The next 5 years will be wild.

Re: Audiobox: Meta's new foundation research model for audio generation

#68

Post by holoduke »

9dev wrote: post #6

If I shutdown every voice other than the optimist's one in my head, this, along with other recent AI research, will mark the advent of never-seen-before role play game possibilities. If the current pace of progress continues, we'll see games with complete narrative freedom for players, where you aren't limited to pre-written answers anymore, but can actually talk to in-game characters with your actual voice, goals, a…

Definitely agree with your last point, but regarding games with endless possibilities. Mm I rather have a game that is created by someone with a clear goalbin mind. One with boundaries. A good single player experience. Like for example Alan wake 2.

Re: Audiobox: Meta's new foundation research model for audio generation

#69

Post by holoduke »

nerdix wrote: post #40
nuz wrote: post #2

VR is gonna get wild in like 5 years if they keep this up

This is why I'm high on the metaverse long term. In ten years, there will be a $500 (or whatever the 2033 inflation adjusted value is) VR headset that blows the Apple Vision Pro out of the water in terms of optics, will run a highly optimized version of the lastest revision of Llama locally (and it will be much better than anything we currently have today), come with wifi 8 (so it will have multigigabit per second re…

In 2040 we will have lenses with 32k displays and gpus with 10 trillion transistors and 1 petabyte of memory. Its hard to predict what you can do with that. The real world would be empty by then.

Re: Audiobox: Meta's new foundation research model for audio generation

#70

Post by holoduke »

How long before someone manages to clone him/herself online and apply for relatively simple gig work. And duplicates than 1000 times. Making millions with simple work. Its almost possible i think. Clone your voice with this, clone your looks by wiring comfyui like sd nodes to your webcam. Everything instructed/orchestrated by some AI agent controlled by chatgpt. Some wiring logic is what you need to make. The only thing you as the real person have to do is answering some critical decisions which are send by a push notification.
Post reply on HN