Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Bark – Text-prompted generative audio model

github.com

Post reply on HN
Print view View original

81–90 of 99 posts

Re: Bark – Text-prompted generative audio model

#81

Post by gmerc »

ttul wrote: post #59
gkucsko wrote: post #23

Hey, one of the Suno founders/creators of Bark here. Thanks for all the comments, we love seeing how we can improve things in the future. At Suno we work on audio foundation models, creating speech, music, sounds effects etc…. Text to speech was a natural playground for us to share with the community and get some feedback. Given that this model is a full GPT model, the text input is merely a guidance and the model ca…

This tech will be used by crooks to automate attacks. Generate the language using GPT-4 and the audio using Bark, and then start making phone calls. Because it’s open source, all you need is GPUs. This is not a criticism. I’m impressed and grateful for the openness. Everyone needs to wake up and recognize that these attacks are coming at us essentially right now.

Nothing stops you from using closed source solutions for that.

Re: Bark – Text-prompted generative audio model

#82

Post by BHSPitMonkey »

CamperBob2 wrote: post #79
gs17 wrote: post #68

Earlier quoted context omitted.

It's open source, and even if it wasn't, it would likely be pretty easy to remove those (not that you would get GPS) from an audio file.

Hmm, I don't know about that. The data rate used by civilian GPS (L1 C/A) is only 50 bps. The symbols are normally spread over a couple MHz of bandwidth to make it possible to recover at levels below the thermal noise floor. I see no reason why the same thing couldn't be done at baseband, adding an imperceptible bit of extra noise to an audio signal. Of course, you wouldn't encode real-time navigation data, but a sma…

The real problem is that bad actors would simply encode some other person's coordinates/metadata into the recordings they produce, and we'll have been trained by then to blindly accept the presence of these markers as strong evidence of guilt.

Re: Bark – Text-prompted generative audio model

#84

Post by MacsHeadroom »

kleer001 wrote: post #36
jdprgm wrote: post #35

It seems like a lot of the entries in TTS are either close sourced saas apps or something like this with limitations on customizing it. It seems clearly inevitable and likely only months away that a high quality unrestricted open source option for things like voice cloning will emerge so i'm not sure why these projects are even really bothering trying to stop it. I think in order for TTS to have its StableDiffusion m…

>> i'm not sure why these projects are even really bothering trying to stop it. CYA aka https://en.wikipedia.org/wiki/Cover_your_ass also it still requires tons of money to run, so it's likely only businesses will do it

It takes about the same resources to run as Stable Diffusion or LLaMA. You don't even need a GPU.

Re: Bark – Text-prompted generative audio model

#85

Post by lynx23 »

ttul wrote: post #59
gkucsko wrote: post #23

Hey, one of the Suno founders/creators of Bark here. Thanks for all the comments, we love seeing how we can improve things in the future. At Suno we work on audio foundation models, creating speech, music, sounds effects etc…. Text to speech was a natural playground for us to share with the community and get some feedback. Given that this model is a full GPT model, the text input is merely a guidance and the model ca…

This tech will be used by crooks to automate attacks. Generate the language using GPT-4 and the audio using Bark, and then start making phone calls. Because it’s open source, all you need is GPUs. This is not a criticism. I’m impressed and grateful for the openness. Everyone needs to wake up and recognize that these attacks are coming at us essentially right now.

Like kitchen knives, which are used to end unhappy relationships. Is this really an argument we should be talking about? Wouldn't you feel silly presenting such an argument, to a household knive maker?

Re: Bark – Text-prompted generative audio model

#86

Post by SanderNL »

lynx23 wrote: post #85
ttul wrote: post #59

Earlier quoted context omitted.

This tech will be used by crooks to automate attacks. Generate the language using GPT-4 and the audio using Bark, and then start making phone calls. Because it’s open source, all you need is GPUs. This is not a criticism. I’m impressed and grateful for the openness. Everyone needs to wake up and recognize that these attacks are coming at us essentially right now.

Like kitchen knives, which are used to end unhappy relationships. Is this really an argument we should be talking about? Wouldn't you feel silly presenting such an argument, to a household knive maker?

That comparison holds up better if you imagine a world without knives or sharp objects of any kind. Now you can suddenly do tremendous harm by wielding a pointy stick. I don't think it's reaching to point out the dangers you just introduced.

With great power comes .... ? Profit?

Re: Bark – Text-prompted generative audio model

#87

Post by generalizations »

SanderNL wrote: post #86
lynx23 wrote: post #85

Earlier quoted context omitted.

Like kitchen knives, which are used to end unhappy relationships. Is this really an argument we should be talking about? Wouldn't you feel silly presenting such an argument, to a household knive maker?

That comparison holds up better if you imagine a world without knives or sharp objects of any kind. Now you can suddenly do tremendous harm by wielding a pointy stick. I don't think it's reaching to point out the dangers you just introduced. With great power comes .... ? Profit?

Except that world used to exist, back in the stone age, and we're all far better off now because we didn't choose to live in fear of the misuse of powerful tools.

Re: Bark – Text-prompted generative audio model

#88

Post by SanderNL »

generalizations wrote: post #87
SanderNL wrote: post #86

Earlier quoted context omitted.

That comparison holds up better if you imagine a world without knives or sharp objects of any kind. Now you can suddenly do tremendous harm by wielding a pointy stick. I don't think it's reaching to point out the dangers you just introduced. With great power comes .... ? Profit?

Except that world used to exist, back in the stone age, and we're all far better off now because we didn't choose to live in fear of the misuse of powerful tools.

I wouldn’t want to be around the first few guys with pointy weapons, but I am sure you would be fine.

Re: Bark – Text-prompted generative audio model

#89

Post by kleer001 »

MacsHeadroom wrote: post #84
kleer001 wrote: post #36

Earlier quoted context omitted.

>> i'm not sure why these projects are even really bothering trying to stop it. CYA aka https://en.wikipedia.org/wiki/Cover_your_ass also it still requires tons of money to run, so it's likely only businesses will do it

It takes about the same resources to run as Stable Diffusion or LLaMA. You don't even need a GPU.

No, the power and money to run high quality servers like ChatGPT4 and MidJourney or DallE. Sure there's local-able alternatives, but they're lower quality and lower bandwidth and not being used as a business proposition.

Just like a private individual can own lock smith tools and play around with locks... don't go basing your business of supplying them wholesale to the general public worldwide for free.

Re: Bark – Text-prompted generative audio model

#90

Post by CamperBob2 »

gs17 wrote: post #49
sschueller wrote: post #30

"However, to mitigate misuse of this technology, we limit the audio history prompts to a limited set of Suno-provided, fully synthetic options to choose from for each language." Isn't this open source and can be easily removed or am I missing something?

Yes, it seems to be enforced by a few assert statements in the code.

Have you seen any information on how to create the .npy files for custom voices, though? That's where I hit a wall. There must be some process that takes a .wav or similar audio file and creates the (relatively small) history prompt data.

Edit: looking at https://www.reddit.com/r/singularity/comments/12udgzh/bark_t... now.

Post reply on HN