Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Joe Rogan Issues Warning After AI-Generated Version of His Podcast Surfaces

zerohedge.com

Post reply on HN
Print view View original

141–150 of 181 posts

Re: Joe Rogan Issues Warning After AI-Generated Version of His Podcast Surfaces

#141

Post by nickthegreek »

httpz wrote: post #73

I think we now have the technology to build the talking portraits we saw in Harry Potter. Voice, facial movements, dialogs that matches the character can all be generated by AI now. I'm just not sure if this can be done realtime yet to interact with another person. In the future, you may be able to have a conversation with a portrait of your parents even after they pass away. (So collect as much training data now?)

the current workflow I've seen use is midjourney for the portrait creation, elevenlabs to do the voice and D-ID to animate the picture to the voice. Apparently the entire process can take under 15mins.

Re: Joe Rogan Issues Warning After AI-Generated Version of His Podcast Surfaces

#142

Post by superfrank »

PaulDavisThe1st wrote: post #119
superfrank wrote: post #62

Earlier quoted context omitted.

> I think in future people might start to take internet way less serious when you can literally make things up I've been starting to think this way as well. It feels like we're seeing something similar to the way that mass spam calls drastically changed the way people use the phones to the point where people don't recognize a phone number, they just don't pick up anymore. As the ratio of garbage goes up, people will…

> a more local, trust-less internet like we had in the 90s and early 00s I don't recognize this description of the Internet from any time after 1985 onward.

"More local" may not be the perfect description. When I wrote it I was thinking of things like AIM where, for the most part, you knew everyone you were interacting with. The more I think about it, there were plenty of chatrooms and forums at that time though, so yeah, probably not a good word to use.

I think "trust-less" is more what I'm getting at though. In the 90s and early 00s the whole, "don't reveal anything personal, assume anyone you don't have a history with as if they might have malicious intent" was still very prevalent. That only changed when the early versions of social media really started to catch on. My mental mile marker for that switch happening has always been when Facebook no longer required an edu email to sign up (2005), but I'm sure you could argue it happened a few years earlier.

There are plenty of reasons we should go back to that mindset and AI bots making it incredibly hard to verify that you are talking to an actual human maybe the thing that pushes us back toward that mindset.

Re: Joe Rogan Issues Warning After AI-Generated Version of His Podcast Surfaces

#143

Post by zuminator »

pharrington wrote: post #114
NalNezumi wrote: post #18

Personally I love this new AI voice content booms. My favorite is the AI presidents discussing/playing/rating stuff [1], Attenborough narrating warhammer [2]. While slightly silly, I think in future people might start to take internet way less serious when you can literally make things up. Which I think is a good trend. People getting depressed or so consumed by the internet culture that they loose all interest in th…

I agree that without massive safeguards, it is only going to become harder to discern between fact and fiction. The problem is that people must be able to discern between fact and fiction in order to live healthy lives. Reacting to AI by becoming laissez-faire about your information intake is just one more way for people to disconnect from reality. I think a good analogy is how technological advances made forging phy…

I think eventually we should get to the point where it should be considered prima facie fraud to use an unidentified AI in commerce. That is, you can use AI generated text, voice, or video but it has to clearly identify itself as such.

At the very least, responsible businesses can agree by common convention to abide by this code of conduct. There could be something like a "good AI seal of approval" issued to businesses that voluntarily adhere to the standard, like those web certificates that were ubiquitous in the early Aughts. Not only should the communications be public-key signed so the browser can identify them, but the the synthetic authors/speakers etc. should be named in a consistent way that unequivocally identifies them as AI.

For example, appending a numeral to the name. Instead of calling itself Joe Rogan, the AI would be "Joe 7 Rogan." Or instead of an article written by Jennifer 8. Lee, it would be written by, hmm, okay there might be a little problem in her[0] case. One thing I've been mulling around is the idea of repurposing the Apple][ symbol. So Joe][ and Jennifer][, where ][ is pronounced "two." The convenience being that it's comprised of glyphs that are on every keyboard, and they also look mechanical and nothing like normal names.

[0] https://en.wikipedia.org/wiki/Jennifer_8._Lee

Re: Joe Rogan Issues Warning After AI-Generated Version of His Podcast Surfaces

#144

Post by csw-001 »

pixl97 wrote: post #72
tovej wrote: post #31

Earlier quoted context omitted.

You mean like China's social credit system? Sounds dystopian

There are few to no paths to a non-dystopian outcome currently.

> There are few to no paths to a non-dystopian outcome currently.

Said Caveman 1 to Caveman 2 shortly after the discovery of fire. ;-)

Re: Joe Rogan Issues Warning After AI-Generated Version of His Podcast Surfaces

#145

Post by CSMastermind »

artificial wrote: post #117
neom wrote: post #23

After listening to this, I feel annoyed at the folks in the "AI clones teen girl’s voice in $1M kidnapping scam: ‘I’ve got your daughter’" thread that was on the front page yesterday saying "ppfftt bullshit you'd need to be an idiot to fall for an AI voice" - Guess I'm an idiot. Like it or not, generative media is getting better and better by the day.

This is also how swatting works: https://www.vice.com/en/article/k7z8be/torswats-computer-gen...

I don't understand how the phone systems allow for anonymous phone calls. Is it because of virtual telephone services? It feels like they should be required by law to follow KYC regulations like banks do.

Re: Joe Rogan Issues Warning After AI-Generated Version of His Podcast Surfaces

#146

Post by ZainRiz »

superfrank wrote: post #62
NalNezumi wrote: post #18

Personally I love this new AI voice content booms. My favorite is the AI presidents discussing/playing/rating stuff [1], Attenborough narrating warhammer [2]. While slightly silly, I think in future people might start to take internet way less serious when you can literally make things up. Which I think is a good trend. People getting depressed or so consumed by the internet culture that they loose all interest in th…

> I think in future people might start to take internet way less serious when you can literally make things up I've been starting to think this way as well. It feels like we're seeing something similar to the way that mass spam calls drastically changed the way people use the phones to the point where people don't recognize a phone number, they just don't pick up anymore. As the ratio of garbage goes up, people will…

Trust-less information was the norm for most of history.

The past century has really been an anomaly when it came to trusting news, with photos and videos seeming to be reliable proof. Before that, societies had to be structured very differently to account for the lack of proof. You'd hear people from out of town talking about what they saw in a neighboring city.

You'd need to judge how trustworthy the person was.

People would expect a chain of narration, to understand how _that_ person came to learn a bit of information (or if they claimed to witness it first hand).

As AI generated content becomes more popular, I predict we as a society are going to go back to relying more and more on the reputation of the speakers in question.

Who might you consider reputable? People you've met personally, people who your community respects, and of course, influencers who you follow who's persuasive words match your pre-existing world views. Perhaps something else will emerge

Re: Joe Rogan Issues Warning After AI-Generated Version of His Podcast Surfaces

#147

Post by ZainRiz »

majormajor wrote: post #48
boredemployee wrote: post #29

Earlier quoted context omitted.

>> We might be just going back to the time of early, anonymous internet forums time where most people used to it just didn't take it too seriously Man I was just thinking about it lastnite. Back in the day we were (at some level) respectful to each other in places like IRC and forums, even tho nobody knew each other. And when some idiot started to f- around you had IRCOps and moderators, so it was somewhat easier and…

I don't think these things follow from each other. Smaller-scale, pre-social-media forums and such in many ways took things more seriously, not less. The poster-to-moderator ratio was WAY lower than somewhere like Facebook or Twitter, and things got handled faster. Internet content was generally not taken too seriously, but internet communities were still serious, and they had better tools for enforcement than they d…

The tools for a community to self-moderate is the key here, along with communities being able to define their own boundaries.

Reddit communities with active moderators are often great places to have respectful conversations. Twitter, on the other extreme, has virtually zero moderation tools for any group. You get to live with whatever rules Twitter sets for the entire platform (and die by the group that's able to hack them)

Re: Joe Rogan Issues Warning After AI-Generated Version of His Podcast Surfaces

#148

Post by majormajor »

boredemployee wrote: post #94
majormajor wrote: post #48

Earlier quoted context omitted.

I don't think these things follow from each other. Smaller-scale, pre-social-media forums and such in many ways took things more seriously, not less. The poster-to-moderator ratio was WAY lower than somewhere like Facebook or Twitter, and things got handled faster. Internet content was generally not taken too seriously, but internet communities were still serious, and they had better tools for enforcement than they d…

>> The poster-to-moderator ratio was WAY lower than somewhere like Facebook or Twitter, and things got handled faster. But, honestly and genuinely asking here: isn't that exacly what happens when all you think is about scale, money and growth, at all costs? (I mean, on the big social networks side)

I would definitely say that the big social network sites are bad for the internet and bad for "real world" society as well; I think it's a perfect example of an externality that they ignore in going for money at all costs.

Re: Joe Rogan Issues Warning After AI-Generated Version of His Podcast Surfaces

#149

Post by majormajor »

ZainRiz wrote: post #147
majormajor wrote: post #48

Earlier quoted context omitted.

I don't think these things follow from each other. Smaller-scale, pre-social-media forums and such in many ways took things more seriously, not less. The poster-to-moderator ratio was WAY lower than somewhere like Facebook or Twitter, and things got handled faster. Internet content was generally not taken too seriously, but internet communities were still serious, and they had better tools for enforcement than they d…

The tools for a community to self-moderate is the key here, along with communities being able to define their own boundaries. Reddit communities with active moderators are often great places to have respectful conversations. Twitter, on the other extreme, has virtually zero moderation tools for any group. You get to live with whatever rules Twitter sets for the entire platform (and die by the group that's able to hac…

The biggest question for me right now is "can Reddit [or similar] survive hordes of generative AI spam/troll/abuse bots without changing to a paid membership model?"

I don't know if the current tools are up to the task.

Post reply on HN