Live data from Hacker News

ChatGPT unexpectedly began speaking in a user's cloned voice during testing

arstechnica.com

41–50 of 164 posts

Re: ChatGPT unexpectedly began speaking in a user's cloned voice during testing

#41

It’s “unexpected” because their early training didn’t get rid of it as well as they hoped. LLM’s are good at detecting patterns and like to continue the pattern. They’re starting with autocomplete for voice and training it to do something else. For now, it’s fairly harmless since it’s only a blooper in a lab, but there will likely be open-weights versions of this sort of thing eventually. And there will probably be p…

[deleted]

Re: ChatGPT unexpectedly began speaking in a user's cloned voice during testing

#42

It’s “unexpected” because their early training didn’t get rid of it as well as they hoped. LLM’s are good at detecting patterns and like to continue the pattern. They’re starting with autocomplete for voice and training it to do something else. For now, it’s fairly harmless since it’s only a blooper in a lab, but there will likely be open-weights versions of this sort of thing eventually. And there will probably be p…

Can someone pleasee convince why i shouldn't be absolutely shit out of my mind cynical about this innovation? we are literally seeing the downfall of trust in society. and no, i dont believe i am exaggerating

Luckily, the same person bringing this tech to market (Sam Altman) sells the solution to the trust problems his tech will create (WorldCoin).

Re: ChatGPT unexpectedly began speaking in a user's cloned voice during testing

#43

Earlier quoted context omitted.

Those are not contradictions.

One of the common bad takes is that since personal things can be distilled to “just math” they are no longer personal or valuable in the sort of way we value personal things. Increasing our understanding of how the world works shouldn’t devalue the world. To put it another way, people having souls is not the only reason to treat people like people. Or as Dr Seuss says: A person’s a person no matter how small.

> they are no longer personal or valuable in the sort of way we value personal things

There were people with your face or voice before, you just didn't care. AI continues a trend: the internet has always been post-scarcity, free copying and offering an amazing array of choices. We are acting as if it's a new thing, but it's been here for 25 years.

Re: ChatGPT unexpectedly began speaking in a user's cloned voice during testing

#45

It’s “unexpected” because their early training didn’t get rid of it as well as they hoped. LLM’s are good at detecting patterns and like to continue the pattern. They’re starting with autocomplete for voice and training it to do something else. For now, it’s fairly harmless since it’s only a blooper in a lab, but there will likely be open-weights versions of this sort of thing eventually. And there will probably be p…

Can someone pleasee convince why i shouldn't be absolutely shit out of my mind cynical about this innovation? we are literally seeing the downfall of trust in society. and no, i dont believe i am exaggerating

If everyone is too cynical, then companies like OpenAI won't be able to make any money on it. You wouldn't want that, right??

Re: ChatGPT unexpectedly began speaking in a user's cloned voice during testing

#46
post #15

So Open AI has the capability to deep fake any of its users that use the voice chat capability? Yikes.

Did anybody with a passing familiarity with the technology not know this? There's a reason people don't trust their IP to public chat assistants, ya know. It's because they're remorselessly siphoning our data for training purposes. And you've agreed to let them use your inputs for anything they please.

> And you've agreed to let them use your inputs for anything they please.

This has always been the Google and FaceBook deal - your data for services, and the AI assistant deal remains the same. I believe people will flock to the best AI with their data, handing it on a silver platter. Will they spend half a second thinking about privacy or prefer immediate results? When you know your competition uses AI, you aim to have just as much AI assistance or more.

Re: ChatGPT unexpectedly began speaking in a user's cloned voice during testing

#47
This isn’t an example of general intelligence. However, it’s an example of the complexity of these systems. As they get more complex (and advanced) it’s going to be pretty scary (and creepy) what can happen. I’ll predict there will be moments when we’re truly convinced some independent autonomy has taken over.

Re: ChatGPT unexpectedly began speaking in a user's cloned voice during testing

#49
post #42

Earlier quoted context omitted.

Can someone pleasee convince why i shouldn't be absolutely shit out of my mind cynical about this innovation? we are literally seeing the downfall of trust in society. and no, i dont believe i am exaggerating

Luckily, the same person bringing this tech to market (Sam Altman) sells the solution to the trust problems his tech will create (WorldCoin).

If you mean voice cloning, they aren't bringing that tech to market. (Someone else will, though.)

Similarly, Google doesn't let you use face matching in image search to find every photograph of you on the web, even though they could, and quite similar technology is built into Google Photos.

Re: ChatGPT unexpectedly began speaking in a user's cloned voice during testing

#50

It’s “unexpected” because their early training didn’t get rid of it as well as they hoped. LLM’s are good at detecting patterns and like to continue the pattern. They’re starting with autocomplete for voice and training it to do something else. For now, it’s fairly harmless since it’s only a blooper in a lab, but there will likely be open-weights versions of this sort of thing eventually. And there will probably be p…

Can someone pleasee convince why i shouldn't be absolutely shit out of my mind cynical about this innovation? we are literally seeing the downfall of trust in society. and no, i dont believe i am exaggerating

We are just finally seeing the mainstream get the idea they shouldn't trust anything on the internet. Long overdue.
Post reply on HN