Live data from Hacker News

Crossing the uncanny valley of conversational voice

sesame.com

11–20 of 231 posts

Re: Crossing the uncanny valley of conversational voice

#12
post #8

I asked it if it could whisper, and it replied in full voice, ”I’m whispering to you right now”.

lol yeah I tried to get it to whisper too. And talk faster or slower or do accents. It seemed to be able to kind of do each of those things but only very slightly. Enough to see that there was some successful interpretation of the request but lack of flexibility to fully execute on it. OpenAI's model still has this beat on that front imo (talking quietly / slower / faster)

Re: Crossing the uncanny valley of conversational voice

#13

This is so good that it's disarming. People are going to blabber everything to it, so we need a local private model. It's a lot to ask, I know. Incredible tech.

> Our models will be available under an Apache 2.0 license.

^ from the post

https://github.com/SesameAILabs/csm is empty for now, but I imagine they'll be releasing it soon: https://x.com/_apkumar/status/1895492615220707723

Re: Crossing the uncanny valley of conversational voice

#14
post #5

AI voice is an overwhelmingly harmful technology. It's biggest use will be to hurt people.

It will unfortunately undoubtedly be used for mass automation of scams but text AI (and pre-AI automation) have been used for that for many years as well. Doesn't really make sense to say "ok we should allow all forms of AI besides voice because of scams", I think.

But yes, there needs to be some spreading of public awareness.

Re: Crossing the uncanny valley of conversational voice

#15
pretty impressive demo but not my style I mean the constant jabbing and kind of unintelligent behavior. so yeah it feels pretty uncanny but unfortunately in a negative annoying way. I don't think this is a limitation of the model they could just adopt to more scientific users in a more cooperative way, similar to how ChatGPT has this very sophisticated aura. I don't like how systems which have no emotions constantly pretend to have emotions but maybe that's just me.

Re: Crossing the uncanny valley of conversational voice

#17
Well done. My first impression:

Cons: they are just a bit too casual with their language. The casualness came off somewhat studied and inauthentic. They were just a bit too eager to fill silence: less than a split second of silence, and they were chattering. If they were humans I would think they were a bit insecure and trying too hard to establish rapport. But those flaws are relatively minor, and could just be an uncanny valley thing.

Pros: They had such personalities that I felt at moments that I was talking to a person. Maya was trying to make me laugh and succeeded. They took initiative in conversation; even if that needs some tweaking, it feels huge.

Re: Crossing the uncanny valley of conversational voice

#19

This is so good that it's disarming. People are going to blabber everything to it, so we need a local private model. It's a lot to ask, I know. Incredible tech.

Same, I have been trying it for the last few minutes, and it is crazy.

Try asking if it if it speaks a different language. It will pretend like it can and then give you some humor. But then you probe a bit more and it tells you it is really good at listening and can listen to you in other languages. I tell it alright I'll talk to you in a different language but you will reply back in English. It says you got it and then passes all sorts of tests I put it through with flying colors.

Oh it also remembers your previous conversation and greets you accordingly.

Crazy impressive this will certainly revolutionize virtual office businesses.

Post reply on HN