Live data from Hacker News

ChatGPT with voice is now available to all free users

twitter.com

61–70 of 303 posts

Re: ChatGPT with voice is now available to all free users

#61
post #7

Interesting - this was actually a feature that got me to convert. I have some slight annoyances with how it handles natural pauses as I collect my thoughts and speak, but overall it's been great. I've had some interesting discussions and it's helped me structure some thoughts by asking questions and follow-ups, then summarizing our conversation... all while I'm on a walk. One fun thing I did with my family was have i…

Yeah, I wish there was an option to verbally cue that you were finished talking... like an "over and out" thing. Do you know about the feature where you can press the circle to force it to listen and then release for it to answer?

Re: ChatGPT with voice is now available to all free users

#67
post #61
post #7

Interesting - this was actually a feature that got me to convert. I have some slight annoyances with how it handles natural pauses as I collect my thoughts and speak, but overall it's been great. I've had some interesting discussions and it's helped me structure some thoughts by asking questions and follow-ups, then summarizing our conversation... all while I'm on a walk. One fun thing I did with my family was have i…

Yeah, I wish there was an option to verbally cue that you were finished talking... like an "over and out" thing. Do you know about the feature where you can press the circle to force it to listen and then release for it to answer?

It's interesting how in my frustration I intuitively tried that push-to-talk sorta-feature and it worked. Integrating something like Whisper and streaming live text could be neat, especially considering how different cultures handle conversational pauses and turn-taking. Wondering why there's no move towards full-duplex conversations in such tools.

Re: ChatGPT with voice is now available to all free users

#68
post #34

Earlier quoted context omitted.

I'm almost sure its streamed

It is streamed. They also offer this as an API for developers [0]. I just wish they'd offer more languages as it currently is English only. It can speak German and Spanish, but with a very clear English accent, which makes it kind of funny and makes one think about why the accent sounds so real. [0] https://platform.openai.com/docs/guides/text-to-speech

> It can speak German and Spanish

Among others...

Had to check myself.

> Afrikaans, Arabic, Armenian, Azerbaijani, Belarusian, Bosnian, Bulgarian, Catalan, Chinese, Croatian, Czech, Danish, Dutch, English, Estonian, Finnish, French, Galician, German, Greek, Hebrew, Hindi, Hungarian, Icelandic, Indonesian, Italian, Japanese, Kannada, Kazakh, Korean, Latvian, Lithuanian, Macedonian, Malay, Marathi, Maori, Nepali, Norwegian, Persian, Polish, Portuguese, Romanian, Russian, Serbian, Slovak, Slovenian, Spanish, Swahili, Swedish, Tagalog, Tamil, Thai, Turkish, Ukrainian, Urdu, Vietnamese, and Welsh.

Re: ChatGPT with voice is now available to all free users

#70
post #59

Earlier quoted context omitted.

What models/libraries is it based on?

Currently OpenHermes2-Mistral-7B (via exllama2), OpenAI Whisper (via faster_whisper), and StyleTTS2 (uses HF Transformers). All PyTorch-based. I will probably update to the OpenHermes vision model when Nous Research releases it, so it'll be able to see with the webcam or even read your screen and chat about what you're working on! I also need to update to Whisper-v3 or Distil-Whisper, and I need to update to a newer…

Thanks for such a detailed answer!
Post reply on HN