Remember: If it’s free. You are the product.
hoeing for prompts
ChatGPT with voice is now available to all free users
81–90 of 303 posts
Re: ChatGPT with voice is now available to all free users
#82I wonder why they launched it today, when it was supposed to be a week-off for all OAI employees and amidst whatever else is going on? One possibility is to capture Thanksgiving gatherings as a growth hack where people demo this to their families/friends and increase app downloads for OAI.
Another possibility is that people who build products don’t actually care about leadership drama as much as Twitter or HN
Re: ChatGPT with voice is now available to all free users
#83It's possible to run a voice AI similar to this entirely locally on a normal gaming PC with a good GPU using open source AI models. I have a standalone demo I've been working on that you can try if you have a 12GB+ Nvidia GPU: https://apps.microsoft.com/detail/9NC624PBFGB7 It's still very much a demo and not as good as GPT-4, but it responds much faster. It's fun to play with and it shows the promise. Open models hav…
Related to the subthread above, and something I've been thinking about - how do you detect when the user has stopped speaking so the bot can respond?
Re: ChatGPT with voice is now available to all free users
#84It's possible to run a voice AI similar to this entirely locally on a normal gaming PC with a good GPU using open source AI models. I have a standalone demo I've been working on that you can try if you have a 12GB+ Nvidia GPU: https://apps.microsoft.com/detail/9NC624PBFGB7 It's still very much a demo and not as good as GPT-4, but it responds much faster. It's fun to play with and it shows the promise. Open models hav…
Related to the subthread above, and something I've been thinking about - how do you detect when the user has stopped speaking so the bot can respond?
Great question! Right now both ChatGPT and my demo are doing very simple and basic stuff that definitely needs improvement.
ChatGPT is essentially push-to-talk with a little bit of automation to attempt to press the button automatically at certain times. Mine is continuously listening and can be interrupted while speaking, but isn't yet smart enough to delay responding if you pause in the middle of a sentence, or stop responding at the natural end of a conversation.
I wrote up my detailed thoughts about it here: https://news.ycombinator.com/item?id=38339222
Re: ChatGPT with voice is now available to all free users
#85Can somebody who knows their stuff about voice synthesis explain to me why chatGPT sounds like it's speaking German with an American accent when I speak to it in German? It's really surprising how believably it sounds like a native American-speaker speaking excellent, just not accent-free, German. I would imagine that voice synthesis models would somehow be trained on data from native speakers, so why the accent?
I expect that the training data for the voice AI is overwhelmingly English. Native speakers of other languages will be a small minority. I'm sure it will improve over time.
Re: ChatGPT with voice is now available to all free users
#86Does that example really work? It's suggesting to ask it where to order 195 pizzas from. Does it have access to active business records like that?
They re-enabled browsing access, so I believe it has the ability to search Bing again now.
It seems much better now too. Before, it would do exactly one query and read one or two results and then give up. Yesterday I asked a question and it did several queries and read probably a dozen results before answering. And it correctly said that little information was available on the topic I asked about, which impressed me because I expect it to hallucinate in that situation instead.
Re: ChatGPT with voice is now available to all free users
#87I wonder why they launched it today, when it was supposed to be a week-off for all OAI employees and amidst whatever else is going on? One possibility is to capture Thanksgiving gatherings as a growth hack where people demo this to their families/friends and increase app downloads for OAI.
Another possibility is that people who build products don’t actually care about leadership drama as much as Twitter or HN
Almost all of the OpenAI team signed a letter saying they would resign if the board is not replaced, so safe to say that they do care about the leadership drama; perhaps more than the rest of us.
Re: ChatGPT with voice is now available to all free users
#88Am I the only one who doesn't like these specific voices? The quality is incredible, but they feel too cheery/enthusiastic/casual and it just gets annoying after a while. I made an iOS shortcut a while ago that uses Siri with the ChatGPT app (it has iOS shortcut bindings) and despite Siri being a useless pile of junk compared to this, I actually prefer Siri's voice to this in some ways, because it doesn't feel so ove…
It is very much a cultural thing, the voice equivalent of decorating your Instagram. Ordering pizza after a 60h work week? Well, better make it sound like fun!!
Re: ChatGPT with voice is now available to all free users
#89Earlier quoted context omitted.
Do you mean Siri's voice recognition? If so, 100% agreed. My iOS shortcut uses OpenAI's Whisper API for voice recognition, and Siri (English United Kingdom - Siri Voice 1) for text to speech. I really like dictating things sometimes, and Whisper is perfect for that (automatic paragraphs inside the model itself would be nice but not a big deal). If anyone is interested - the "Whisper speech recognition in iOS" part is…
No, I mean the voice recognition in ChatGPT. > free except for the OpenAI API usage fees There are several versions of Whisper which have been distilled and can run locally, so I don’t see what advantage making API calls would be other than increased latency and decreased reliability and data security.
That's really interesting, Whisper is generally considered the current state of the art in STT and I've personally never experienced errors like the ones you describe. I've actually never had an error from Whisper.
First question, is there another STT you have used which works better for you?
Second question, is there any reason your voice might be considered unusual, like having a strong Welsh, Irish, or Indian accent, or being Deaf or Hard of Hearing?
Re: ChatGPT with voice is now available to all free users
#90Can somebody who knows their stuff about voice synthesis explain to me why chatGPT sounds like it's speaking German with an American accent when I speak to it in German? It's really surprising how believably it sounds like a native American-speaker speaking excellent, just not accent-free, German. I would imagine that voice synthesis models would somehow be trained on data from native speakers, so why the accent?
> models would somehow be trained on data from native speakers, so why the accent?
you wouldn't believe it, but models haven't been trained yet. as usual.