Live data from Hacker News

Show HN: Open source framework OpenAI uses for Advanced Voice

github.com

31–40 of 63 posts

Re: Show HN: Open source framework OpenAI uses for Advanced Voice

#31
Imagine being able to tell an app to call the IRS during the day, endure the on-hold wait times, then ask the question to the IRS rep and log the answer. Then deliver the answer when you get home.

Or, have the app call a pharmacy every month to refill prescriptions. For some drugs, the pharmacy requires a manual phone call to refill which gets very annoying.

So many use cases for this.

Re: Show HN: Open source framework OpenAI uses for Advanced Voice

#32

Imagine being able to tell an app to call the IRS during the day, endure the on-hold wait times, then ask the question to the IRS rep and log the answer. Then deliver the answer when you get home. Or, have the app call a pharmacy every month to refill prescriptions. For some drugs, the pharmacy requires a manual phone call to refill which gets very annoying. So many use cases for this.

As costs of humanlike communications decrease, so will Sybil attacks and spam.

The IRS is notorious for resistance to tech change, don't be surprised if they unplug the phones and force you to walk in to ask your question.

What is the value add here? Save sometime for technocrats and technoadjacents for a whole of 3 years before victims of spam adapt?

Also this has been solved already just mail your question like the rest of mortals.

Re: Show HN: Open source framework OpenAI uses for Advanced Voice

#33

Earlier quoted context omitted.

Who did you ask? ChatGPT? Not sure if you understand LLMs but its knowledge is based on the training data, it can't reason about itself, it can only hallucinate in this case, sometimes correctly, most times incorrectly.

This is also true for petty much all humans and bypassing this limitation is called enlightenment/self realization. LLMs don't even have a self so it can never be realized. Just the ego alone exists.

No, humans can self inspect just fine

Re: Show HN: Open source framework OpenAI uses for Advanced Voice

#34
post #33

Earlier quoted context omitted.

This is also true for petty much all humans and bypassing this limitation is called enlightenment/self realization. LLMs don't even have a self so it can never be realized. Just the ego alone exists.

No, humans can self inspect just fine

How do you know that?

Re: Show HN: Open source framework OpenAI uses for Advanced Voice

#35
post #32

Imagine being able to tell an app to call the IRS during the day, endure the on-hold wait times, then ask the question to the IRS rep and log the answer. Then deliver the answer when you get home. Or, have the app call a pharmacy every month to refill prescriptions. For some drugs, the pharmacy requires a manual phone call to refill which gets very annoying. So many use cases for this.

As costs of humanlike communications decrease, so will Sybil attacks and spam. The IRS is notorious for resistance to tech change, don't be surprised if they unplug the phones and force you to walk in to ask your question. What is the value add here? Save sometime for technocrats and technoadjacents for a whole of 3 years before victims of spam adapt? Also this has been solved already just mail your question like the…

It would be really nice if the IRS would ALLOW you to walk in and ask a question!

Re: Show HN: Open source framework OpenAI uses for Advanced Voice

#36

This suggests that the AI "brain" receives the user input as text prompt (agent relays the speech prompt to GPT-4o) and generates audio as output (GPT-4o streams speech packets back to the agent). But when I asked advanced voice mode it said the exact opposite. That it receives input as audio and generates text as output.

Both input and output are audio. This post is about bridging WebRTC audio I/O with an API that itself operates on simple TCP socket streams of raw PCM. For reliability and efficiency you want end users to connect with compressed loss-tolerant Zoom-style streams, and that goes through a middleman which relays to the model API.

Re: Show HN: Open source framework OpenAI uses for Advanced Voice

#37
post #23

Is there anyone besides OpenAI working on a speech to speech model? I find it incredibly useful and it's the sole reason that I pay for their service but I do find it very limited. I'd be interested to know if any other groups are doing research on voice models.

When I asked advanced voice mode it said that it receives input as audio and generates text as output.

It is mistaken because it has no particular insight into its own implementation. In fact the whole point is that it directly consumes and produces audio tokens with no text. That's why it's able to sing, make noises, do accents, and so on.

Re: Show HN: Open source framework OpenAI uses for Advanced Voice

#38
post #33

Earlier quoted context omitted.

This is also true for petty much all humans and bypassing this limitation is called enlightenment/self realization. LLMs don't even have a self so it can never be realized. Just the ego alone exists.

No, humans can self inspect just fine

A lot of psychologists would quibble with that...

Re: Show HN: Open source framework OpenAI uses for Advanced Voice

#39
post #33

Earlier quoted context omitted.

This is also true for petty much all humans and bypassing this limitation is called enlightenment/self realization. LLMs don't even have a self so it can never be realized. Just the ego alone exists.

No, humans can self inspect just fine

Any evidence of that?

Have you seen the current US political system? Or Hawk Tua?

Re: Show HN: Open source framework OpenAI uses for Advanced Voice

#40
post #32

Earlier quoted context omitted.

As costs of humanlike communications decrease, so will Sybil attacks and spam. The IRS is notorious for resistance to tech change, don't be surprised if they unplug the phones and force you to walk in to ask your question. What is the value add here? Save sometime for technocrats and technoadjacents for a whole of 3 years before victims of spam adapt? Also this has been solved already just mail your question like the…

It would be really nice if the IRS would ALLOW you to walk in and ask a question!

That is very expensive. Offices all around the country with personnel. We are going to have to fund them instead of gripe about them to get that to happen.
Post reply on HN