Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Asterisk AI Voice Agent

github.com

Post reply on HN
Print view View original

71–80 of 129 posts

Re: Asterisk AI Voice Agent

#71

Post by WD-42 »

bronco21016 wrote: post #66
WD-42 wrote: post #43

What is the application of this that makes anything better for anyone? All I can think of is more spammers, scammers, horrible customer support lines.

My local dealership adopted one of these for their service department. Prior to the AI assistant, you would call and immediately be placed on hold because the same people serving customers at the desk were answering the phone. The AI picks up right away and can schedule an oil change. It's fantastic and I'd love to see more of this. Of course it also has the ability to escalate to a human for the things it doesn't ha…

If they have the ability to hook an llm up to a system that can schedule an oil change why can’t they provide a form on their website to do the same thing and save everyone the hassle?

Re: Asterisk AI Voice Agent

#72

Post by phantasmish »

fragmede wrote: post #35
duckkg5 wrote: post #23

Earlier quoted context omitted.

Absolutely not. 500-1000ms is borderline acceptable. Sub-300ms is closer to SOTA. 2000ms or more means people will hang up.

play "Just a second, one moment please ".wave as soon as input goes quiet. ChatGPT app has a audio version of the spinner icon when you ask it a question and it needs a second before answering.

I haaaaate the fake typing noises.

Re: Asterisk AI Voice Agent

#73

Post by quaheezle »

WD-42 wrote: post #71
bronco21016 wrote: post #66

Earlier quoted context omitted.

My local dealership adopted one of these for their service department. Prior to the AI assistant, you would call and immediately be placed on hold because the same people serving customers at the desk were answering the phone. The AI picks up right away and can schedule an oil change. It's fantastic and I'd love to see more of this. Of course it also has the ability to escalate to a human for the things it doesn't ha…

If they have the ability to hook an llm up to a system that can schedule an oil change why can’t they provide a form on their website to do the same thing and save everyone the hassle?

They do offer the ability to schedule an oil change via the website and yet some people still prefer to call. User preference and multi-channel servicing options are nice to support

Re: Asterisk AI Voice Agent

#74

Post by mh- »

WD-42 wrote: post #71
bronco21016 wrote: post #66

Earlier quoted context omitted.

My local dealership adopted one of these for their service department. Prior to the AI assistant, you would call and immediately be placed on hold because the same people serving customers at the desk were answering the phone. The AI picks up right away and can schedule an oil change. It's fantastic and I'd love to see more of this. Of course it also has the ability to escalate to a human for the things it doesn't ha…

If they have the ability to hook an llm up to a system that can schedule an oil change why can’t they provide a form on their website to do the same thing and save everyone the hassle?

Not everyone wants to use a form on their website?

You and I certainly do, but a ton of people prefer calling on the phone.

Re: Asterisk AI Voice Agent

#75

Post by PoachedEggs »

WD-42 wrote: post #71
bronco21016 wrote: post #66

Earlier quoted context omitted.

My local dealership adopted one of these for their service department. Prior to the AI assistant, you would call and immediately be placed on hold because the same people serving customers at the desk were answering the phone. The AI picks up right away and can schedule an oil change. It's fantastic and I'd love to see more of this. Of course it also has the ability to escalate to a human for the things it doesn't ha…

If they have the ability to hook an llm up to a system that can schedule an oil change why can’t they provide a form on their website to do the same thing and save everyone the hassle?

Both can be true. They might have those web forms, while also having enough customers that prefer phone calls to justify it.

Re: Asterisk AI Voice Agent

#76

Post by picardo »

ldenoue wrote: post #25
nextworddev wrote: post #4

Can I connect this to Twilio

I developed a stack on Cloudflare workers where latency is super low and it is cheap to run at scale thanks to Cloudflare pricing. Runs at around 50 cents per hour using AssemblyAI or Deepgram as the STT, Gemini Flash as LLM and InWorld.ai as the TTS (for me it’s on par with ElevenLabs and super fast)

Is AssemblyAI or Deepgram compatible with OpenAI Realtime API, esp. around voice activity detection and turn taking? How do you implement those?

Re: Asterisk AI Voice Agent

#77

Post by numpad0 »

wild_egg wrote: post #10

The baseline configurations all note Is that really where SOTA is right now?

Very randomly and personally I appear to have experimented with that few months ago, based on a Japanese advent calendar project[1] - the code is all over the place and only works with Japanese speeches, but the gist is as follows. Also in [2].

The trick is to NOT wait for the LLM to finish talking, but:

  1 at end of user VAD, call LLM, stream response into a buffer(simple enough)   
  2 chunk the response at [commas, periods, newlines], and queue sentence-oid texts  
  3 pipe queued sentence-oid fragments into a fast classical TTS and queue audio snippets   
  4 play queued sentence-oid-audio-snippets, maintaining correspondence of consumed audio and text 
  5 at user VAD, stop and clear everything everywhere, undoing queued unplayed voice, nuking unplayed text from chat log 
  6 at end of user VAD, feed the amended transcripts that are canonical to user's ears to step 1
  7 (make sure to parallelize it all)
This flow (hypothetically)allow such interactions as:

  user: "what's the date today"
  sys:  "[today][is thursday], [decem"
  user: "sorry yesterday"
  sys:  "[...uh,][wednesday?][Usually?]"

  1: https://developers.cyberagent.co.jp/blog/archives/44592/
  2: https://gist.github.com/numpad0/18ae612675688eeccd3af5eabcfdf686

Re: Asterisk AI Voice Agent

#78

Post by Rebelgecko »

WD-42 wrote: post #71
bronco21016 wrote: post #66

Earlier quoted context omitted.

My local dealership adopted one of these for their service department. Prior to the AI assistant, you would call and immediately be placed on hold because the same people serving customers at the desk were answering the phone. The AI picks up right away and can schedule an oil change. It's fantastic and I'd love to see more of this. Of course it also has the ability to escalate to a human for the things it doesn't ha…

If they have the ability to hook an llm up to a system that can schedule an oil change why can’t they provide a form on their website to do the same thing and save everyone the hassle?

Just ask your LLM to call the dealership. The only downside is spoken word is a bit slow for computers. Maybe we can even work out a protocol where the LLM voices talk faster and faster until they can't hear tokens clearly

Re: Asterisk AI Voice Agent

#79

Post by WD-42 »

Rebelgecko wrote: post #78
WD-42 wrote: post #71

Earlier quoted context omitted.

If they have the ability to hook an llm up to a system that can schedule an oil change why can’t they provide a form on their website to do the same thing and save everyone the hassle?

Just ask your LLM to call the dealership. The only downside is spoken word is a bit slow for computers. Maybe we can even work out a protocol where the LLM voices talk faster and faster until they can't hear tokens clearly

At that point we’ll have to convert the voices into a form more amenable to machine to machine communication. Perhaps a system based on high and low signals.

Seriously what is the point of all this.

Re: Asterisk AI Voice Agent

#80

Post by WD-42 »

quaheezle wrote: post #73
WD-42 wrote: post #71

Earlier quoted context omitted.

If they have the ability to hook an llm up to a system that can schedule an oil change why can’t they provide a form on their website to do the same thing and save everyone the hassle?

They do offer the ability to schedule an oil change via the website and yet some people still prefer to call. User preference and multi-channel servicing options are nice to support

They do? How do you know?
Post reply on HN