I welcome the spam calls from our asterisk overlords.
I was more thinking I could add it to my Asterisk server to honey-pot the spam callers into an infinite time waster cycle.
[deleted]
Asterisk AI Voice Agent
121–129 of 129 posts
Re: Asterisk AI Voice Agent
#122Re: Asterisk AI Voice Agent
#123Earlier quoted context omitted.
The problem with PipeCat and LiveKit (the 2 major stacks for building voice ai) is the deployment at scale. That’s why I created a stack entirely in Cloudflare workers and durable objects in JavaScript. Providers like AssemblyAI and Deepgram now integrate VAD in their realtime API so our voice AI only need networking (no CPU anymore).
let me get this straight, you are storing convo threads / context in DOs? e.g. Deepgram (STT) via websocket -> DO -> LLM API -> TTS?
Yes DO let you handle long lived websocket connections.
I think this is unique to Cloudflare. AWS or Google Cloud don't seem to offer these things (statefulness basically).
Same with TTS: some like Deepgram and ElevenLabs let you stream the LLM text (or chunks per sentence) over their websocket API, making your Voice AI bot really really low latency.
Re: Asterisk AI Voice Agent
#124Earlier quoted context omitted.
It depends on what you mean by replacing. The integrated developer experience is much better on Vapi, etc. The goal of the Pipecat project is to provide state of the art building blocks if you want to control every part of the multimodal, realtime agent processing flow and tech stack. There are thousands of companies with Pipecat voice agents deployed at scale in production, including some of the world's largest e-co…
Is there a simple, serverless version of deploying Pipecat stack, without: - me having to self host on my infra I just want to provide: - business logic - tools - configuration metadata (e.g. which voice to use) I don't like Vapi due to 1) extensive GUI driven experience, 2) cost
Check out something like LayerCode (Cloudflare based).
Or PipeCat Cloud / LiveKit cloud (I think they charge 1 cent per minute?)
Re: Asterisk AI Voice Agent
#125Earlier quoted context omitted.
I developed a stack on Cloudflare workers where latency is super low and it is cheap to run at scale thanks to Cloudflare pricing. Runs at around 50 cents per hour using AssemblyAI or Deepgram as the STT, Gemini Flash as LLM and InWorld.ai as the TTS (for me it’s on par with ElevenLabs and super fast)
Is AssemblyAI or Deepgram compatible with OpenAI Realtime API, esp. around voice activity detection and turn taking? How do you implement those?
I am not using speech to speech APIs like OpenAI, but it would be easy to swap the STT + LLM + TTS to using Realtime (or Gemini Live API for that matter).
OpenAI realtime voices are really bad though, so you can also configure your session to accept AUDIO and output TEXT, and then use any TTS provider (like ElevenLabs or InWord.ai, my favorite for cost) so generate the audio.
Re: Asterisk AI Voice Agent
#126Earlier quoted context omitted.
I developed a stack on Cloudflare workers where latency is super low and it is cheap to run at scale thanks to Cloudflare pricing. Runs at around 50 cents per hour using AssemblyAI or Deepgram as the STT, Gemini Flash as LLM and InWorld.ai as the TTS (for me it’s on par with ElevenLabs and super fast)
Do you have anything written up about how you're doing this? Curious to learn more...
I don't but I should open source this code.
I was trying to sell to OEM though, that's why.
Are you interested in licensing it?
Re: Asterisk AI Voice Agent
#127Earlier quoted context omitted.
I built a voice AI stack and background noise can be really helpful to a restaurant AI for example. Italian background music or cafe background is part of the brand. It’s not meant to make the caller believe this is not a bot but only to make the AI call on brand.
You can call it what ever you like, but to me this is deceptive. Where is the difference between this and Indian support staff pretending to be in your vicinity by telling you about the local weather? Your version is arguably even worse because it can plausibly fool people more competently.
It doesn't have to be. You can configure your bot to great the user.
E.g. "Aleksandra is not available at the moment, but I'm her AI assistant to help you book a table. How may I help you?"
So you're telling the caller that it is an AI, and yet you can have a pleasant background audio experience.
Re: Asterisk AI Voice Agent
#128Earlier quoted context omitted.
Just ask your LLM to call the dealership. The only downside is spoken word is a bit slow for computers. Maybe we can even work out a protocol where the LLM voices talk faster and faster until they can't hear tokens clearly
At that point we’ll have to convert the voices into a form more amenable to machine to machine communication. Perhaps a system based on high and low signals. Seriously what is the point of all this.
Some people just like to call over navigate to a site and fill out a form. Sometimes just speaking is easier.
Re: Asterisk AI Voice Agent
#129Earlier quoted context omitted.
how about the plainly obvious fact that every call tree system first spends 1-8 minutes going through all the things that you can actually do on the website instead of calling: do you really think they would bother with that if people aren’t calling about stuff that is easily done on the website? sure, we all agree that it is partly designed to get people to hang up in disgust and give up, but that is an obviously in…
>sure, we all agree that it is partly designed to get people to hang up in disgust and give up actually, as someone who works in this area - no, it's not. it designed to help people to do things and metrics of success are closely monitored
fair enough. i totally believe that, and for the record i threw that bit in as an olive branch to the parent commenter… in retrospect, i shouldn’t have even included that rhetorical sludge. major chesterton’s fence area, that.