Live data from Hacker News

Launch HN: Retell AI (YC W24) – Conversational Speech API for Your LLM

news.ycombinator.com

81–90 of 182 posts

Re: Launch HN: Retell AI (YC W24) – Conversational Speech API for Your LLM

#81
Curious what model the dentist bot is running on? Tried it out, was surprisingly good, though eventually it contradicted itself (booked a slot it said previously was not available). (I get that’s the programming but am curious especially given the latency is really great).

Re: Launch HN: Retell AI (YC W24) – Conversational Speech API for Your LLM

#82
This is very interesting. One thing I wondered about the per-minute pricing is how to keep a phone agent like this from being kept on the phone in order to run up a bill for a company using it. It'd be very inexpensive to make many automated calls to an AI bot like the dentist receptionist in the demo, and to just play a recording of someone asking questions designed to keep the bot on the phone.

As a customer of a service like Retell (though of course not specific to Retell itself), how might one go about setting up rules to keep a phone conversation from going on for too long? At 17¢ per minute, a 6-minute call will cost just over $1, or about $10 per hour. Assuming the AI receptionist can take calls outside of business hours (which would be a nice thing for a business to offer), then such a malicious/time-wasting caller could start at closing time (5pm) and continue nonstop until opening time the next day (8am), with that 15 hour span costing the business $150 for billable AI time. If the receptionist is available on weekends (from Friday at 5pm until Monday at 8am), that's a 63-hour stretch of time, or $630. And if the phone system can handle 10 calls in parallel, the dentist could come in Monday morning to an AI receptionist bill of over $6,300 for a single weekend (63 hours × $10 per hour × 10 lines).

This is in no way a reflection on Retell (I think the service is compelling and the usage-based pricing is fair, and with that being the only cost, it's approachable and easy for people to try out). The problem of when to end a call is one I hadn't considered until now. Of course you could waste the time of a human receptionist who is being paid an hourly wage by the business, but that receptionist is going to hang up on you when it becomes clear you're just wasting their time. But an AI bot may not know when to hang up, or may be prevented from doing so by its programming if the human (or recording) on the other end of the line is asking it not to hang up. You could say it shouldn't ever take more than five minutes to book a dentist appointment, but what if the person has questions about the available dental procedures, or what if it's a person who can't hear well or a non-native speaker who has trouble understanding and needs the receptionist to repeat certain things? A human can handle that easily, but it seems difficult to program limits like this in a phone system.

Re: Launch HN: Retell AI (YC W24) – Conversational Speech API for Your LLM

#85
post #78

Wow, this is sweet! With a little better latency and less perfection, it'd be well over the uncanny valley (not that it wouldn't fool many people as-is). Are you planning to add more "human" elements like filler words or disfluencies? If anything it feels too perfect to be human. Awesome stuff! P.S: I tried to fool the Dental Office demo trying to book on Sunday or outside of the slots it had indicated, and it did a…

Yes, we do plan to make the responses more conversational by adding pauses, filter words, slight stuttering, etc. This is also a high priority for us to work on.

Re: Launch HN: Retell AI (YC W24) – Conversational Speech API for Your LLM

#87
Wow this is incredible. I've worked a bit in the conversational LLM space and one of the hardest problems we were struggling with was human interruption handling. From the demo it seems like you guys have it down. Can't wait to see where this goes :) BTW I don't think the demo works on mobile, tried it on safari on IOS and got no response.

Re: Launch HN: Retell AI (YC W24) – Conversational Speech API for Your LLM

#88

Wow this is incredible. I've worked a bit in the conversational LLM space and one of the hardest problems we were struggling with was human interruption handling. From the demo it seems like you guys have it down. Can't wait to see where this goes :) BTW I don't think the demo works on mobile, tried it on safari on IOS and got no response.

It might ask for permission to use the microphone. If you can't find it, try going to the website's homepage, where you can enter your phone number to receive a call.

Re: Launch HN: Retell AI (YC W24) – Conversational Speech API for Your LLM

#89
post #86

What's the difference between your product and Gridspace's? I get the sense that your offering is more developer-focused, but I'm curious if there are any technical differences.

I believe Gridspace is an IVR solution, not one based on LLM. It's challenging to ask questions that deviate from the initial settings. We're using LLM to generate responses, which makes the conversation smoother.

Re: Launch HN: Retell AI (YC W24) – Conversational Speech API for Your LLM

#90
post #82

This is very interesting. One thing I wondered about the per-minute pricing is how to keep a phone agent like this from being kept on the phone in order to run up a bill for a company using it. It'd be very inexpensive to make many automated calls to an AI bot like the dentist receptionist in the demo, and to just play a recording of someone asking questions designed to keep the bot on the phone. As a customer of a s…

This can be handled with function calling and other features in LLM. We support the input signal of closing the call, and you can have your rule-based (timer) system or LLM-based end call functionality and use that to hang up.
Post reply on HN