Live data from Hacker News

Kinney Drugs pulls back AI phone assistant after hundreds of customer complaints

wcax.com

31–40 of 171 posts

Re: Kinney Drugs pulls back AI phone assistant after hundreds of customer complaints

#31
post #16

As someone who's been doing AI call centres for a while, I'm not surprised. It's really, really hard to build voice AI that works. There are no open source solutions that work out of the box. But the biggest problem is ASR. WER is still atrocious even with SOTA models. When you add drug names and regional accents, it's a recipe for disaster.

Just curious, why are drug names such a disaster? Do LLMs not understand pronunciation keys?

Re: Kinney Drugs pulls back AI phone assistant after hundreds of customer complaints

#32

Pharmacy phone lines are a terrible first use case for voice AI. Older callers, drug names, insurance mess, zero patience. Automating "store hours" is fine. Automating refill exceptions is how you get this outcome.

I just don't get why we're not doing it vertically like you said here. Implement a part of the cognitive work using AI but let the hard parts be done by a person. They're still gonna be more rich, just less so.

You figured it out, there, at the end!

Re: Kinney Drugs pulls back AI phone assistant after hundreds of customer complaints

#33

Pharmacy phone lines are a terrible first use case for voice AI. Older callers, drug names, insurance mess, zero patience. Automating "store hours" is fine. Automating refill exceptions is how you get this outcome.

Explain to me then why pharmacies have almost exclusively used IVR based phone systems for pharmacy refills and prescription management for the last decade?

Like they don’t even say the full name of the prescription they just tell you the first three letters and they’ll say “for the patient born on…”

Current pharmacy IT systems are currently almost 100% automated so how are you claiming it’s the first use?

Re: Kinney Drugs pulls back AI phone assistant after hundreds of customer complaints

#34

So - I run a company that does AI agents for pharmacy. We are at Series B now and growing well - series C in 9-12 months given growth. We just acquired a competitor of that vendor so very much an insider. First, The technology works, and it scales, but the whole bottleneck is domain expertise and implementation. These are expensive, and hard to scale. We hire pharmacists as project managers, that's how important doma…

> We have hundreds of pharmacies with us now and they mostly successful and happy

How happy are their patients?

Re: Kinney Drugs pulls back AI phone assistant after hundreds of customer complaints

#35
post #16

As someone who's been doing AI call centres for a while, I'm not surprised. It's really, really hard to build voice AI that works. There are no open source solutions that work out of the box. But the biggest problem is ASR. WER is still atrocious even with SOTA models. When you add drug names and regional accents, it's a recipe for disaster.

ASR = Automatic Speech Recognition

WER = Word Error Rate

Too many acronyms; not everybody is in your field.

Re: Kinney Drugs pulls back AI phone assistant after hundreds of customer complaints

#36

So - I run a company that does AI agents for pharmacy. We are at Series B now and growing well - series C in 9-12 months given growth. We just acquired a competitor of that vendor so very much an insider. First, The technology works, and it scales, but the whole bottleneck is domain expertise and implementation. These are expensive, and hard to scale. We hire pharmacists as project managers, that's how important doma…

> We have hundreds of pharmacies with us now and they mostly successful and happy. Our biggest friction is customers being burned by vendors like this and writing off AI altogether as "not ready".

This is such a great graph. Your company feels successful because your customer is happy yet the rest of the world would be just happy if your company died in a fire. This seems to also be just fine for companies like yours.

Re: Kinney Drugs pulls back AI phone assistant after hundreds of customer complaints

#37
post #4

Companies will pawn off thier customers to AI at their peril. In many ways this is a repeat of the India call center train wrecks of the 00s. On paper, letting someone in Bangalore vs onshore handle incoming customer service calls looked like a path to amazing savings. In practice the customer experience was horrendous and companies CTRL-Zed these decisions and rapidly brought customer service back onshore again. AI…

This, I suspect, is exactly like offshoring - and a lot of companies died during the offshoring fad because their software products become full of low quality merges and feature improvements that the company couldn't afford to fix or remove by the time they realized there was a problem. That remains my primary concern with AI code generation - well established codebases might become full of slop to the point of being unusable without a clear path back to maintainability leading to company death.

Re: Kinney Drugs pulls back AI phone assistant after hundreds of customer complaints

#39

So - I run a company that does AI agents for pharmacy. We are at Series B now and growing well - series C in 9-12 months given growth. We just acquired a competitor of that vendor so very much an insider. First, The technology works, and it scales, but the whole bottleneck is domain expertise and implementation. These are expensive, and hard to scale. We hire pharmacists as project managers, that's how important doma…

> We have hundreds of pharmacies with us now and they mostly successful and happy How happy are their patients?

Former patients

Re: Kinney Drugs pulls back AI phone assistant after hundreds of customer complaints

#40
post #16

As someone who's been doing AI call centres for a while, I'm not surprised. It's really, really hard to build voice AI that works. There are no open source solutions that work out of the box. But the biggest problem is ASR. WER is still atrocious even with SOTA models. When you add drug names and regional accents, it's a recipe for disaster.

Just curious, why are drug names such a disaster? Do LLMs not understand pronunciation keys?

People pronounce drug names all sorts of ways, and there's a lot of them (with a steady trickle of new ones)
Post reply on HN