Live data from Hacker News

If AI chatbots are the future, I hate it

jeffgeerling.com

51–60 of 200 posts

Re: If AI chatbots are the future, I hate it

#51
I think support is going to get worse before it gets better.

From a quick glance the chatbot described in this post it is clearly moving through a dialog tree and not LLM based. The outsourced support agent is likely also just moving through some sort of script. I don't think the chatbot necessarily made the experience much worse than typical AT&T support.

I think the big challenge with promise of AI chatbots (not in this example though), is that somehow you can just replace your entire support team with a bunch of bots, and free up your reactive support team to do other things. We (Olark: https://www.olark.com) have definitely seen this in our customer base and try really hard to walk people back from this perspective, but even then we are going to see more and more unstaffed chat solutions (e.g. every drift bot ever, and most intercoms) before things swing back to some hybrid of AI and humans.

That said, a very simplified version of the way I think about how AI chatbots and what the future of support looks like might help you:

1) Big enterprises (or regional monopolies) who are mostly monopolies selling to consumers, where they have to just be good enough that regulators don't come after them (or sometimes compete on price (AT&T, Comcast/Xfinity, Verizon, power company)), these folks will always offer the cheapest support they can get away with.

2) Companies that still win business with human relationships. These folks will likely over index on AI and provide worse service if they BELIEVE that they are winning business based on some sort of non-relationship based factors.

3) Small businesses with small teams wearing multiple hats all the time, where providing AI support lets them offer a better service than they'd be able to provide (e.g. we now can answer 50% of questions 24/7 instantly). They will over index on AI until it hurts the bottom line.

I still believe human relationships matter, and figuring out how to create hybrid bot / human customer service to enable humans to do their best work is still huge unsolved opportunity.

Re: If AI chatbots are the future, I hate it

#52
post #33

The problem here is bad customer support, not the use of chatbots. In this case, the chatbot is part of a badly designed system. Note that the human support rep didn't even have access to the chat history. AT&T is not making a real effort to provide good customer support. If the incentive structure within AT&T isn't focused on providing customer support, then throwing an AI chatbot into the mix isn't going to fix any…

> Note that the human support rep didn't even have access to the chat history.

Yeah... that's unlikely. They often do and just ignore it.

Re: If AI chatbots are the future, I hate it

#53
post #17
post #12

The general trend of insulating the human customer away from human customer service is just a horrible thing that keeps spreading. It was bad enough outsourcing customer support to overseas agents who have their hands tied to only read from a script and generally do nothing, and now we're just talking to computers that can generally do nothing. The message is the same: we don't actually care about our customers. I ow…

It's gotten so bad, that I have started to actively look for for products and services with known good customer support. E.g. I switched to an internet provider for SMEs. Costs around 20% more, but has dedicated IPv4/IPv6 IPs and offers a real human help desk.

I am doing the same recently. It took me a while to learn this (because I started life without much access to money). Buying convenience is a thing! Some examples: I pay for my search (Kagi). I picked my home builder by how they took my wishes into account. Instead of the chain restaurant, with disinterested staff, go to the one where the person behind the counter is the owner. I think good customer services can be your special sauce when making a business!

Re: If AI chatbots are the future, I hate it

#54
post #12

The general trend of insulating the human customer away from human customer service is just a horrible thing that keeps spreading. It was bad enough outsourcing customer support to overseas agents who have their hands tied to only read from a script and generally do nothing, and now we're just talking to computers that can generally do nothing. The message is the same: we don't actually care about our customers. I ow…

It's rather simple. If you don't pay enough money for a product that would sustain good customer service, you won't get it. Especially if you pay nothing and the product business model is ad-based. If you pay enough money, you usually can get good customer service, but you might pay a lot.

AT&T gigabit internet tends to be $1,200 a year and has incredible margins on profitability.

Re: If AI chatbots are the future, I hate it

#55
post #11

The problem is that this is not an AI chatbot, at least not in the sense the term AI is thrown around right now. Chatbots like this have been wasting people's time for a few years now. A modern LLM should not have any problem to detect whether the user has a problem with the connection or their wifi. I'm still optimistic that support chats are a field that may actually see improvements through (otherise overhyped IMH…

I had a decent experience with a service recently that used a ChatGPT powered support agent, it couldn't deal with my situation but I was surprised by how quickly it knew its own limitations and handed me to an actual human who helped me out. Edit: The chatbot in question was not powered by ChatGPT a few months ago and it was pretty bad, a few canned QAs and really weird loops to get to a human agent. Before that the…

I feel that's the best case, a smart conversational system that knows its limit and can off-ramp you to a human if need be. In addition, I don't _want_ to talk to a human, via phone or otherwise. We all had horrendous CS experiences ("are the lights on you router blinking?" - "yes! I just told you that there is packet loss, arghhh" so I actually prefer a smart non-human system in the vast majority of cases.

Re: If AI chatbots are the future, I hate it

#56

A few things stand out to me here. * Most notably, the ai bot is repeating itself and serving very standard looking messages. I don't think this is an "AI" chatbot in the sense of an LLM. It's just a dialogue tree with some parsing. * The author's communication is... bad. Don't say "connect to support rep". Say "talk to human". * It's very silly to state the following to a dumb chat bot: > Hello! I just received and…

> It's very silly to state the following to a dumb chat bot

It was the first message. We don't know if the author knew the decision tree will come first. Usually the initial prompt is something like "please describe the issue".

Re: If AI chatbots are the future, I hate it

#57

The thing is, he was having trouble with his WiFi. He, like most computer scientists, is dedicated to the True Name of Things, which I can respect, but also, in this day and age, WiFi == Internet. I know it literally doesn't, but the uh, vector embedding, for WiFi and internet? Very similar.

I don’t disagree but there’s no reason to think the ISP understands wifi and internet the same as the chatbot. The help being offered by the chatbot for wifi issues may have been specific for troubleshooting wifi issues and irrelevant for fixing a slow wired connection.

Re: If AI chatbots are the future, I hate it

#58

Earlier quoted context omitted.

Customers are generally not willing to pay for trained cs reps that could actually be helpful. As far as startups are concerned VCs would therefore not like you to use their dollars to pay cs reps when an LLM could do the job in their eyes. I agree with the sentiment of TFA but I think this is a battle that we have no chance of winning at scale. Very similarly to hoping for an ad-free web.

LLM support bots have literally never been helpful, their only purpose is to save costs and to drive you away

Oh, one has been spectacularly useful to customers, by hallucinating a new, more customer friendly refund policy that courts held the company liable for:

https://arstechnica.com/tech-policy/2024/02/air-canada-must-...

We absolutely need more chatbots like that.

Re: If AI chatbots are the future, I hate it

#59

Earlier quoted context omitted.

It's rather simple. If you don't pay enough money for a product that would sustain good customer service, you won't get it. Especially if you pay nothing and the product business model is ad-based. If you pay enough money, you usually can get good customer service, but you might pay a lot.

Agreed. Consider how much you pay monthly for the service. Then consider how much time would a customer support agent have to spend to help you out and how much money it would cost. To time spent, add in training time, training costs and to always have 100% capacity, the downtime costs as well. Humans cost a lot. And if you want creative, passionate humans who would be willing to go off script, you'd have to pay them…

Isn't the issue that even the scripts aren't up to scratch.

A chatbot that had the nuances correctly distinguished would not be a concern but it's because the script is not well put together and most likely poorly applied with a bot that it's so painful.

Re: If AI chatbots are the future, I hate it

#60

I hate AI chatbots too and I have yet to encounter one that is remotely helpful, let alone an enjoyable experience. On the other hand I can very well image how such a positive exchange could look like. I am not convinced that it is not possible to create a chatbot that provides a satisfactory or even satisfying interaction, but I believe the incentives to do so are not there. Most of the time chatbots are just an add…

The issue is IMO that they have very bad / little / no internal documentation. The boys are usually as good as the documentation that powers them.
Post reply on HN