Live data from Hacker News

Air Canada is responsible for chatbot's mistake: B.C. tribunal

bc.ctvnews.ca

251–260 of 434 posts

Re: Air Canada is responsible for chatbot's mistake: B.C. tribunal

#251

ouch I cant believe they really tried those arguments the chatbot as a separate legal entity? do they mean like a contractor’s service, or did they mean like a distinct AI creature

Either way, if their argument were upheld, it would be insanely interesting to see the second-order effects of that.

Like, could you spawn up a local LLM, have it take out some loans and transfer you the funds, and then "kill it" (^C), so the loan liability dies with the LLM?

Re: Air Canada is responsible for chatbot's mistake: B.C. tribunal

#252
post #244

I hate the whole attitude the industry has towards AI models, it just seems so sloppy compared to software of the past It’s like “yeah we don’t really know what it’s going to do and it might screw up but whatever just launch it” Really surprised me that so many companies are willing to jump into LLMs without any guarantee that the output won’t be something completely insane

Too much money on the line to bother with due diligence

This is the part I never got.

How does using a computer suddenly wash away any responsibility? Like if Air Canada's desk agents were all a separate company and they told the guy the wrong information isn't Air Canada still on the hook for training their sub-contractors?

Re: Air Canada is responsible for chatbot's mistake: B.C. tribunal

#253
The worst case for these airlines is always just a refund for whatever money they took in the first place.

Someone could make a killing making a fake airline, taking payments for flights, and then cancelling every single flight and only refunding the people who fight back hard enough.

Re: Air Canada is responsible for chatbot's mistake: B.C. tribunal

#254
post #188

Earlier quoted context omitted.

I disagree. I expect any credible offer a company makes in an advertisement, on its website, using a chatbot, or through a customer service agent to be authorized by the company. Surely a corporation with lots of resources knows better than to program a chatbot to make fake offers; they'd get sued. And they did get sued. Next time maybe they'll make sure software they connect to their website is more reliable.

> Surely a corporation with lots of resources knows better than to program a chatbot to make fake offers; they'd get sued. They didn't program it to do that, it's a characteristic of the technology that it makes mistakes. Which is fine as the public learns not to blindly trust its answers. It seems silly to assume that people won't be able to figure that out. People are capable of learning how new things work. This i…

> They didn't program it to do that, it's a characteristic of the technology that it makes mistakes

It sounds like you meant to say that they didn’t _intentionally_ program it to do that. They didn’t find the system under a rock and unleash it on the world; they made it.

Re: Air Canada is responsible for chatbot's mistake: B.C. tribunal

#255
post #200

Earlier quoted context omitted.

I agree with your cruise control analogy in a sense, but I think it's Air Canada that's misusing the technology, not the customer. If they try to replace customer service agents with chatbots that lie, they need to be prepared to pay for the results. I'm glad they're not allowed to use such unreliable, experimental technologies in their airplanes (737 Max notwithstanding). There's absolutely a technology available to…

> If they try to replace customer service agents with chatbots that lie, they need to be prepared to pay for the results. The result would be a de facto ban on AI chatbots, because nobody knows how to get them not to make stuff up. > I'm glad they're not allowed to use such unreliable, experimental technologies in their airplanes (737 Max notwithstanding). If you use unreliable technology in an airplane, it falls out…

> The result would be a de facto ban on AI chatbots, because nobody knows how to get them not to make stuff up

I think that banning lying to customers is fine.

Re: Air Canada is responsible for chatbot's mistake: B.C. tribunal

#256

I hate the whole attitude the industry has towards AI models, it just seems so sloppy compared to software of the past It’s like “yeah we don’t really know what it’s going to do and it might screw up but whatever just launch it” Really surprised me that so many companies are willing to jump into LLMs without any guarantee that the output won’t be something completely insane

They are salivating at the idea of being able to get humans off their payroll. The future is mass unemployment with all resources being split between a handful of trillionaires who control the AIs.

That wouldn't make sense though - once a sizable portion of the customer base is too poor to buy the services, there's no source of income anymore and the whole system collapses.

Re: Air Canada is responsible for chatbot's mistake: B.C. tribunal

#257
post #216

I just can't believe it took a lawsuit to get an airline to fork over a few hundred bucks on something that was obviously their fault.

Probably because they felt confident they could set a precedent would be my guess.

Of course the argument is absurd, but this is exactly where companies like this would love to go. Virtually free support staff that incur the company absolutely no liability whatsoever.

Re: Air Canada is responsible for chatbot's mistake: B.C. tribunal

#258

What are the chances that companies take the easy way out and slap a EULA on the chatbots like "by engaging in conversation with our automated agent you agree to "?

100%

Then they'll make it hard to get the information in any other way as well. Three humans on the phone lines and most of website content gone as they lay off the staff.

Re: Air Canada is responsible for chatbot's mistake: B.C. tribunal

#259

I hate the whole attitude the industry has towards AI models, it just seems so sloppy compared to software of the past It’s like “yeah we don’t really know what it’s going to do and it might screw up but whatever just launch it” Really surprised me that so many companies are willing to jump into LLMs without any guarantee that the output won’t be something completely insane

The purpose of AI, and the entire drive of investment in it, is to eliminate labor costs. There's no other purpose. It is not to advance science or make a better world, it is to make money. That money comes by the expense of the many and the gain of a few. And there will not be new jobs to replace the ones lost. There's no more "learn to code!". They're there to replace all jobs possible, make a more unequal society, and nothing more.

You'd best understand this today.

Re: Air Canada is responsible for chatbot's mistake: B.C. tribunal

#260

If I am trying to interact with a company and they direct me to their chatbot, I expect that chatbot to provide me with accurate answers 100% of the time (or to say it can't help me in the event that I ask a question that it's not meant to solve, and connect me to a representative who can). If I have to double-triple check elsewhere to make sure that the chatbot is correct, or if anything the chatbot tells me is non-…

Yes, I think people underestimate the amount of imagined LLM use cases that require accurate responses. To the point that hallucinations will cost money in fines & lawsuits.

This is a new frontier in short sighted customer service staffing (non-staffing in this case). The people who are on the frontline communicating with customers can convert unhappy customers to repeat customers, or into ex-customers. There's a few brands I won't buy from again after having to jump through too many hoops to get (bad) warranty service.

Post reply on HN