India's top court angry after junior judge cites fake AI-generated orders
1–10 of 212 posts
Re: India's top court angry after junior judge cites fake AI-generated orders
#2How many of these cases do we have to have before lawyers realise that they need to check that the things an LLM tells them are actually true?
Re: India's top court angry after junior judge cites fake AI-generated orders
#3> She had no intention to misquote or misrepresent the rulings and that "the mistake occurred solely due to the reliance on an automatic source", the high court wrote
I don't think the intention matters here. Its the same deal with every profession using llm to "automate" their work. The onus in on the professional, not the llm. Arstechnica case could have been justified by same manner otherwise.
Not knowing the law isnt execuse to break law, so why is not knowing the tool an excuse to blame the tool.
Re: India's top court angry after junior judge cites fake AI-generated orders
#4How many of these cases do we have to have before lawyers realise that they need to check that the things an LLM tells them are actually true?
Do we see this a lot in the US? This seems to be more unique to India.
Re: India's top court angry after junior judge cites fake AI-generated orders
#5How many of these cases do we have to have before lawyers realise that they need to check that the things an LLM tells them are actually true?
It’s worse than that. We’re hearing about the lawyers and Ars Technica because the consequences are public and the errors are egregious.
It’s likely happening to everyone.
Re: India's top court angry after junior judge cites fake AI-generated orders
#6How many of these cases do we have to have before lawyers realise that they need to check that the things an LLM tells them are actually true?
It doesn't matter anymore.
LLMs just revealed what a decadent society we have setup for ourselves worldwide.
Re: India's top court angry after junior judge cites fake AI-generated orders
#7How many of these cases do we have to have before lawyers realise that they need to check that the things an LLM tells them are actually true?
Do we see this a lot in the US? This seems to be more unique to India.
Re: India's top court angry after junior judge cites fake AI-generated orders
#8How many of these cases do we have to have before lawyers realise that they need to check that the things an LLM tells them are actually true?
I'm continually amazed at how much faith people have in them. I guess since they can sound like people and output really authoritative and confident text it just overrides any skepticism subconsciously?
Re: India's top court angry after junior judge cites fake AI-generated orders
#9How many of these cases do we have to have before lawyers realise that they need to check that the things an LLM tells them are actually true?
It doesn't matter, because any process that seems right most of the time but occasionally is wrong in subtle, hard to spot ways is basically a machine to lull people into not checking, so stuff will always slip through.
It's just like the cars driving themselves but you need to be able to jump in if there is a mistake, humans are not going to react as fast as if they were driving, because they aren't going to be engaged, and no one can stay as engaged as they were when they were doing it themselves.
We need to stop pretending we can tell people they "just" need to check things from LLMs for accuracy, it's a process that inevitably leads to people not checking and things slipping through. Pretending it's the people's fault when essentially everyone using it would eventually end up doing that is stupid and won't solve the core problem.
Re: India's top court angry after junior judge cites fake AI-generated orders
#10How many of these cases do we have to have before lawyers realise that they need to check that the things an LLM tells them are actually true?
Do we see this a lot in the US? This seems to be more unique to India.
It’s happening A LOT in the US too. Mainstream media just doesn’t seem to find it that newsworthy.
https://arstechnica.com/tech-policy/2026/02/randomly-quoting...