Earlier quoted context omitted.
this situation says more about rampant/unchecked/unregulated businesses and the american legal system/beliefs around regulation than anything. mcdonald’s coffee “warning: contents may be hot” comes to mind as a previous example. fast food businesses were competing to serve the hottest coffee and one of them ended up scalding a woman so badly they were forced to put warnings on their coffee cups. replace coffee being…
Nobody would expect their coffee to be almost boiling, everybody should expect an LLM to give slop answers from time to time. Even Steve Jobs died early because he took vibes-based advice instead of just listening to doctors. You can snark about capitalism all you want, but at some point people are in charge of their own health.
oh really? because that’s not how they’re being advertised or marketed. they’re being touted as oracles that can answer any and all of your questions
with a tiny disclaimer in greyed out text at the bottom of the ui that says they sometimes get things wrong.
> You can snark about capitalism all you want, but at some point people are in charge of their own health.
firstly, i’m not snarking about capitalism. i’m snarking about american companies.
second. yes. but when someone is less able to look after themselves there is a question to answer about the influence something like an LLM is having on them.
ai psychosis is a documented and real phenomena. people fall into rabbit holes because of the sycophantic nature of the models. and the models are sycophantic not because it makes them better at answering questions, the sycophancy makes them worse at that. they’re made more sycophantic because it gets people to engage with the models more and more.
dark pattern addictive design causing real world harms, being dismissed and waved off, yet again from american companies.