The more and more AI projects I see both at work and online, the more convinced I'm that I should treat AI as an application interface, that's all. It's a slightly different modality for the application. Nothing AI does wasn't possible before. You could always "create a price performance chart showing a stock's movement with key events annotated since May". You could also always buy dozens of software that will not j…
But, unfortunately, it also runs the risk of hallucination and improper logic.
Every RDS database with a dozen of terabytes that's at the entire value of a business that's running it still comes with a "Delete permanently, skip snapshot" button and, believe it or not, accidentally clicking it is not THAT unheard of.
If AI is thought of as an interface for an application where the "destructive" functions are all explicitly and clearly represented to the user and all the other actions are safe to experiment with is acceptable.
Bad UX (be it GUI, CLI, TUI, AIUI or even physical) can cause catastrophic bugs. Remember the Cisco switch with a reset button above an RJ45 port? https://thenextweb.com/news/this-hilarious-cisco-fail-is-a-n...