I wrote this on a comment thread 260 days ago when the autopilot features were introduced.
>A common phrase in aircraft cockpits nowadays is "What the heck is it doing now?" as pilots have migrated from actually flying the plane to simply being glorified systems managers.
While planes have become so, so, so much safer because of all this automation, pilots uncertainty regarding autopilot functioning is a major concern nowadays, and the reason for several accidents.
There are very interesting HCI challenges around properly communicating to the pilot/driver "what the heck it is doing" and clearly communicating just how much control the human has or doesn't have at any given point.
This "announcement" certainly doesn't inspire any confidence that they have really thought this through deeply enough (I think they probably have, but it should be communicated like it). As a huge Tesla fan, I can't help but feel like I need to hold my breath now and make sure something terrible doesn't happen because of this, and it ends up leading to even more regs setting us back on the path to full car automation.
I really hate having been right. But from the ensuing discussion here about the rightness or wrongness about labeling features "beta" in the car, to the disconnect of how the technology was "meant" to be used versus how it was portrayed by the company itself, it is pretty clear they really fucked up.
The huge discrepancy between the cautionary tone of this press release and everything that came before it is a great reminder that while some of us may be really worried about preventing AI from having unintended consequences in our society, there are at the same time many more pressing issues that we must address that are very much caused by very human motivations and actions.