Earlier quoted context omitted.
In the video, Musk states that SpaceX believes BFR will match the safety of commercial airliners due to its multi-engine propulsive landing capability.
Yes, totally, I get that they have a plan to make it safer -- my point is that a 20,000x increase in saftey is a massive leap, and that will be the limiting factor for this technology.
To put it another way, it seems likely that the safety will increase by that much. Before airplanes, hang gliders were one of the most popular ways to fly, along with balloons. Gliders were incredibly unsafe, because pilots were expected to control the glider by shifting their body weight. This made stalls fatal, since you couldn't recover.