I disagree with your assessment. I think that the core problem with GA is that most people in the United States want to travel distances beyond what an affordable GA aircraft can in a single flight. I live in the midwest and I generally want to travel to the East or West coast or Southwest or Florida and the range of a Cessna just isn’t going to cut it. The only practical vehicle would be a Phenom 300 or Honda Jet II…
I might be over estimating, but I'd also think taking off and landing will tack on a few hours to the start and end of your trip. Fueling, safety checks, dealing with the control tower, etc. all seem like they'd effectively take your time savings to zero.
I know little to nothing about GA, but... it only makes sense to take time if the procedures are still done somehow manually, like speaking with human operators out there. It true, the dependence on a fallible human attention for something that can be automated, that right there is a safety hazard to me.