I wouldn't trade one job for another (in the same field), if that's how it's going to feel to you.
I would quit my job in a second to pursue a dream or retire. I have different financial expectations & desires than most.
I actually just pulled the plug on quitting my "high paying" job. The pay is quite nice considering my cost of living (I'm a remote worker), but nowhere near what you're making.
It would be easy for me to continue at the job feeling burned out, hating my day-to-day, but having no financial concerns. But I'm not proud of myself. I want to do something radically different, and I don't want to work for anyone else anymore.
So, I put in my notice and I'm taking the "scary" route instead. I'm excited about it, rather than concerned, and I don't have a million bucks guarding my flank, either.
If I were in your financial position, I would retire immediately and pursue whatever I desired without jeopardizing my already-achieved wealth. For me that would be hobbies, not income--but many hobbies also generate income. You could achieve a nice middle-class passive income forever, and that would suit me much better than wasting one more second in a job I hate.
Best of luck!