The ultimate first world problem, but still a real one.
Around the time my first kid was born, I took a look at the profits from my little handful of SaaS products and decided that, even though we were happily living off it, it wasn't really "put a kid through college" money. So I picked up a remote contract.
But, SaaS being Saas, business picked up. After a few years, the product business was bringing in more than any full-time job I'd ever had before. But I had negotiated my "Bay Area Rate" for this contract, and was therefore also bringing in a significant fraction of what the OP describes each year.
House paid off, savings saved, no money troubles on the horizon, but it still took a long time and a lot of effort to convince myself to drop that contract. When the getting is good, it's really hard to deliberately stop the getting.
But I did. Took the kids out of school for half a year and hopped a flight to Southeast Asia to show them how mommy and daddy used to travel with backpacks and sleep in tin huts on the beach. Then slowly settled back in to working on the business stuff, when the weather didn't favor being outside, implementing all those things I'd had to put off for 5 years and shaping them up to be the solid revenue stream they'll need to be going forward.
But yeah, it's tough to do. Well worth it though.
To the OP, though, I'd recommend getting your spending sorted out. The math above doesn't work out for me, and it sounds like you've ramped your lifestyle up to consume most of that half million a year. Don't pull the plug until you have that comfortably down to around $50k all in. Otherwise you'll burn through your $1M savings in, well, 2 years. That would be no fun. And completely unnecessary.