Walked away from 20 years of software development last year. I've been day and swing trading stocks for last 2 years. I'm now trading full time and doing great. I don't miss the daily stand-ups, scrum meetings, planning meetings, "quick chats", one-on-ones with management, weekly department meetings, monthly company meetings, and late night critical support calls one bit!
Sorry for the blunt question, but how does it feel to go from something where you make something valuable to ...that? (At least I feel what I do give me meaning)
There are more ways to make an impact, such as earning a good salary and re-investing / donating to build trees, renewables or serve any of the UNDP goals that are helping society.
In fact that is probably more impactful that personally picking fruit in the garden.
I guess it just depends on the place itself not being generally net negative to society compared to the impact you can make with it.
Here is a good primer: https://80000hours.org/