If you feel like the job is taking its toll it probably won’t hurt to look elsewhere. I enjoy my current job, but it started demanding 10-12 hour days, working on vacation days, and time away from my family. Once I hit that point it was a sign that something needed to change, and I didn’t see the job changing anytime soon.
Do what’s best for you and the important people in your life. Never feel guilty about it. And for the love of god, don’t deal with it the way I do, which is shutting down and not communicating with people who can help.