Stop listening to podcasts. Enjoy the quiet. I use to fill up my day with listening to podcasts during all non-work time (e.g. driving in the car, exercising, even showering). It overloads your brain if it's having to process info during every waking moment. You brain just needs quiet time to think, relax and explore. I'm way more relaxed, creative and find unique solutions to problems now, than before.
However I feel like this question falls into the "optimise every second of the day" thought pattern which kinda goes against the point.