Earlier quoted context omitted.
I share your experience. But, I've recently read a book, The Mind is Flat by Nick Chater, a psychologist, wherein he argues that your brain does not crunch anything in the background, and only does what it focuses on. However, the situation you outlined still occurs because you can get stuck in a certain paradigm (e.g. "this name that I can't remember definitely starts with 's'"), which you effectively reset, in addi…
I call this the "attractor basin hypothesis" of problem solving- your mental state is in one attractor basin and you need to be in a different one; a break gives you another chance to enter the right one. If true, it may be possible to get the same benefit as taking a break and returning to the work by doing something that jolts you out of your current attractor basin. Maybe that just means asking the right question…
Every now and then when I'm doing English to German translation, I find myself puzzled and then have to remind myself "think about the Dutch word" only to then immediately understand/recall the German cognate. I'm sure someone talking to me in Dutch could have the same effect, and more broadly speaking, another 'attractor basin' may be activated by random chance, like the tired cliche of someone in a movie figuring out the 'case' as a result of their spouse or child mentioning something unrelated yet apparently analogous.