When you have vague idea of a problem, keep thinking about. This is time when thinking while walking somewhere is more beneficial then just sitting at desk. Your mind is less "restricted".
Also, it is normal to feel frustrated or depressed or ineffective while solving hard problem. Managing these emotions is part of the task, having them does not make you lesser. But when they are getting too much, take a break.