I only had this effect when going completely zero caffeine, not when I cut down to one cup a day.
Unfortunately coffee is a vicious cycle, where I end up picking the habit back up on work trips. Before I know it I'm drinking a cup of coffee while writing a reply on HN about how great it was when I gave it up.