Earlier quoted context omitted.
Yes it absolutely does carry a stigma. What companies layoff their best people? (I say as someone who has been laidoff)
Competent people who were effective at their job are laid off all the time. You're basically saying there's a stigma to not being the best at work.
As noted, there are many reasons why layoffs may occur, however, the stigma of being laid off exists.