I'm exactly one of these people you're referring to. For some reason people around me tend to thing I am much smarter than I am.
It's not modesty of sorts, I am often involved in life or work situations where everyone around me seems to have understood something highly relevant to the situation, but me.
And the few times I mention it, people laugh.
"Hu hu, good one!" "Yup..."