Silent Semantic Drift

I'm not sure I'm getting this. Don't any two humans that periodically communicate have exactly the same phenomenon? I usually solve this "drift" by saying "wait, what did you mean by $X, I don't think I understand that use".