Maybe this is because the interviewee feels partly abused, as if communication isn't a two-way street. I think interviews would be less terrible if interviewers actually told you at the end that you did above/aswell as/below expectations, and/or why instead of just waiting 1-2 weeks before getting back to you and then telling you that you are/aren't moving on to the next step. A huge part of the interview process produces emotional ups/downs that no one wants to deal with and which ostracize potential employees, but the interviewers don't really do much to help with this.
I also think that having a 1-4 range is not a good guide for gathering sweeping datasets. Adding any amount of numbers will help to show actually how much. Or actually using human language to define them would be better. 1) Terrible/Unhirable. 2) Unhirable/Not Passing 3) Passing 4) Exemplar would actually be beneficial right now arbitrary numbering doesn't help to give people much context as to what they should choose, and the numbers are so close that you're going to get outliers where maybe some people think that a 2 is passable but not great, and interviewer thinks 3 is passable but not great, or vice-versa.