Earlier quoted context omitted.
If you really want a secret voting system such that the voter can’t access their own history, then just do not offer the password option. Instead a unique private key is generated, but never distributed to the voter or any other party. - Key: Encrypted SSN - Value: Unencrypted Vote
However, I’d personally prefer a system that was fully public. Problems: Social Pressure, Violent/Non-Violent Coercion, Retaliation. Coercion could be a problem but with enough humans seems unlikely to be effective without the details of the conspiring entity to leak. If here are 10 jurors or a few judges coercion matters because it is easy to cover up. Coercion at scale has never occurred. Coercing any double digit…
It was made secret because all the problems you say aren't important, were very important.