The most obvious evidence to me has always been that Europeans are not black. A change like the loss of melanin requires selective pressure, which in this case was likely furnished by less vitamin D as we migrated away from the equator. The pressure must have been significant since being white carries a big downside: higher vulnerability to sunburn and skin cancer. When I lived in Cali I always envied my darker skinn…
It's not so much about the race, but about the exploitation. Blacks and whites co-lived without racism for millenia, back when anybody could become a slave.
When around the 16th century the Europeans started to exploit latin americans, indians and blacks as slaves, they spread the various theories of racism to justify the practice (both the advance of christianity and englightenment meant that such a thing should now be justified, whereas in the ancient/pagan world just being more powerful was enough to justify making slaves of the less powerful, you didn't need an excuse).
So, if Europens where also blacks, the exploitation would just have found some other justification than skin color (kind of how Hitler didn't have much issue to discriminate against the also-white Jews).