Because the words come from Dutch nautical terms. “Starboard” is really “Steer-board”, an external keel on one side of a boat. Therefore Port is the only side of the boat that can dock to the port.
Stjόrn means stern, so the back of the boat. I'm guess borði refers to the rudder itself, meaning plank.
From what I gather the OP story is bunk. It's easy to verify.