Earlier quoted context omitted.
This isn't accurate, either. Most of us are decidedly not facing the direction of travel. Specifically, we are evenly split in large parts of the boat, as they have bench chairs that face each other. Or you are on the side of the boat facing out. The ferry is actually a very odd boat in this, btw. As I am not clear that starboard/port are fixed. The boat literally goes in both directions, such that I'm assuming I don…
Port and starboard are indeed fixed (same with bow and stern), so that no matter which way the boat is moving or the passengers are facing, those words always refer to the same physical sides of the boat :)
Edit: I found more discussion on this by searching for "double ended" boats. Port/starboard do indeed change depending on the direction of travel from all results I've found.