One challenge that I have always had with the trolley problem is that in general solutions are not symmetrical. By this, I mean that as an observer, I might conclude that several different choices made by the subject of the experiment were ethical. For instance, if the subject threw the switch and caused one person to be killed (instead of multiple), I would see that as ethical. I would also see it as ethical if the…
But that's also literally what it's supposed to do. It's a device to poke around and figure out your positions, e.g. are you into consequentialism or do you prefer deontology, are there circumstances that can change your position etc.
I often find people (not you, people in general) rejecting thought experiments, because they are not comfortable with their intuitive decisions and they feel that it will be exposed when they're forced to apply it to a hypothetical situation that does not leave them an easy out ("this wouldn't happen, I don't walk near train tracks, ever").