Throwaway.
Correct for part. I'm in a similar situation, but only 28. Five years to go. Twelve to a movie.
In my mind—and this is entirely anecdotal—sex and relationships are merely a checkpoint for the life of a person. It's nothing more than a signifier, of which people place a negative connotation on being a virgin. I'm not here by choice, but by inability to progress against these signifiers.
While I agree with your point about the sex being irrelevant, the entirety of the statement of "It's sex" framed as a triviality is dead wrong. I, and I assume most other virgins, have severe issues with dealing with social cues. When you say "someone" who is that? Is it someone at the bar? A friendly glance at work? I can't tell. I'm pretty bad at learning social cues. I'm not sure where to do them. Or at who.
And because I'm bad at learning those social cues, I'm afraid to be forward. A friend who was sexually harassed at work gave me the advice to try a small company because "they have more relationships between coworkers there." It's somewhat irrelevant advice given how tone-deaf I am to general human interactions. Kind of ironic too, considering I probably couldn't tell the difference between harmless office flirting and sexual harassment. Which is why it's precluded in my mind.
Much like T.H. White's Merlin, I realize my doom, but am unable to change it. I'm guessing it's a chemical issue with my locus of control.
EDIT:
I spend a majority of my free time in the gym. I'm very fit, so it's not a matter of appearance. Minus any crazy expression on my face.