> Should the costs be borne by the same people who derive the benefit? Absolutely.
Apologies in advance, but for the sake of argument I'm going to create a straw man for a moment. I'll do my best to bring my straw man argument back around to fit the context of this conversation.
Sometimes the real cost of an activity isn't fully apparent until a crisis emerges from those activities, such as the Flint, Michigan water crisis. And sometimes by the time we figure out how much damage has really been done, the people who "should have paid" are long gone (soil contamination is still a good example here).
Sadly, humanity has proven time and again that we are entirely willing to dump our problems onto others in order to further enrich ourselves. At the most visible level there is inflation, where producers happily pass the burden of increased operational costs on to the consumer. When land tax increases, profit doesn't go down, rent simply goes up.
My point is that the true cost of an activity isn't always readily apparent, and sometimes humanity will be left to foot the bill. Case in point, in the distant future our planet will be a very unsafe place to just run around digging holes in - because you might run into a nuclear waste deposit. All of the measures that we take to try to scare people away from these sites (https://en.wikipedia.org/wiki/Long-time_nuclear_waste_warnin...), may in fact end up piquing their curiosity and attracting them.
So when you talk about "the costs being borne by the same people who derive benefit", to my ears that sounds very tone deaf when you consider that those costs involve burying nuclear waste and marking those locations on maps that will very likely become lost long before the waste site is safe. If you don't care about the humans of the far future, then I don't think we even have enough common ground to constructively argue upon.
> Should we treat as implicitly accepted that a particular use of energy is frivolous and should be stopped? Not if you care about your own ability to use energy to do things you think are valuable.
Implicitly accept? No, I think we should explicitly reject frivolous energy use on the grounds that we endanger the future inhabitants of this planet with the byproducts of that energy use.