I think this work is great and interesting, and I respect it. One of the things I feel like it lacks is a discussion of the broader context: we all sort of suspect that one of the reasons Twitter does not generally allow for de-escalation (like FB not censoring misleading news articles) is that such escalation is in fact part of their revenue stream (escalation=more engagement), so while I think ideas like this would…
"Engagement" is the "paper clip maximizer"[1] of the modern software industry, or more generally an example of "instrumental convergence." Optimizing engagement without regard for negative externalities is a catastrophic ethical failure of the major players in the software industry, and we are finally seeing a backlash both from mainstream advertisers and widespread public outcry. [1] https://en.wikipedia.org/wiki/In…
Science fiction is pretty much always just about things that already happened. “What if we maximized a non-human value?” is just a subconsciously repressed way of asking “Did anyone notice we’ve been maximizing non-human values for a couple hundred years?”