The ultimate issue is that underpinning every action is a value system. Value systems are opinions and are fundamentally not rational. Virtually every political disagreement is based on values, though most of the time people dont recognize it. Values determine priorities and priorities underpin action. For example some people feel that liberty (e.g. choice) is more important than saving lives when it comes to vaccine…
Why is it so hard to be rational?
141–150 of 309 posts
Re: Why is it so hard to be rational?
#142Earlier quoted context omitted.
Yudkowsky and other prominent contributors set "the" goal as a sort of revealed wisdom regarding their speculations about what a super powerful AI will do. Pragmatically, the goals themselves appeal to individuals who want to maintain conventional (liberal) morality yet also position themselves as superior, typically as a form of compensation.
position themselves as superior This is why we can't have nice things. Any time someone tries to find more effective ways of making good decisions or accomplishing their goals, someone has to bring out the most tortured cynical interpretation to tear them down.
Re: Why is it so hard to be rational?
#143Earlier quoted context omitted.
> Correct. Rationality is Bounded. That fact won a Nobel Prize. It's a model not a fact. As a model, it can't really be correct only more or less accurate.
> It's a model not a fact. As a model, it can't really be correct only more or less accurate. This is not true. Models of an external world may be only more or less accurate, but models of other models may be true or false. Mathematical proofs rely on this. Rationality itself is a model so models of rationality may be true or false.
In economy in a way that is not dissimilar to physics, model has a precise meaning. To quote Wikipedia, it is a simplified version of reality that allows us to observe, understand, and make predictions about economic behavior. You can't have a model of a model. That just doesn't really make sense.
> Mathematical proofs rely on this
I'm confused by what you want to say here. Mathematical proofs don't use models.
Every proved statements in mathematics can be built from axioms which are presupposed true applying logical rules which are themselves part of the axiomatic system. Saying that something is mathematically proved basically means that given this set of rules we can build up to that point.
> Rationality itself is a model
Once again I'm fairly lost by what you are trying to mean. I'm fairly certain that for most accepted meaning of the world model and the world rationality, rationality is in fact not a model in the same way that a dog is not a theory.
Re: Why is it so hard to be rational?
#144Earlier quoted context omitted.
I wouldn’t be surprised to learn that even being less wrong is NP-hard.
The saving grace of being able to survive in the universe is that it's possible to climb up NP hard problems far enough to get real results with hard work.
Re: Why is it so hard to be rational?
#145Re: Why is it so hard to be rational?
#146Nobody wants to deal with rational people. Big business want people to buy things they don't need, with money they don't have to impress people they don't like Politicians want people who will drink the cool-aid and follow what they (the politicians) say (and not what they do) Religions... well, same. And so all messages from advertisement, to movies, TV, narrative is about hijacking people's feelings and suppressing…
Re: Why is it so hard to be rational?
#147Studying logical fallacies and behavioral economics biases have been the best ways for me to become more rational. I'm constantly calling myself out for confirmation bias, home country bias, and the recency effect in my internal investment thought process. Learning about logical fallacies and identifying them in conversations is great. Don't tell the counterparty of their logical fallacies in conversations cause that…
Some are grateful to have them pointed out, after a bit of initial discomfort and resistance. Didn’t work out so well for Socrates of course, but we’re more enlightened now.
We hope.
Re: Why is it so hard to be rational?
#148Re: Why is it so hard to be rational?
#149Re: Why is it so hard to be rational?
#150I maintain that it isn't just hard, it is computationally impossible. We should all know that given a belief about the world, and evidence, Bayes' Theorem describes how to update our beliefs. But what if we have a network of interrelated beliefs? That's called a Bayesian net, and it turns out that Bayes' Theorem also prescribes a unique answer. However, unfortunately, it turns out that working out that answer is NP-h…
I further maintain that it's definitionally impossible. Before we find it computationally impossible, we will find that we can't write the a complete, detailed requirements specification defining what rational is.
(Of course, we recognize egregious irrationality when we see it; that's not what I mean; you can't just define rationality as the opposite of that.)
People can behave rationally (or not) with respect to some stated values that they have. But those can be arbitrary. So the requirement specification for rationality has to refer to a "configuration space", so to speak, where we program these values. This means that the output is dependent on it; we can't write some absolute test case for rationality that doesn't include this.
Problem is, people with different values look at each other's values and point to them and say, "those values are irrational; those people should adopt my values instead".