Earlier quoted context omitted.
The #1 thing is it led to an elegant notion of how to compare intelligence (or rather, a parametrized family of intelligence comparators). There's a theorem called Arrow's Theorem, which basically says there's no good way to decide elections between more than 2 candidates. There are a handful of requirements an election-deciding method should have, and no method satisfies all those requirements. But Arrow's theorem h…
Taking their characterization, a definition for relative intelligence is immediate--it writes itself A definition, but not a concrete and practical way of determining the relative difference between two agents? Come on, bring this into reality. We're mostly a bunch of coders here. Stop talking about ultrafilters , concepts that are complex and thus render those of us not familiar with them unable to understand what y…
Re: John Carmack: I’m going to work on artificial general intelligence
#801The paper isn't intended to be a manual for how to practically compare agents. It will indirectly help there, I hope, by making people realize that they're looking at an election problem, and that there's a big existing literature on that subject. So in the practical case, say you have 10 different benchmarks, and some agents perform better at some of them, and others perform better at others. You could approach the problem from scratch, but it would be helpful for you to realize "oh this is an election with 10 voters and people have been studying how to decide elections for hundreds of years, I probably shouldn't reinvent the wheel". For example, it might take you many ages to essentially rediscover the Condorcet paradox and you might put inordinate effort into futilely trying to "solve" that paradox. Or you could stand on the shoulders of giants and avoid all that! https://en.wikipedia.org/wiki/Condorcet_paradox