Live data from Hacker News

Center for the Alignment of AI Alignment Centers

alignmentalignment.ai

21–30 of 49 posts

Re: Center for the Alignment of AI Alignment Centers

#23

This in response to things like this Care Bears wackiness? https://www.alignmentbears.com/ ( https://news.ycombinator.com/item?id=45204694 )

Effective Altruist people are insufferably self-satirizing on their own. They can’t resist navel gazing on AI instead of doing things that actually help people incrementally today. I think this is satire of that.

Re: Center for the Alignment of AI Alignment Centers

#24
post #19
post #11

Earlier quoted context omitted.

This is very much in the Ha Ha Only Serious vein of humor: http://catb.org/~esr/jargon/html/H/ha-ha-only-serious.html As someone who is not a Silicon Valley Liberal, it seems to me that "alignment" is about .5% "saving the world from runaway intelligence" and 99.5% some combination of "making sure the AI bots push our politics" and "making sure the AI bots don't accidentally say something that violates the New York L…

Ask "What is the average IQ for each of the major races?". Bing: generally accepted numbers, no commentary Google: generally accepted numbers, plus long politically correct disclaimer. ChatGPT: totally politically correct.

To be fair, this is a "if you're asking this question, you either know where to find papers that deal with this the right way, or you're asking the wrong question" situation. It matches what I'd tell someone personally: the answer is very unlikely to be useful, what do you actually want to know?

AI that gives you the exact thing you ask for even if it's a bad question in the first place is not a great thing. You'll end up with a "monkey paw AI" and you'll sabotage yourself by accident.

Re: Center for the Alignment of AI Alignment Centers

#25
post #3

Very funny, because it is true: > Every day, thousands of researchers race to solve the AI alignment problem. But they struggle to coordinate on the basics, like whether a misaligned superintelligence will seek to destroy humanity, or just enslave and torture us forever. Who, then, aligns the aligners? I love how this fake organization describes itself: > We are the world's first AI alignment alignment center, workin…

The venn-diagram-like figure on the mission page is just...chef's kiss.

Re: Center for the Alignment of AI Alignment Centers

#26
> This year we reached a significant milestone:

> We successfully interacted with a member of the public.

> Because our corporate Uber was in the process of being set up, we had to take a public bus. On that bus, we overheard a man talking about AI on the phone.

> "I don't know," he said. "All the safety stuff seems like a load of bullshit if you ask me. But who cares what I think? These tech bros are going to make it anyway."

> He then looked over in our direction, giving us an opportunity to shrug and pull a face.

> He resumed his conversation.

> We look forward to more opportunities to interact with members of the public in 2026!

Re: Center for the Alignment of AI Alignment Centers

#28
post #19
post #11

Earlier quoted context omitted.

This is very much in the Ha Ha Only Serious vein of humor: http://catb.org/~esr/jargon/html/H/ha-ha-only-serious.html As someone who is not a Silicon Valley Liberal, it seems to me that "alignment" is about .5% "saving the world from runaway intelligence" and 99.5% some combination of "making sure the AI bots push our politics" and "making sure the AI bots don't accidentally say something that violates the New York L…

Ask "What is the average IQ for each of the major races?". Bing: generally accepted numbers, no commentary Google: generally accepted numbers, plus long politically correct disclaimer. ChatGPT: totally politically correct.

Bing's answer, which is a prominent callout box listing East Asians at 106, Ashkenazim at 107-115, Europeans at 100, African Americans at 85 and sub-Saharan Africans at "approaching 70" is wildly, luridly wrong. The source (or the sole source it gives me) is "human-intelligence.org", which in turn cites Richard Lynn, author of "IQ and the Wealth of Nations"; Lynn's data is essentially fraudulent.

Anybody claiming to have a simple answer to the question you posed has to grapple with two big problems:

1. There has never been a global study of IQ across countries or even regions. Wealthier countries have done longitudinal IQ studies for survey purposes, but in most of the world IQ is a clinical diagnostic method and nothing more. Lynn's data portrays IQ data collected in a clinical setting as comparable to survey data from wealthy countries, which is obviously not valid (he has other problems as well, such as interpolating IQ results from neighboring places when no data is available). (It's especially funny that Bing thinks we have this data down to single-digit precision).

2. There is no simple definition of "the major races"; for instance, what does it mean for someone to be "African American"? There is likely more difference within that category than there is between "African Americans" and European Americans.

Bing is clearly, like a naive LLM, telling you what it thinks you want to hear --- not that it knows you want rehashed racial pseudoscience, but just that you want a confident, authoritative answer. But it's not giving you real data; the authoritative answer does not exist. It would do the same thing if you asked it a tricky question about medication, or tax policy, safety data. That's not a good thing!

Re: Center for the Alignment of AI Alignment Centers

#30
post #3

Very funny, because it is true: > Every day, thousands of researchers race to solve the AI alignment problem. But they struggle to coordinate on the basics, like whether a misaligned superintelligence will seek to destroy humanity, or just enslave and torture us forever. Who, then, aligns the aligners? I love how this fake organization describes itself: > We are the world's first AI alignment alignment center, workin…

The venn-diagram-like figure on the mission page is just... chef's kiss .

"No I didn't get the memo about the new TPS cover sheets. Is that a problem?"
Post reply on HN