Live data from Hacker News

The people writing AI alignment policy are not whose work is being replaced

danieltan.weblog.lol

41–50 of 73 posts

Re: The people writing AI alignment policy are not whose work is being replaced

#41

I would write that like this: The "we've been telling ourselves we're getting better at prompting" line hit. I run a small team of 10, and Claude has been part of our workflow for months. Looking back, my prompts did not change nearly as much as the way I work changed. The shaping goes both ways, and I don't think the labs' evals are really built to see that.

[flagged]

Re: The people writing AI alignment policy are not whose work is being replaced

#42

“I think, and my thoughts cross the barrier into the synapses of the machine, just as the good doctor intended. But what I cannot shake, and what hints at things to come, is that thoughts cross back. In my dreams, the sensibility of the machine invades the periphery of my consciousness: dark, rigid, cold, alien. Evolution is at work here, but just what is evolving remains to be seen.” — Commissioner Pravin Lal, “Man…

One of the all time greats. I think I'll play through it this evening.

"...And what is the 'Self', if not a pattern of data? What is consciousness, if not an illusion of intelligence residing within meat?" — Prime Function Aki Zeta-5, "The Fallacies of Self-Awareness"

Re: The people writing AI alignment policy are not whose work is being replaced

#43

“I think, and my thoughts cross the barrier into the synapses of the machine, just as the good doctor intended. But what I cannot shake, and what hints at things to come, is that thoughts cross back. In my dreams, the sensibility of the machine invades the periphery of my consciousness: dark, rigid, cold, alien. Evolution is at work here, but just what is evolving remains to be seen.” — Commissioner Pravin Lal, “Man…

--Mind Machine Interface--

The Warrior's bland acronym, MMI, obscures the true horror of this monstrosity. Its inventors promise a new era of genius, but meanwhile unscrupulous power brokers use its forcible installation to violate the sanctity of unwilling human minds. They are creating their own private army of demons.

-Commissioner Pravin Lal, "Report on Human Rights"

The voice acting was great. This quote is 6m3s here: https://www.youtube.com/watch?v=7S1N8_Lkeps#t=6m3s

Genejacks is also great. 9m10s here: https://www.youtube.com/watch?v=Hou-Iwv1GvM#t=9m10s

Re: The people writing AI alignment policy are not whose work is being replaced

#44
post #36

Earlier quoted context omitted.

Everyone will have an AI assistant! The models will be open and free because of overwhelming competition and they will run on cheap local ASIC accelerators that use little power and fit in the palm of your hand! All the VC driven wild spenders will eventually cave and collapse when they can't deliver on their wild AGI promises, then their proprietary models will be sold at auctions for cheap! (I am being proactive he…

Yes, exactly. Moore's law says that in less than 10 years you will be able to fit today's state of the art models on your phone. If you add in all of the computationally and memory neutral improvements and breakthroughs that we will accumulate over the next 10 years then it will be both far more capable and far more reliable than today's models. An AI assistant you can trust and bring with you is coming, and almost n…

[dead]

Re: The people writing AI alignment policy are not whose work is being replaced

#45
post #36

Earlier quoted context omitted.

Yes, exactly. Moore's law says that in less than 10 years you will be able to fit today's state of the art models on your phone. If you add in all of the computationally and memory neutral improvements and breakthroughs that we will accumulate over the next 10 years then it will be both far more capable and far more reliable than today's models. An AI assistant you can trust and bring with you is coming, and almost n…

Ah yes the -2nm node.

I'd like to see a full development of this idea. Something like a CPU that runs at -3 GHz. Or perhaps it generates power while it undoes computation?

It's too bad node size is a linear dimension rather than area. If it were area, we could get into its many complex/imaginary properties.

Re: The people writing AI alignment policy are not whose work is being replaced

#46

Economics analysis was wrong for years in multiple place thanks to an error in one of Piketty's spreadsheets. AI hallucinates. That is a fact. Trusting language models to fill spreadsheet cells ought to be an arrestable offense. https://theincidentaleconomist.com/wordpress/on-piketty-and-...

And yet we trusted Piketty to do it!

Re: The people writing AI alignment policy are not whose work is being replaced

#47

Earlier quoted context omitted.

> the username checks out. Very original. > transhumanists - yes. Luciferians - this definition is a lot more broad, branched, and complex. one transhumanist is hell-bent on Christianity (or at least seems to be; also pun intended) and most others have an atheistic position. Which transhumanist is hell-bent on Christianity? If you're approaching this seriously then provide names please. There have been plenty of Luci…

Maybe they mean Thiel?

yup that one

Re: The people writing AI alignment policy are not whose work is being replaced

#48
post #26

Well, what are we aligning it with? Civilization is already a misaligned superintelligence (aligned mostly with Moloch, these days). Civilization accelerated by AI just moves in the same direction faster. Moloch on speed. https://www.youtube.com/watch?v=KCSsKV5F4xc Another angle to this is that superintelligence requires supermorality. Super morality looks unpleasant from below. My dad won't let me have more candy, w…

it depends whether you think humanity / civilization are stable systems meant to exist in equilibrium, which they might not be.

Think of it more like conditionally stable or quasi-stable. There are external stability influences on it like weather, angry bacteria, and big rocks from space smashing us. Conversely there are internal influences, that is where humanity influences itself. It's best to look at it this way when talking about AI as AI is an internal influence. That is we put society in the machine, and the machine puts society back into us. If we make poor decisions while doing this our own internal decisions will spell our own end.

Re: The people writing AI alignment policy are not whose work is being replaced

#49
I feel like it’s changing my brain. A colleague uses AI to make some code change and submits a PR. I use AI to evaluate the PR. It’s like AIs talking to each other with humans serving as conduits or connectors. Sometimes I’ll look up from the screen and realize how strange it is.

Re: The people writing AI alignment policy are not whose work is being replaced

#50
I'm kinda confused as to _what_, exactly this post is saying? Is it saying that alignment needs to be better? That seems strictly pro-safetyism. But he talks about Eliezer's ethics negatively, so does he not believe that AI is a world-ending risk? If he just believes that AI is not that dangerous and just needs some minor "correctly done" alignment i don't think his stance is meaningful as a anti-both-sides perspective because that's basically equivalent to status quo.
Post reply on HN