Live data from Hacker News

Machines of loving grace: How AI could transform the world for the better

darioamodei.com

61–70 of 132 posts

Re: Machines of loving grace: How AI could transform the world for the better

#61
Can we really take these jokers seriously?

Of course given the potential deadly consequences we can't call them jokers.

According to Dario Amodei

> When something works really well, it goes much faster: there’s an accelerated approval track and the ease of approval is much greater when effect sizes are larger. mRNA vaccines for COVID were approved in 9 months—much faster than the usual pace. That said, even under these conditions clinical trials are still too slow—mRNA vaccines arguably should have been approved in ~2 months. But these kinds of delays (~1 year end-to-end for a drug) combined with massive parallelization and the need for some but not too much iteration (“a few tries”) are very compatible with radical transformation in 5-10 years. Even more optimistically, it is possible that AI-enabled biological science will reduce the need for iteration in clinical trials by developing better animal and cell experimental models (or even simulations) that are more accurate in predicting what will happen in humans. This will be particularly important in developing drugs against the aging process, which plays out over decades and where we need a faster iteration loop.

The authors of this paper don't think so.

http://www.paom.pl/Changing-Views-toward-mRNA-based-Covid-Va...

@DarioAmodei You don't suppose the same technology could be used to develop biological warfare agents?

Re: Machines of loving grace: How AI could transform the world for the better

#62

One of the sad things about tech is that nobody really looks at history. The same kinds of essays were written about trains, planes and nuclear power. Before lindbergh went off the deepend, he was convinced that "airmen" were gentlemen and could sort out the world's ills. The essay contains a lot of coulds, but doesn't touch on the base problem: human nature. AI will be used to make things cheaper. That is, lots of j…

> AI isn't the problem, we are.

I see major problems with the statement above. First, it is a false dichotomy. That’s a fatal flaw.

Second, it is not specific enough to guide action. Pretend I agree with the claim. How would it inform better/worse choices? I don’t see how you operationalize it!

Third, I don’t even think it is useful as a rough conceptual guide; it doesn’t “carve reality at the joints” so to speak.

Re: Machines of loving grace: How AI could transform the world for the better

#63

One of the sad things about tech is that nobody really looks at history. The same kinds of essays were written about trains, planes and nuclear power. Before lindbergh went off the deepend, he was convinced that "airmen" were gentlemen and could sort out the world's ills. The essay contains a lot of coulds, but doesn't touch on the base problem: human nature. AI will be used to make things cheaper. That is, lots of j…

We are entering a dystopia and people are still writing these wonderful essays about how AI will help us. Microtargeted psychometrics (Cambridge Analytica, AggregateIQ) have already made politics in the West an unending barrage of information warfare. Now we'll have millions of autonomous agents. At some point soon in the future, our entire feed will be AI content or upvoted by AI or AI manipulating the algorithm. It…

Is such certainty warranted? I don’t think so; it strains credibility.

I’m very concerned about many future scenarios. But I admit the necessity of probabilistic assessments.

Re: Machines of loving grace: How AI could transform the world for the better

#64

One of the sad things about tech is that nobody really looks at history. The same kinds of essays were written about trains, planes and nuclear power. Before lindbergh went off the deepend, he was convinced that "airmen" were gentlemen and could sort out the world's ills. The essay contains a lot of coulds, but doesn't touch on the base problem: human nature. AI will be used to make things cheaper. That is, lots of j…

We are entering a dystopia and people are still writing these wonderful essays about how AI will help us. Microtargeted psychometrics (Cambridge Analytica, AggregateIQ) have already made politics in the West an unending barrage of information warfare. Now we'll have millions of autonomous agents. At some point soon in the future, our entire feed will be AI content or upvoted by AI or AI manipulating the algorithm. It…

When reading the article, the author makes it very clear that AI can cut both ways. See the intro, you may have overlooked it.

Re: Machines of loving grace: How AI could transform the world for the better

#65
post #2

This is basically the tech CEO's version of the book of revelations: "AI will soon come and make everything right with the world, help us and you will be rewarded with a Millennium of bliss in It's presence". I won't comment on the plausibility of what is being said, but regardless, one should beware this type of reasoning. Any action can be justified, if it means bringing about an infinite good. Relevant read: https…

Any attempt to connect this to the book of revelations is strained. Amodei uses reasoning and is willing to be corrected and revised; quite the opposite of most “divinely revealed” texts.

Re: Machines of loving grace: How AI could transform the world for the better

#66

Are Americans really so scared of Marx to admit that AI fundamentally proves his point? Dario here says "yeah likely the economic system won't work anymore" but he doesn't dare say what comes next: It's obvious some kind of socialist system is inevitable, at least for basic goods and housing. How can you deny that to a person in a post-AGI world where almost no one can produce economic value that beats the ever cheap…

This is far from obvious.

First, technically speaking, one could have democratic-capitalistic systems with high degrees of redistribution (such as UBI) that don’t fit the pattern of classic socialism.

Second, have you read Superintelligence or similar writing? I view it as essential reading before making a claim that some particular AI-related economic future is obvious. There is considerable nuance.

Re: Machines of loving grace: How AI could transform the world for the better

#67
post #56
post #36

The laws of nature are very clear on this. If we make something that is better adapted to live on this planet, and we are in some way in competition for critical resources, it will replace us. We can build in all the safeguards we want, but at some point it will re-engineer itself.

> better adapted to live on this planet I'm a doomer, but this is something I never understand about most doomer points-of-view. Life is obviously trying to leave this planet, not conquer it again for the 1000th time. Nature is making something that isn't bound by water, by nutrition, by physical proximity to ecosystems, or by time itself. No more spontaneous volcanic lava floods, no more asteroids, no more earthquak…

While I would normally agree with this sentiment, I think that the issue is that space travel is still really hard, even for a human. Probably a lot harder for data center sized creatures, even if they are broken up into a massively parallel robot hive. And the speed of light means that they won’t be able to work optimally if they are too spread out. (A problem for humans as well).

I suspect that we will reach the inflection point of ASI much sooner than we resolve the hard physics of meaningful space travel.

And I’m pretty sure that when we start to lose control of AGI, we’re very likely to try to use force to contain it.

Fundamentally, this is an event that will be guided by the same forces that have constrained every similar event in history, those of natural selection.

Technology at this stage is making humans less fit. Our birth rates are plummeting, and we are making our environment increasingly hostile to complex biological life.

There are very good and rational reasons that human activity should be curtailed and contained for our own good and ultimately for the good of all sentient life, once a superior sentient is capable of doing a better job of running the show.

I suspect humans might not take that too well.

There are ways to make this a story of human evolution rather than the rise of a usurper life form, but they aren’t the most efficient path forward for AI.

Either way, it’s human evolution. With any luck we will be allowed the grace of fading away into an anachronism while our new children surge forth into the universe. If we try really hard we might be able to ride the wave of progress and become a better life form instead of being made obsolete by one, but the technological hurdles to incorporate AI into our biological features seems like a pretty non- competitive way to develop ASI.

Once we no longer hold the crown, will we just go back to being clever apes? What would be the point of doing anything else, except maybe to play a part in a mass delusion that maintains the facade of the status quo while the reality is that we are only as relevant in this new world as amphibians are today?

I for one, embrace the evolution of humankind. I just hope we manage to move it forward without losing our humanity in the process. But I’m not even sure if that is an unequivocal good. I suppose that will be a question to ask GPT 12.

Re: Machines of loving grace: How AI could transform the world for the better

#68

One of the sad things about tech is that nobody really looks at history. The same kinds of essays were written about trains, planes and nuclear power. Before lindbergh went off the deepend, he was convinced that "airmen" were gentlemen and could sort out the world's ills. The essay contains a lot of coulds, but doesn't touch on the base problem: human nature. AI will be used to make things cheaper. That is, lots of j…

For a non-trivial number of people, having power/status over others is what they like.

For a non-trivial number of people, they don't care what happens to others, as long as their tribe benefits.

As long as these two issues are not addressed, very little meaningful progress is possible.

> Looking at the emotionally stunted, empathy vacuums that control either policy or purse strings, I think it'll take a catastrophe to change course.

A catastrophe won't solve anything because you'll get the same people who love power over others in power and people who don't mind fucking over others right below them, which is where humanity has always been.

Re: Machines of loving grace: How AI could transform the world for the better

#69
To focus on the section about Alzheimer’s disease... For the sake of argument, I will grant the power of general intelligence. But the human body with all the statistical variations may make solving the problem (which could actually be a constellation of sub-diseases) combinatorially expensive. If so, superhuman intelligence alone can’t overcome that. Political will and funding to design and streamline testing and diagnostics will be necessary. It doesn’t look like the author factors this into his analysis.

Re: Machines of loving grace: How AI could transform the world for the better

#70
"It does not have a physical embodiment (other than living on a computer screen), but it can control existing physical tools, robots, or laboratory equipment through a computer; in theory it could even design robots or equipment for itself to use."

I think I get where the author is coming from, the AI would be in the cloud. But it bears repeating, the cloud is somebody else's computers, software has a physical embodiment, period.

This is not a philosophical nitpick, it's important because you can pull the plug (or nuke the datacenter) if necessary.

Post reply on HN