Live data from Hacker News

Pause Giant AI Experiments: An Open Letter

futureoflife.org

61–70 of 1001 posts

Re: Pause Giant AI Experiments: An Open Letter

#61
post #9
post #4

Big red font at top says "EMBARGOED UNTIL WEDNESDAY MARCH 29 00:01 AM EDT. No media coverage & no online linking." I'm sorry but who do these people think they are? Next...

They have 900 signatures already..

900 signatures vs... probably more than 900 people who use ChatGPT daily. And 4 million people watched a remixed GameCube boot screen with fart sounds that I made in middle school.

Re: Pause Giant AI Experiments: An Open Letter

#62

"Please stop training these AI" is almost comical, even if they are right and the signers are significant. It would be far more effective to lobby for legislation on, say, liability related to the use of AI, data privacy (especially when it comes to training datasets), psycological manipulation, actual AGI research bounds and so on. They are just burning donator money with messages like that, and the research is not…

Is anyone even trying to develop an AGI by the way? I mean a language model is neat, may even pick up some emergent features, but in the end it has no real identity. It's basically a memoryless computer doing improv where it tries to pick continue a conversation someone else had.

Maybe not a "real" AGI, but a system that could adequately impersonate an AGI with improv and self training seems quite practical in the near future.

https://en.m.wikipedia.org/wiki/Philosophical_zombie

Re: Pause Giant AI Experiments: An Open Letter

#63

> ... nonhuman minds that might eventually outnumber, outsmart, obsolete and replace us... loss of control of our civilization... I don't think these concerns are very likely, but I find them considerably easier to imagine than a VC-funded company voluntarily surrendering market advantage.

""" In parallel, AI developers must work with policymakers to dramatically accelerate development of robust AI governance systems. These should at a minimum include: new and capable regulatory authorities dedicated to AI; oversight and tracking of highly capable AI systems and large pools of computational capability; provenance and watermarking systems to help distinguish real from synthetic and to track model leaks; a robust auditing and certification ecosystem; liability for AI-caused harm; robust public funding for technical AI safety research; and well-resourced institutions for coping with the dramatic economic and political disruptions (especially to democracy) that AI will cause. """

All your datacenter are belong to us too

Re: Pause Giant AI Experiments: An Open Letter

#64
post #41

GPT-4 might be close to the best we'll get on the general LLM model front for a while since they trained on a huge chunk of web text. Next real advances will probably be in tuning them for specific applications in medicine, law, accounting, marketing, coding and etc. As someone running a one man company I can't wait for the cost of accounting, legal and copywriting to approach 0. Cost of shipping products will also g…

I wonder how it will be able to do that for the tech that will be current in 10 years, if mostly everyone will be using AI by then instead of asking on Stack Overflow.

Re: Pause Giant AI Experiments: An Open Letter

#65

Can an AGI be controlled, and if it is, who will dictate its actions and to whom will the benefits accrue. What happens to the service economy and the political stability when the middle class paper pushed get decimated.

> Who will dictate its actions and to whom will the benefits accrue?

Corporations, of course.

Capitalist society has never achieved a consensus on the proper limits of corporate power. There is a school of thought, popularized by Milton Friedman, that says the only duty of corporations is to their stockholders. This is about to backfire. If we treat AIs as a component of corporate power, there are few limits on what they can do.

Changes will come when AI systems start outperforming CEOs. Which may not be far off.

Re: Pause Giant AI Experiments: An Open Letter

#68
> Should we automate away all the jobs, including the fulfilling ones?

You don't necessarily need jobs because you don't need money. What you need is wealth. I am going to leave it to PG to explain the difference [1]: Wealth is not money. Wealth is stuff we want: food, clothes, houses, cars, gadgets, travel to interesting places, and so on. You can have wealth without having money. If you had a magic machine that could on command make you a car or cook you dinner or do your laundry, or do anything else you wanted, you wouldn't need money. Whereas if you were in the middle of Antarctica, where there is nothing to buy, it wouldn't matter how much money you had.

In the next 10 years, AI/robots will generate wealth at an unprecedented scale. Food, clothing and shelter will be plentiful. The industrial revolution didn't make human lives miserable, it made it better. AI/robots will be the same. Because of productivity gains humans will work very little, and yet live comfortably.

As a practical example of how this works, look to Alaska. If you lived in Alaska last year and had a pulse you received $3,284 just for living there. Where does the state get money for this? Oil. Oil is not the only possible source of wealth. AI & robots will generate wealth at unprecedented scale, and humans will reap the benefits, the same way Alaskans reap the benefits of their natural resources.

[1] http://www.paulgraham.com/wealth.html

Re: Pause Giant AI Experiments: An Open Letter

#69
I understand that some people find this a hopeless gesture. But I think anybody who thinks "losing jobs" or "China" is a bad outcome from AI is hopelessly lost.

The upside of AI if done right - nobody ever having to work again The downside of AI if done wrong - end of humanity

It doesn't take a rocket scientist to determine we've made AIs go from thinking like an ant to thinking like a 6-year-old in a few years. Anybody who believes we won't make AI 2, 3, 27 times smarter than any human who ever lived is kidding themselves.

Now ask yourself, if there was a human that was 27 times smarter than anybody else (and could self-replicate at will), how long would it be until that individual took control over the world?

Re: Pause Giant AI Experiments: An Open Letter

#70
post #41

GPT-4 might be close to the best we'll get on the general LLM model front for a while since they trained on a huge chunk of web text. Next real advances will probably be in tuning them for specific applications in medicine, law, accounting, marketing, coding and etc. As someone running a one man company I can't wait for the cost of accounting, legal and copywriting to approach 0. Cost of shipping products will also g…

I’m not sure I’m looking forward to the politics that would come out of 10-20% of the previously middle class becoming instantly redundant and out of (middle-salary) work. That’s the fast path to fascism, unless we’re able to quickly implement UBI and other major societal overhauls.

This is isn't speculating, this is truthing.
Post reply on HN