Live data from Hacker News

Likelihood of discontinuous progress around the development of AGI

aiimpacts.org

61–70 of 111 posts

Re: Likelihood of discontinuous progress around the development of AGI

#61

Earlier quoted context omitted.

It is difficult to make arguments in something that has no grounding. I'd expect someone who claims to have a valid argument for an [intelligence explosion] event to have formal education and industry experience designing computational systems such that they could clearly define how exactly it could occur. I have yet to see such an individual w/ such a viewpoint. Instead, I see a ridiculous argument being forwarded b…

What is your argument? Why a group of engineers who can think two times faster than average cannot perform the task of designing three times faster engineer quicker than a group of average engineers? They will hit economical and physical limits eventually, sure. But what will stop them at the beginning?

> But what will stop them at the beginning?

Themselves of course. You are after-all your own worst enemy. I don't think people appreciate the incredibly slim number of individuals who are actually capable of pursuing this problem through to fruition and what their natures necessarily have to be. Do people not know of the types of individuals whose work is still being dusted off and relabeled as modern day achievements by others? The thinkers and creators of the previous AI age had certain characteristics. Certain character flaws and natures preclude you from probing certain subject matter. If you don't know much about yourself as a human being and your creation... If you haven't conquered aspects of yourself, how do you imagine you magically become capable of replicated it another domain? You don't. It's a non-starter which is why there is so much wheel spinning going on even with billions of dollars of resources and top ranking engineering talent. I really don't think people appreciate how fundamental AGI is. Look in a mirror sometime. All the answers are right there if you can find them/recognize them. Always has been.

Re: Likelihood of discontinuous progress around the development of AGI

#62
post #39

Earlier quoted context omitted.

What is your argument? Why a group of engineers who can think two times faster than average cannot perform the task of designing three times faster engineer quicker than a group of average engineers? They will hit economical and physical limits eventually, sure. But what will stop them at the beginning?

I guess the argument is, that so far no one showed good examples of how would that lead to a total extinction. How would it start, etc. So it's kind of a (fallacious) argument against "black box"-ing the whole intelligence explosion problem. If you can't define it, you can't analyze it sort of thing.

What I stated was that there isn't even a sound/reasoned example as to how a it would escape its bounds unless purposely authored to and even then you run into the scenario of human limits (its creator). Also, having no understanding on how AGI is structured, it is quite foolish to talk about bound leaping in the traditional sense of tech which is mainly associated with computer viruses that are purposely written for that sole purpose. There's nothing to even suggest you can purposely author AGI in such a fashion. So...

> How would it start, etc.

There has been no credible framing on how it would even start. As such, it's a null point of discussion.

> If you can't define it, you can't analyze it sort of thing.

With no definition, you can 'attempt' to analyze it and you'll likely be horribly off the mark, wasting tons of resources, and likely produce something that has no bearing on the real thing. Instead of admitting this, it's like people put full faith in these efforts being sound when the reality is the exact opposite. Why engage in this, unless your aim is profit/notoriety, when you could be working on the actual problem? Define intelligence [first]. Time to be honest with oneself. Time to stop projecting ones shortcomings on others. Time to stop using fear/uncertainty/doubt to obscure one's true intent. Time to stop pushing the disinformation cloud. Time for TRUE intelligence.

Re: Likelihood of discontinuous progress around the development of AGI

#63
post #37

Earlier quoted context omitted.

That's quite a bad argument when it comes to "existential risk for all of humanity". Of course, so far no one has any idea how pragmatically it could play out. Maybe it'll start with something as banal as VisualStudio + Cortana providing an advantage to AI design, that helps designing a better Cortana, that helps designing a better Cortana, that ... Yes, of course, it's unlikely in the coming next 1-2 decade, because…

> That's quite a bad argument when it comes to "existential risk for all of humanity". It's not a bad argument. It's the standard for creating one. Engineers get paid to resolve risk/problems. So, if you claim there is one and it is fantastically an 'existential risk for all of humanity', one should at least be able to explain how exactly it exists in the most basic technical terms. I haven't heard a single example o…

>And if I told you the foundation of AGI has already been defined, the core computational model proofed, and that a functional system exists today how would anything change? AGI is here and there is no doomsday playing out. It's running on an 8-core processor, a GPU, and 32GB of RAM completing interactive exercises and going through a series of tests defined by its creator. The bowl of spaghetti above your head was decoded and a functional equivalent instantiated in computer hardware. The locks are compiled binaries, read only code regions, and a power button.

(1) What sort of tests is it going through?

(2) How do you know it's self-aware (don't just say because you designed it that way)?

(3) How is this an improvement over SHRDLU (which also exhibited fairly complex behavior and "understanding" within a simulated environment)?

(4) Did you actually "invalidate a host of theories, [and] create new mathematics, new algorithms, and new theories"? Which ones?

Re: Likelihood of discontinuous progress around the development of AGI

#64

Earlier quoted context omitted.

I disagree. The naming convention [Artificial Intelligence] still is a large shoe that these purpose built applied engineering solutions have yet to fill. Meanwhile, for profit/notoriety/marketing people want to trample on yet another name space? What you just described is essentially the architecture of a self-driving car. It's yet another applied engineering solution of Artificial Intelligence. It is not Artificial…

I'm not sure what you're arguing but it seems like my key point wasn't communicated well. What you just described is essentially the architecture of a self-driving car. Yes, every narrow AI is a system of systems to an extent. So expand on that concept but outside of a single firm/system. Such that the self driving car system is one single solution path solving "transportation" which would comprise automated flight/r…

> I'm not sure what you're arguing but it seems like my key point wasn't communicated well.

It was and quite well. Were speaking the same language. We just have different conclusions.

> Yes, every narrow AI is a system of systems to an extent. So expand on that concept but outside of a single firm/system. Such that the self driving car system is one single solution path solving "transportation" which would comprise automated flight/rail etc... and is a node in a larger general system - like hub and spoke.

And you still have nothing more than a hub and spoke system of systems authored for specific problems spaces and you're spokes will increase with every new problem space until you overwhelm your hub. A horrible architectural approach that if not caught in the initial stages will result in catastrophe down the road... Weak AI is weak AI no matter how you scale it.

> You seem to be arguing that a single entity will fail if it attempts to take a narrow AI system and make it generalizable. Of which I am in agreement with.

This is a start in the right direction...

> If however there were 10,000 or 100,000 or 1,000,000 narrow AI companies/systems (like a self driving car system or alphago etc...) those could fill the corpus of solutions which an executive function system could utilize depending on the application and together they would be what we call AGI.

No, its strung together weak AI. It will require significantly and unreasonable amounts of resources. Its capability will increasingly reach diminishing returns and you'll end up with a frankenstein monster code base that no one can manage or understand.. Sounds a lot like the path Weak AI is already heading down.. At such a point, it's best to just scrap it and start all over. Something that Hinton and other prominent figures are finally admitting. Something I concluded year ago which lead me down a different path. Now, you're more than welcome to state : Well hey man that's your opinion and you're wrong and I'll wish the 10s,100s, million of narrow AI companies the best just as was conveyed to me a umber of years ago. Weak AI is Weak AI. It is a class of optimization algorithms. You can jerry rig this all you want.. You still have nothing more than a system of systems of optimization algos. If you think this is what intelligence is, I'm not sure what to say.

Re: Likelihood of discontinuous progress around the development of AGI

#65

Earlier quoted context omitted.

Your replies are probably valid for your system. I specifically noted above that what I describe is about an AGI that some other groups may develop to be a more free, less controlled system that allows it to improve faster and execute more efficiently. If an AGI can indeed learn and act at the human level or above, there are reasons to believe that a more free variety will improve faster and become more powerful than…

Firstly, there are fundamental limits that all things are subject to in this universe. When you push towards these limits, you discover this... Developing AGI pushes certain limits. There aren't many who have this capability as it requires a vast range of understanding/know-how across an incredible number of domains and into ones that have yet to be discovered. There are multiple disjoint leaps and barriers. In order…

I never said even once that an AGI will become human-level smart/mature in an instant. Another point: freedom != chaos.

The AI you develop can help fact check those (if it can understand natural language well as general intelligence should be able to). Please let us know when it can read and participate in our discussion.

Re: Likelihood of discontinuous progress around the development of AGI

#66
We're all already part of a society-scale, distributed hive mind--have been since the invention of language. Birds flock together, they eat together, they think together. Families, friend networks, cities, global societies, they all form communication topologies that have analogs in the brain. Thoughts bounce from person to person, memes spread amongst the computational fabric of groups of people. It's nothing new.

We as a society have formed networks and systems to solve problems like finding energy, producing food, and organizing economic output. We live in a distributed intelligent system that disseminates knowledge and programs our preferences, responses. We're all utilized as work units, and economics does that. I think it's a mistake to think of AGI as something separate from us, something that doesn't already exist. We're more like a cybernetic superorganism. We've put so much computational power in charge of the choices that we make, and we rely so often on recommendations from computational systems, that if you zoom out far enough, it becomes clear that we are part of a huge, cybernetic Overmind.

The Overmind is just moving more computation away from humans because hey, they're slow. It doesn't really speak to us. Do you speak to your neurons? Nevertheless, it has its goals, its resources, its needs, its preferences. People carry out its wishes, statistically. It turns out that its wishes align very well with economics: More computers! More network! More screens! Connect all the stuff! All the companies doing this are making huge dollars. The mind or minds are just centralizing now, and economics drives that. Computers already fully run the stock market. They run shipping and logistics. They are used to optimize all kinds of economic outputs. And they are used (by humans) to design better computers.

At the broadest scale, we are already that self-improving intelligent system, it just doesn't look like it from meatspace just yet.

It's kind of irrelevant if it could utter the words "I think for I am." Who would it tell that anyway?

Re: Likelihood of discontinuous progress around the development of AGI

#67

Earlier quoted context omitted.

I'm not sure what you're arguing but it seems like my key point wasn't communicated well. What you just described is essentially the architecture of a self-driving car. Yes, every narrow AI is a system of systems to an extent. So expand on that concept but outside of a single firm/system. Such that the self driving car system is one single solution path solving "transportation" which would comprise automated flight/r…

> I'm not sure what you're arguing but it seems like my key point wasn't communicated well. It was and quite well. Were speaking the same language. We just have different conclusions. > Yes, every narrow AI is a system of systems to an extent. So expand on that concept but outside of a single firm/system. Such that the self driving car system is one single solution path solving "transportation" which would comprise a…

You still have nothing more than a system of systems of optimization algos. If you think this is what intelligence is, I'm not sure what to say.

Until someone comes up with a better definition of intelligence that's what I'm sticking with. I think you're looking for an elegant solution right out of the box - the "one algorithm to rule them all" and I don't think that is feasible from an engineering perspective if for no other reason than no singular system has anything near the data collection nodes needed for specificity on the range of tasks that would suffice any definition of "General."

Having raised three other humans and observing them while building DL systems myself for a living, I feel more strongly everyday that human intelligence is a hodgepodge of "weak AI" systems glued together with an exceptionally efficient executive function. AGI is as much a community building and humanity wide input collection challenge as it is a math problem. We need to think about it that way.

Re: Likelihood of discontinuous progress around the development of AGI

#68

About AlphaZero particularly, a few things must be kept in mind. First, AlphaZero still makes use of a Monte Carlo Tree Search algorithm to search for good moves. MCTS is a powerful algorithm with a very limited scope: zero-sum, perfect information games. So for instance, it would be very difficult to see how to use MCTS-based AlphaZero in, e.g., training self-driving cars. Second, the AlphaZero architecture is preci…

I would just like to echo this comment as it exactly and indefensibly strikes out Weak-AI from Artificial General Intelligence. I fail to see how specially crafted optimization algorithms continue to receive higher attribution. First, they were renamed to Artificial Intelligence. A great deal of cash exchanged hands based on this attribution. To retain the spirit of the true definition of Artificial Intelligence, the…

It's highly disingenuous to portray the researchers in machine learning as some sort of sell outs . Hinton was working in neural nets even in the time when they were uncool and fringe area of research. They didn't sell out AGI for some profit motive .

The thing is we don't have any clear path laid to follow to achieve AGI . Various paths proposed earlier turned out over optimistic and dead end.

The current "weak AI" you disparage is an achievement expanding generalization of problem spaces using unified methods way better than past systems.

So even if our current progress seems disappointing , please examine what's happened and why research has taken the current path before tarnishing researchers with unjustified quips.

Re: Likelihood of discontinuous progress around the development of AGI

#69

Earlier quoted context omitted.

>> AGI is computable on present day hardware if one has enough knowledge on how to correctly structure it. (...) Hardware reached capability in recent years. How could you possibly know anything regarding whether this is true or not, given that we know nothing about AGI? Also, may I ask what you mean by "AGI Developer"?

Sure. I am Jovan Williams from : http://www.monad.ai . I know its true because I am sitting in front of working aspects that I have been researching and developing full time for approximately 4 years. Some years ago, I was operating a full stack on a 4-core Intel processor. While resources were pegged, it only contributed to increased latency which is why I created my own simulation layer to continue my proofing work…

[deleted]

Re: Likelihood of discontinuous progress around the development of AGI

#70

We know that for most problems, a group of people tends to be better at problem solving than an individual [1]. Even if AI technology only reaches human-level and does not exceed it, continually increasing efficiency would make AI smarter than any small groups of humans and immense bandwidth relative to human communications would make it more effective than any large human organizations. [1] https://aiimpacts.org/coo…

I am not entirely convinced by the 'most problems are exponentially hard' argument, as problem-solving often has synergistic effects - e.g. consider calculus, developed in solving the problem of planetary orbits, but useful for so much more. On the other hand, trying to discern a general rule from historical data is complicated by the fact that the number of problem-solvers has been growing exponentially.

I think the better argument is that most "breakthroughs" are exponentially hard, or we wouldn't consider them breakthroughs!
Post reply on HN