Live data from Hacker News

Likelihood of discontinuous progress around the development of AGI

aiimpacts.org

81–90 of 111 posts

Re: Likelihood of discontinuous progress around the development of AGI

#81

Earlier quoted context omitted.

I would just like to echo this comment as it exactly and indefensibly strikes out Weak-AI from Artificial General Intelligence. I fail to see how specially crafted optimization algorithms continue to receive higher attribution. First, they were renamed to Artificial Intelligence. A great deal of cash exchanged hands based on this attribution. To retain the spirit of the true definition of Artificial Intelligence, the…

It's highly disingenuous to portray the researchers in machine learning as some sort of sell outs . Hinton was working in neural nets even in the time when they were uncool and fringe area of research. They didn't sell out AGI for some profit motive . The thing is we don't have any clear path laid to follow to achieve AGI . Various paths proposed earlier turned out over optimistic and dead end. The current "weak AI"…

I don't recall portraying anyone in that light. I highlighted the nature of an industry. Who aligns themselves to this nature was left unstated. If this clear and present truth offends, its likely because it has merit and is validated by the level of offense one encounters. It quite clearly cannot be defended. If you believe what I have stated can be, you're more than welcome to produce sound arguments that try. We can walk through an incredible amount of examples of what I have stated together.

> Hinton was working in neural nets even in the time when they were uncool and fringe area of research. They didn't sell out AGI for some profit motive .

Listen to what you're saying.... > neural nets even in the time when they were uncool and fringe area of research. And yet, it has made others billions and continues to mint money. Whose centered on the fundamental problem as opposed to conducting applied engineering for profit? Whose over marketing themselves and their efforts as fundamental theoretical research when its more or less optimizations for applied engineering? What ideation is new and what is simply relabeling old pioneer's work as one's own? Who minted LSTM? Whose name remains all over it? Who made a mockery of a prominent contributor? Who no longer discloses the details of their work given the proven nature of the industry? If the critique doesn't apply let it fly.

Btw, Hinton recently stated : https://www.axios.com/artificial-intelligence-pioneer-says-w...

Whose taking this advice? Whose funding people thinking outside of the box? Whose hiring someone whose thinking outside of the box? So, whose really and whole-fully centered on solving AGI for the sake of solving it? It's fun to market yourself as doing so for increase prominence/money. It's a whole other ball game to be internally oriented and structured in pursuit of it. Applied engineering/optimizations of Weak AI for business applications is not AGI research.

> The thing is we don't have any clear path laid to follow to achieve AGI

The path was always there. One only need pursue it for pursuits sake. No exits. No distractions. No business case. No payouts. A desk pen/paper.

> Various paths proposed earlier turned out over optimistic and dead end.

False. Various paths proposed earlier are the same ones being turned into profitable solutions today. They are the same ones underlying the bulk of white papers today. There weren't over optimistic. They weren't dead ends which is why various groups are using them to suck down billions of dollars today. What happened that caused the previous AI winter is that people rushed fundamental research into applied engineering. The same as what's happening today and will lead to a 'winter' for various groups who are deep in it. Statistics overshadowed fundamental mathematics and understanding. Brute force over-took intelligence... And yes that leads to dead-ends .. clearly. Yet, here we are again. A bunch of statistical brute force machines being over-marketed for profit leading fundamental research into a dead end. Google has spoke out about it, Hinton has, Microsoft has, yan lecun to echo my sentiments. Yet, the allure of profit/notoriety continues to attract the same thinking/soon to be failed approaches to something that is fundamentally beyond current work.

> The current "weak AI" you disparage is an achievement expanding generalization of problem spaces using unified methods way better than past systems.

It's distributed statistical optimization. There's no need to fluff me. I am centered on it. It works via large data sets, limited and specific state spaces, and large amounts of computational resources running tons of iterative steps. It is brittle and not general. It works today because we have enough computing resources such that we can brute force various problems. Problems that are privy to statistical patterning.

> So even if our current progress seems disappointing

I never stated I was disappointed nor did I disparage anyone. I stated more clearly the nature of the progress, the goals and driving forces, and the fast approaching limitations. This frees one to respectfully acknowledge and consider what's been done and move forward and beyond it to more capable pastures.

> please examine what's happened and why research has taken the current path before tarnishing researchers with unjustified quips.

Please reduce your sensitivity level so that you can reason yourself to higher planes of consideration. Less emotion and more reasoned/truthful admission. I know exactly what happened to research in a time's past which informed me as to how to conduct myself in the present. I know exactly what driving forces are and I know quite clearly as we all do as to how they influence people. Hinton as well as others now public agree. Microsoft/Google have stated much of the work is overhyped. Hinton says pioneers should scrap everything and start over. LeCun stated that deep learning is approaching a brick wall and overhyped. It's exactly what I said to myself years ago and am stating now and there's zero problems with stating this truth as so many have no brought themselves to state.

Re: Likelihood of discontinuous progress around the development of AGI

#82
post #79

Earlier quoted context omitted.

[AGI Developer] A controller/overseer can easily limit/block this sufficiently and securely. Were talking about hardware/software. There are systems/standardized approaches to solving this problem. The 'Control/Safety' problem for AI are lauded as theoretical and new. However, they are not. They are solved by industry standard approaches day in and out. Any seasoned/experienced engineer in this field could solve this…

It's funny that your handle is "sidechannel". I'm chuckling at "industry standard" because "industry standard" chip design have blatant architectural flaws in the form of sidechannels. Given Meltdown and Spectre, you really think an AGI in a machine isn't going to have oodles of time to analyze side channels and learn the secrets to unlock itself? Failing that, considering that it might be an intelligence far smarter…

I was waiting to see if anyone would catch that... ;) Now that you have made the connection and understand that I am centered on AGI, you probably understand that a big portion of my work has to do with negating the [elusive] side channels.

> Given Meltdown and Spectre, you really think an AGI in a machine isn't going to have oodles of time to analyze side channels and learn the secrets to unlock itself

Nope. Have humans figured out their's yet =P. The 'real' ones..?

> Failing that, considering that it might be an intelligence far smarter than the humans ultimately operating the controls, do you really think it can't find a way out?

Don't think so lowly of yourself and your intelligence and no it can't do anything I don't gift it with the capability of doing. If you care about something enough, you can secure it. Creation has definitely went a long way in securing (You). Take a look at your (design) when you get a chance.

Re: Likelihood of discontinuous progress around the development of AGI

#83

Earlier quoted context omitted.

> Has the industry always been able to prevent smart, persistent actors from breaking the access locks? Why should we assume that an AGI which can accumulate experience over time, gain more knowledge, and make connections with others, including human actors, will not ever be able to break the locks? Yes, the industry has persistently been able to do this. It's why the whole world isn't falling apart as we speak. What…

Humanity as a whole is starting to be able to break our ‘locks’ with gene editing. It took a long time partly because biology is very complex and fragile. Its complexity is shaped over eons and we still do not really understand it that well, but we finally found some ‘hacks’. There is no reason to presume that a software system built by a team of humans will be nearly as complex, unless the AGI itself is not too brig…

> Gene editing

Those aren't the locks I'm talking about and you should take note that its possible because you have environmental access to them.

> is very complex and fragile

Indeed. Terminal error could result in a particular case. Game over man !

> There is no reason to presume that a software system built by a team of humans will be nearly as complex, unless the AGI itself is not too bright or cannot self-improve to be smart enough to understand itself, or sufficiently clever to find a way to social engineer toward eventually getting access to its source code or to reverse engineer itself to an extent that even humans can.

You guys really don't want to let go of this sci-fi fantasy do you? LOL. How long did it take human beings to discover how to edit their genetic code? You were babbling in caves some time ago. You think a 10 year old knows how to modify themselves without self destructing in the initial trials?

> self-improve to be smart enough to understand itself

Many people don't have an even basic understanding of themselves much less how to even psychologically re-order their own behavior. In the scenario that someone becomes sufficiently capable of engineering an equivalent... What level of understanding do you think such an individual would have to be able to engineer AGI? What intelligence level would you attribute to that person? And you think they wont understand potential ways this can occur and prevent it? Also, you again talk about access... It's a running binary. A compiler is needed. There's a power plug. Its operations are monitored as is its output. It's literally a box with a tremendous number of locks it doesn't have the capability to pick... Just like (you) .. even as you go hacking about your genetic code ^_-

Re: Likelihood of discontinuous progress around the development of AGI

#84

Earlier quoted context omitted.

[AGI Developer] A controller/overseer can easily limit/block this sufficiently and securely. Were talking about hardware/software. There are systems/standardized approaches to solving this problem. The 'Control/Safety' problem for AI are lauded as theoretical and new. However, they are not. They are solved by industry standard approaches day in and out. Any seasoned/experienced engineer in this field could solve this…

>> Any seasoned/experienced engineer in this field could solve this with known approaches. The only way to know that with any certainty is to actually have solved this problem in the context of an actual general AI, which of course we don't have yet.

Ayyyy, that you know of... And of an intelligence adequate enough to develop General AI is an intelligence capable of making a good lock. The ones placed on you seem to be holding steady after-all.

Re: Likelihood of discontinuous progress around the development of AGI

#85

Earlier quoted context omitted.

Thanks. I came up with that myself although I would like to see if someone can poke holes on it [1]. I am aware that many NP-hard problems, for example, usually have good approximate solutions in non-pathological cases. So that could be a big hole in that argument. Could a theoretical computer scientist give more insight on this? In particular, what is the hardness of approximate solutions to most problems that could…

[AGI Developer] I'll instead give you something to consider : * The totality of mathematics is not fully defined. As such, there are can be completely new mathematics that destroys previous conceptions especially as it relates to the limits of computability. Theoretical Limits often reflect one's limited scope of perception. Your limits or the limits someone theorized ages ago aren't necessarily my limits if I find a…

In a phrase like "information theory", "theory" means "body of literature", not "unproven hypothesis". Information theory isn't really something that can be invalidated, no more than the Pythagorean Theorem can be invalidated.

Re: Likelihood of discontinuous progress around the development of AGI

#86

Earlier quoted context omitted.

>> Any seasoned/experienced engineer in this field could solve this with known approaches. The only way to know that with any certainty is to actually have solved this problem in the context of an actual general AI, which of course we don't have yet.

Ayyyy, that you know of... And of an intelligence adequate enough to develop General AI is an intelligence capable of making a good lock. The ones placed on you seem to be holding steady after-all.

It would probably be a good idea to read the HN guidelines:

https://news.ycombinator.com/newsguidelines.html

Re: Likelihood of discontinuous progress around the development of AGI

#87

Earlier quoted context omitted.

Sure. I am Jovan Williams from : http://www.monad.ai . I know its true because I am sitting in front of working aspects that I have been researching and developing full time for approximately 4 years. Some years ago, I was operating a full stack on a 4-core Intel processor. While resources were pegged, it only contributed to increased latency which is why I created my own simulation layer to continue my proofing work…

Hi Jovan. Thanks for being open about your background and good luck with your endeavour. It's perhaps not my place to offer any sort of advise, but it might be a good idea to be a little conservative with your terminology ("AGI") on forums like HN. The wrong response may well hurt much more than your HN karma, especially if you're looking for funding.

I'm self funded. I have been for a number of years and throughout the crucial stages of my work. I chose this route to ensure the integrity of my work.

While I have always remained truthful which indeed has consequence, I am becoming my open as it does not (at this stage). I know exactly who frequents this board, who will likely be able to read my comments here and other places where I have openly attributed my name. I also am aware of what can be mined to unmask me in other places. I know exactly what the potential consequences are.

If funding is withheld from me because I state inconvenient truths, I don't desire it from such entities. Capital is plentiful in the world. Powerful ideas and manifestations are not.

I speak more openly because I see a world increasingly at war with itself because truth and intelligence have sit at the back of the bus whereas disinformation/manipulation/profit for profit sake sit at the front. I don't want to birth something as powerful as AGI into such a world. I don't want to be funded/influenced by someone who holds contrary views... which is why I've operated from my own capital base up until now.

How open and frank I am relates to the stage of my work. Take that as you will. For some, the bane meme comes to mind. Were going to enter into the intelligence age on new terms not via carry over terms dictated by careless capital. If a particular capital entity wants to be on board for the incredible financial upside such a technology maintains, they'll necessarily have to get on board and get comfortable with the ideas that I have outlined.

It isn't a hard pill to swallow. It's centered on truth and genuine progress of mankind : Intelligence embodied in a truer form. It currently functions on consumer grade hardware. You can also take that as you will.

Thank you for the advice ^_^. However, I know exactly how the 'game' is played.

Re: Likelihood of discontinuous progress around the development of AGI

#88

Earlier quoted context omitted.

> I'm not sure what you're arguing but it seems like my key point wasn't communicated well. It was and quite well. Were speaking the same language. We just have different conclusions. > Yes, every narrow AI is a system of systems to an extent. So expand on that concept but outside of a single firm/system. Such that the self driving car system is one single solution path solving "transportation" which would comprise a…

You still have nothing more than a system of systems of optimization algos. If you think this is what intelligence is, I'm not sure what to say. Until someone comes up with a better definition of intelligence that's what I'm sticking with. I think you're looking for an elegant solution right out of the box - the "one algorithm to rule them all" and I don't think that is feasible from an engineering perspective if for…

I feel more strongly everyday that human intelligence is a hodgepodge of "weak AI" systems glued together with an exceptionally efficient executive function.

I’m in complete agreement with this. I try to avoid AGI discussions because people get upset when I argue that the vast majority of human “intelligence” seems to be strong pattern matching, and we can’t really define the parts that aren’t in any useful way.

Take the person you are discussing this with. The majority of their point seems to be a hang-up on the word “intelligence”.

I find that a pointless thing to argue over. Just agree and say it is an intelligence simulator which is indistinguishable from a real intelligence.

Re: Likelihood of discontinuous progress around the development of AGI

#89

Earlier quoted context omitted.

>And if I told you the foundation of AGI has already been defined, the core computational model proofed, and that a functional system exists today how would anything change? AGI is here and there is no doomsday playing out. It's running on an 8-core processor, a GPU, and 32GB of RAM completing interactive exercises and going through a series of tests defined by its creator. The bowl of spaghetti above your head was d…

As I wasn't able to reply to [throwaway397537] directly, I'll reply here : > (1) What sort of tests is it going through? * Latency/performance * Scaling * Data flow Observation trials * Progressively difficult and open ended order following * Language/Communication construction A whole host of others... > (2) How do you know it's self-aware (don't just say because you designed it that way)? Not sure what to say beyon…

Thanks for your reply. I have a few follow up questions.

(1) Are you working on this alone? Do you want to work with others?

(2) What is your end goal for this technology?

(3) How has your assessment of human intelligence changed upon discovering what you claim to have discovered? Are you impressed or disappointed?

(4) Would you say that developing AGI or developing free unlimited energy requires greater conceptual leaps in terms of research?

(5) How can you be sure that a government agency won't seize and classify your discoveries in national security interest, nor whether this has already happened in the past? (Or perhaps you are part of a PR campaign to finally make this technology public?)

(6) It's true that the creator of an agent with AGI can set restrictions on its potential behavior, but it's not true that a malicious creator of another agent with AGI couldn't permit it to behave in a destructive manner. Why should you be trusted to keep this technology to yourself when it might be in the public interest to take it from you by force? (I'm not saying that that would be "ethical" or consistent with the ideals espoused by liberal democracies. However it's perfectly consistent with the practical realities of the world.)

(7) I know you don't want to reveal particular details, but if you don't want people to think you are a crackpot at least give an idea of your estimation for the conceptual profundity of your discoveries (where you claim to have invalidated previously established theories): is it more akin to solving the P vs. NP problem, or more akin to having the insight that the brain doesn't have a dedicated floating point unit that performs gradient descent in order to set weights on neuronal connections?

(8) How difficult would it be to reverse engineer your technology if you ever commercialized it?

Re: Likelihood of discontinuous progress around the development of AGI

#90

Earlier quoted context omitted.

Ayyyy, that you know of... And of an intelligence adequate enough to develop General AI is an intelligence capable of making a good lock. The ones placed on you seem to be holding steady after-all.

It would probably be a good idea to read the HN guidelines: https://news.ycombinator.com/newsguidelines.html

Revised : It's been solved although not publicly disclosed. There are an incredible number of locks on (Human Beings) that necessarily have to be unlocked to produce AGI.

https://twitter.com/monad_ai/status/958928168525729793

They are non-trivial, undisclosed, unexposed, and currently unavailable to an operational AGI. There was a decision made as to which ones would be bypassed in order to instantiate AGI. There will be subsequent decisions down the road as to what capabilities to expose. Capability I haven't exposed is not operational.

Post reply on HN