Live data from Hacker News

Where will artificial general intelligence come from?

docs.google.com

31–40 of 252 posts

Re: Where will artificial general intelligence come from?

#32

Background: I did AI and Philosophy of Mind in undergrad, an MSc focused on ALife, then a PhD at Yale under a Macarthur Fellow who developed the theoretical framework for the 'evolution of Evolvability' where I worked on computational evolutionary biology. I can say we're not going to blindly brute force our way forward, but instead we'll need to reverse engineer nature's core algorithms to generate hard AI. Every ti…

I'd love to read your thesis. Would you please a link?

Re: Where will artificial general intelligence come from?

#33

Background: I did AI and Philosophy of Mind in undergrad, an MSc focused on ALife, then a PhD at Yale under a Macarthur Fellow who developed the theoretical framework for the 'evolution of Evolvability' where I worked on computational evolutionary biology. I can say we're not going to blindly brute force our way forward, but instead we'll need to reverse engineer nature's core algorithms to generate hard AI. Every ti…

Can you link to some of your work, this is very interesting stuff

Re: Where will artificial general intelligence come from?

#34
post #12
post #7

That was really interesting. I'm interested why he's so pessimistic about the simulating a brain approach. Yes it's the boring and obvious approach but it also seems the most direct. Also found this quote interesting > Might have to make it illegal to evolve AI strains or an upper bound of computation per person and closely track all computational resources on earth.

The brain is slow and redundant. It has to be like that because it is not produced in a factory - it is created by self replication. Self replication imposes strict limits and requirements on the type of brain that can be created. AI neurons, on the other hand, are perfect - they never get old or tired and always remember. A neural net like ResNet-150 is capable of doing essentially what 1/3 of the brain is doing (vi…

The brain is slow in "cycles"/second, but the amount of computation done by each cycle isn't directly comparable to that done by a computer.

Forgetting isn't a bug, it's a feature. Forgetting is basically like dimensionality reduction on input data - we extract the principle components/exemplars, remember a weighting, and trash the redundancy. Training a ML model is a lot faster on smaller data, and the same is true for us.

Don't compare ANNs with the brain strictly on a time/time basis. Time isn't the only factor, power consumption and heat production are also factors, and if you include them the brain comes out way ahead.

People with an engineering background almost universally underestimate how freaking awesome biology is. Our brains are self-constructing, self-replicating, self repairing (mostly) hyper-efficient pattern recognition systems. The more we learn about them the more awesome we realize they are. Don't be so arrogant as to assume a few hundred years of engineering will universally eclipse hundreds of millions of years of evolution.

Re: Where will artificial general intelligence come from?

#35

I'm waiting for the day when there is an IA OS. Basically there would be a Natural Language processor that determines what sub AI app to run. It's not true general AI but if it's done broad enough it will seem like it.

Google and FB have most to gain from a capable conversational agent. The moment this system will appear, it will start replacing the old interfaces, and pretty soon eat the G-FB pie. If they are not on top of the wave then, they'll lose.

Current state of the art in dialogue AI is an agent that can reason based on images, documents or tables with data. There is a lot of research into attention and memory augmented neural nets. I put my bet on graph based neural nets, that can better represent object and relations in reasoning tasks.

Re: Where will artificial general intelligence come from?

#36
I'm working on a technology that I think might enable either IA or AI. Basically intelligences manage their own programs and the computational resources allocated to those programs. So I'm looking at doing that with markets.

With IA the user acts as feedback to the market about what is good or bad. Ideally it would act as an external brain lobe. More information on my approach is on this blog https://improvingautonomy.wordpress.com/2017/07/25/why-study...

Re: Where will artificial general intelligence come from?

#39
post #4

I think a very interesting aspect of general AI is that while an incredibly complex technology, it is not unrealistic that it could be created for the first time in someone's home office. Unlike many other earth changing technologies there is nothing that a massive corporation has that a home tinkerer does not (besides the obvious of money and many engineers). With the rise of cloud computing and open source; everyth…

Cloud computing will not help home tinkerer much if you need 100K/hour worth of compute to run an experiment.

If we move towards hierarchical model composition, you don't need to rebuild the visual object recognition module to experiment in learning spaces that incorporate visual information.

Re: Where will artificial general intelligence come from?

#40
If you take a look at the evolution of the most advanced non artificial general intelligence, eg. human intelligence, it is strongly connected to the evolution of communication. It is a question of efficiency whether you learn through your own experience and failures or through the experience and failures of others. This teaching/learning process was boosted through the use of pictures, spoken language, hand written and printed books. This is why I believe the artificial general intelligence will we teached by an other artificial general intelligence and this evolution will be somehow connected to language processing. As far as I know Google tries to train its AIs through human imput, eg. to recognize animals drawn by humans. I consider it as one of the first steps in the right direction.
Post reply on HN