So a three year old finding an unanticipated way to slip out of its chair is evidence that it is smart, but a neural net finding an unanticipated common pattern to all school bus images in its training set is evidence to the contrary?
Artificial Intelligence Is Stuck
131–140 of 189 posts
Re: Artificial Intelligence Is Stuck
#132Earlier quoted context omitted.
> Embodiment seems to be a branch with low hanging fruit, when it comes to advancing AGI. If it were "low hanging" it would have been picked already. Reinforcement learning with AI agents is hard, especially in a dynamic environment with many types of objects. I think the path towards AGI is to do simulation coupled with deep learning. Simulation would open the door to predicting non-trivial effects that cannot be le…
I'm sorry if 'low-hanging' comes off as disrespectful - I'm just guessing that aspects of embodiment, once understood, will be capable of fairly trivial description and reap large consecutive rewards. I remember your u/n from other posts, we seem to have similar interests but you are vastly more educated in the engineering of AI. What's your background, if you don't mind sharing here? I am suspicious non-contingent a…
I am just a hobbyist in machine learning. The current situation in AI is that we can only do limited aspects of perception: like vision and hearing, at a superficial level. We can recognize objects but we can't recognize relations between objects nearly as well. There is no global scene understanding yet. With text, we can do syntax and translation, but we can't do reasoning except on trivial cases. There is no power of abstraction yet, of transferring knowledge between domains, which is essential for advanced intelligence.
So, before we have an embodied agent, we need to solve the reasoning and abstraction part, and my money is on graph signal processing (a kind of neural nets) and simulators (also implemented as neural nets). We need to move from simple object recognition to reasoning and simulation on graphs of objects and relations.
Re: Artificial Intelligence Is Stuck
#133I'd dispute that AI research is stuck or that his proposed answer along the lines of "An international A.I. mission focused on teaching machines to read" is a good one. Research seems to be cracking along with AlphaGo, self driving cars and the like. Recently DeepMind have been doing interesting stuff with dreams[1], imagination[2] and body movement[3], the last one being a little reminiscent of his daughter inventin…
Yes, unsupervised learning in a VR environment seems to be paying dividends.
Re: Artificial Intelligence Is Stuck
#134What do you do when this software discovers it's rewarding to compete with you for physical space?
The problem with AGI is it'll implicitly have to model the entities it interacts with and that may present two challanges:
1) Developing robust strategies for managing an AGI discovering a greater reward response from defecting than for cooperating with people / developing strategies for managing scenarios in which a quorum of AGIs discover it's rewarding to collude to the detriment of humans / cellular life.
2) The tractability of maintaining one language model per entity across channels.
The actual implementation could be done by plugging a handful of related techniques we've developed over the past couple of years together though.
Re: Artificial Intelligence Is Stuck
#135Click-baity. AI tech isn't stuck. There are many forthcoming breakthroughs, particularly in medicine, which should really benefit humanity. Radiology is poised to let CNNs make radiologists a lot more efficient. We just need to build the labeled datasets. If we invest heavily in some AI tech, let it be to produce huge medical datasets. The software and hardware is ready. We're only lacking sufficient data to make mor…
> There are many forthcoming breakthroughs... We just need to build... Not sure how you don't see the irony. This has probably been said thousands of times for many scientific areas throughout history. Example: There are forthcoming breakthroughs in humanity being an interstellar civilization. We just need to build faster-than-light engines and terraforming equipment. Nothing major, right?
There is pretty good reason to suppose faster than light travel is impossible. Aside from our current understanding of physics there is also the question of where all the aliens are.
If FTL is possible one could see even one intelligent species possessed of such technology spreading over the galaxy over thousands of years. It would also seem decidedly odd to suppose that if faster than light is possible only we are smart enough to invent it.
Removing faster than light travel doesn't remove the question of where are all the aliens but it sure does make it easier to swallow.
Re: Artificial Intelligence Is Stuck
#136I'd dispute that AI research is stuck or that his proposed answer along the lines of "An international A.I. mission focused on teaching machines to read" is a good one. Research seems to be cracking along with AlphaGo, self driving cars and the like. Recently DeepMind have been doing interesting stuff with dreams[1], imagination[2] and body movement[3], the last one being a little reminiscent of his daughter inventin…
This is just instance #23482398 of the repeating pattern:
1. Computers can't do X (tic-tac-toe, learn XOR, chess, anything relating to images, Go, ...)
2. (4-5 years) researches decide we need to do this
3. proof delivered
Re: Artificial Intelligence Is Stuck
#137I'd dispute that AI research is stuck or that his proposed answer along the lines of "An international A.I. mission focused on teaching machines to read" is a good one. Research seems to be cracking along with AlphaGo, self driving cars and the like. Recently DeepMind have been doing interesting stuff with dreams[1], imagination[2] and body movement[3], the last one being a little reminiscent of his daughter inventin…
There's a LOT of non-Deepmind research as well, some things that have actually been published before Deepmind.
Don't get me wrong, Deepmind puts out a lot of great work, but do look at other research labs as well, especially the ones that aren't as well known. Deepmind markets their research really well, but there's a ton of other labs doing good work as well.
Re: Artificial Intelligence Is Stuck
#138> Not long ago, for example, while sitting with me in a cafe, my 3-year-old daughter spontaneously realized that she could climb out of her chair in a new way: backward, by sliding through the gap between the back and the seat of the chair. My daughter had never seen anyone else disembark in quite this way; she invented it on her own — and without the benefit of trial and error, or the need for terabytes of labeled d…
Not to mention millions of years of evolution for initialization.
Re: Artificial Intelligence Is Stuck
#139> Not long ago, for example, while sitting with me in a cafe, my 3-year-old daughter spontaneously realized that she could climb out of her chair in a new way: backward, by sliding through the gap between the back and the seat of the chair. My daughter had never seen anyone else disembark in quite this way; she invented it on her own — and without the benefit of trial and error, or the need for terabytes of labeled d…
> I really hate the constant comparisons of AIs to babies
Constant comparison? First time I see this comparison to a child.
And btw, it's about that we always equal AI with machine learning, pattern matching, etc.
To be as smart as a 3 year old, we need something entirely different, something way beyond machine learning and all the as AI classified techniques we are aware of today (I think this is what the author meant).
Re: Artificial Intelligence Is Stuck
#140I'd dispute that AI research is stuck or that his proposed answer along the lines of "An international A.I. mission focused on teaching machines to read" is a good one. Research seems to be cracking along with AlphaGo, self driving cars and the like. Recently DeepMind have been doing interesting stuff with dreams[1], imagination[2] and body movement[3], the last one being a little reminiscent of his daughter inventin…
If you look at inventions in tech that had huge impacts it was precisely huge government investment that made it happen. Are you denying that Chinese government investment in AI is going to pay off? Read the AI literature and you will likely find a Chinese name on the literature. This is because of government investment, not despite it.
These things take time and money. The profit motive is a killer of invention.