I would be willing to spend an entire lifetime to perfectly understand how this algorithm works. Currently I can barely write Djikstra's algorithm.
You can watch the RL course given by one of the inventors of AlphaGo, David Silver. https://www.youtube.com/playlist?list=PLzuuYNsE1EZAXYR4FJ75j...
AlphaGo Zero: Learning from scratch
281–290 of 324 posts
Re: AlphaGo Zero: Learning from scratch
#282Earlier quoted context omitted.
So, in your view, starting MIRI, doing fundamental research into AI safety and advocating for it, is not trying to find the damn light? You exemplify exactly the attitude he's trying to combat. "Oh, nobody knows anything, let's not care about consequences and do whatever."
Sorry but I don't really see Yudkowski's contributions as "fundamental research into AI safety". More like navel-gazing without any practical implications. At best, listening to him is just a waste of time. At worse, AGI is a real imminent threat and having people like him generating useless noise like he does will make it harder for legitimate concerns to be heard, when the time comes.
What are _you_ doing to make legitimate concerns heard then? Did you even read the article you were complaining about?
Re: AlphaGo Zero: Learning from scratch
#283Earlier quoted context omitted.
It also presumes that one can simulate the world at low cost. In AlphaGo Zero it takes 0.4 s for 1.600 node extensions, but in this case the cost of the world is negligible. Anyway, assuming you need that many node extensions to get decent quality updates, that puts a rather a tight limit on the cost of simulating the world.
DM has already done a bunch of work on 'deep models' of environments to plan over. Use them and you have 'model-predictive control' and planning, and this tree extension to policy gradients would work as well (probably). It could be pretty interesting to see what would happen if you tried that sort of hybrid on ALE.
Re: AlphaGo Zero: Learning from scratch
#284Earlier quoted context omitted.
I'd certainly be surprised if I ever woke up from being cryopreserved. Which isn't to say that I'd object to the process if I had the disposable income and an understanding/cooperative family support structure, which I do not.
I wonder if it would be more popular if the cost was reduced to something similar to a regular funeral. It seems it might be a more cheery send off even if the chances of it working are questionable.
Re: AlphaGo Zero: Learning from scratch
#285Earlier quoted context omitted.
I don't think you can apply this to alphago. I think probability for a human to beat alphago now is zero. Lee Sedol's single victory is the first and the last.
I disagree. This is precisely what the ELO predicts, and it has been pretty accurate over time - it's a good metric.
Re: AlphaGo Zero: Learning from scratch
#286Earlier quoted context omitted.
I disagree. This is precisely what the ELO predicts, and it has been pretty accurate over time - it's a good metric.
For humans yes. For humans against machines? I don't think so. Can any human beat a modern chess computer? The chance is zero.
Alpha particles can flip bits and cause erratic behavior, can they not?
"[The probability of] at least one bit error in 4 gigabytes of memory at sea level on planet Earth in 72 hours is over 95%"
Re: AlphaGo Zero: Learning from scratch
#287Earlier quoted context omitted.
For humans yes. For humans against machines? I don't think so. Can any human beat a modern chess computer? The chance is zero.
Zero means zero, yes? Alpha particles can flip bits and cause erratic behavior, can they not? "[The probability of] at least one bit error in 4 gigabytes of memory at sea level on planet Earth in 72 hours is over 95%"
Re: AlphaGo Zero: Learning from scratch
#288Is there anywhere to see the games? I'm curious if the AI is superior to humans or just human trained AI. It'd also be interesting to see the source, but that is apparently not being released for some reason.
It'd also be interesting to see the source, but that is apparently not being released for some reason. Last time this was brought up, someone implied it's closed source so as not to boost the Chinese competitor.
Re: AlphaGo Zero: Learning from scratch
#289Earlier quoted context omitted.
It'd also be interesting to see the source, but that is apparently not being released for some reason. Last time this was brought up, someone implied it's closed source so as not to boost the Chinese competitor.
If all their methods for success are in the paper the Chinese competitor can just copy that.
Re: AlphaGo Zero: Learning from scratch
#290Earlier quoted context omitted.
> Do you care to give an example? Are they more or less well defined than find-the-cat-in-the-picture problem? You mean like go over and feed the neighbor's cat while they're on vacation? How about instead, being able to clean any arbitrary building? Go isn't remotely similar to the real world. It's a board game. A challenging one, sure, and AlphaGo is quite a feat, but it's not exactly translatable to open ended tas…
At this point, there is no evidence that the limiting factor in these cases is AI/software. The limiting factor with the neighbors cat is the robotics of having a robust body and arm attachment. We know that the scope of current AI can: 1) Identify a request to feed a cat 2) Identify the cat, cat food and cat's bowl from camera data 3) Navigate an open space like a house Being able to clean an arbitrary building is a…