Earlier quoted context omitted.
> At this point, it is hard to complain. Actually, it's very easy to complain. If they released the model, people could generate arbitrarily many self-play games instead of depending on DM to release 50, could create arbitrarily many tools using the model instead of depending on DM to create and maintain a single tool, and could verify the results of training a clone based on even sketchy descriptions of the methods…
> people could generate arbitrarily many self-play games I have doubts. Their TPU design may be a large factor into making matches at this level within the time limits. And at this point, some implementation details might hook into Google-specific libraries that require the ability to spawn processes in thousands of servers, which past blog posts[0] have hinted at. [0]: https://deepmind.com/blog/decoupled-neural-netw…
AlphaGo's next move
161–170 of 179 posts
Re: AlphaGo's next move
#162So, a question bordering on the philosophical : What can be done to prepare for the end of human supremacy, and quite likely human civilization? For instance, as a software developer it feels almost pointless to continue improving at my craft if AI systems will surpass me within 2-4 years (even if the pessimists are right about it taking 5-10 years, that's still an awfully small timeframe). Likewise, it feels a littl…
Well, firstly AI outdoing us in software development is going to take a while, probably >10 years. Secondly you're looking mostly at the negatives but not positives of AI advancing. Some of those: We will likely use AI to enhance ourselves rather than just have it take over. Such merging may lead to the end of death. At the moment sure you can develop away then age and die - the AI thing may be jollier. Robots at som…
Re: AlphaGo's next move
#163There was a time not too far back when people used to be considered a "genius" for their ability to memorize things well. Nowadays nobody thinks of them as geniuses. Also, people used to be considered geniuses for knowing a lot of things. Nowadays information is just a Google search away, so knowing a lot doesn't really mean as much as it used to. What matters more nowadays is your ability to learn synthesize the thi…
Google made fact recollection less important than before. However, Google itself prefers people who do well on whiteboard interview, which could be solved perfectly by some Google searches! Memorization of historical facts is one thing, but training your memory for fast retrieval of facts and associations is still highly valued. Therefore it is still important to train your memory to the extreme. You'll do something…
I don't see the problem if these problems can also be solved without relying exclusively on knowledge.
As an outsider, I'd say that Google's hiring strategy is pretty successful.
Re: AlphaGo's next move
#164The 10 AlphaGo vs. AlphaGo games are a nice gift! I have always liked playing through great games, both Chess (using the book The Golden Dozen) and Go (modern games and the ancient Shogun Castle games). I have some history with computer Go. In the late 1970s I wrote a Go playing program in UCSD Pascal that I sold for the Apple II, and also for a lot more money I sold the source code to a few people who wanted to expe…
Do you know if there's video or audio of Peter's talk online? I just did a bit of a search but couldn't find it.
Re: AlphaGo's next move
#165Earlier quoted context omitted.
I'd love to be proven wrong but that hypothetical general AI is at least decades away in my humble opinion. It's not going to happen without many more students and researchers in the machine learning/AI field. Now would be a great time to join and make contributions.
> I'd love to be proven wrong but that hypothetical general AI is at least decades away in my humble opinion. I hope so. General AI is the source of dreams and nightmares, and I think it will take us decades just to adequately prepare for it from a safety & management perspective. > Now would be a great time to join and make contributions. Sincere question : short of embarking on a PhD, is AI research something the a…
This also helped me realize that I'm not super excited about getting into machine learning research, because it's just way over my head. I can play around with TensorFlow, and I enjoy writing all of the code connects to a black box, but machine learning seems like an entirely different field to software engineering.
Re: AlphaGo's next move
#166Earlier quoted context omitted.
"First world problems"
It is not a "first world problem" to want to search for accurate and unbiased information.
Go back a couple of decades and you'll find central authorities and organizations with agenda to manipulate the public could easily do so because the rest 99.99% didn't have access to information.
People who wanted truth had absolutely 0 way of attaining the truth back then. Now you're complaining about how it's "hard" to search for accurate and unbiased information. It's not even THAT hard, you just need to google a bit more, sure it's not easy for everyone, but at least there's a way.
Re: AlphaGo's next move
#167Earlier quoted context omitted.
The ability to use knowledge does not come out of thin air. It is unlikely to find someone who knows how to program C++ extremely well, or solve problems in Quantum Field theory, but does not remember most of the language constructs or mathematical equations. Continuous practice involves putting in the hours at practicing an art or a science, which by itself builds muscle memory about the language syntax/equations et…
“The best geologist is he who has seen the most rocks.” – H. H. Read
"All science is either physics or stamp collecting" -Ernest Rutherford.
Re: AlphaGo's next move
#168There was a time not too far back when people used to be considered a "genius" for their ability to memorize things well. Nowadays nobody thinks of them as geniuses. Also, people used to be considered geniuses for knowing a lot of things. Nowadays information is just a Google search away, so knowing a lot doesn't really mean as much as it used to. What matters more nowadays is your ability to learn synthesize the thi…
So, explain this to me like I'm 5. If Google search means you don't need to remember any knowledge any more, why is it that possession of an English-Greek dictionary does not render one capable of speaking both languages fluently?
You can look up all the words you want. Assume you have a grammar of each language at hand, also. Do you think you would be able to speak fulently or understand a fluent speaker of a language you don't know?
Re: AlphaGo's next move
#169Earlier quoted context omitted.
Memory still matters when it matters. For example, when learning a new language. In general, good real-time performance is going to require practice and memorization. It's the trivial stuff you rarely need that's less valued. There are some other things that I think are less valued these days: - Informed speculation counts for less when you could do a search instead. Maybe a good thing? - Cleverness counts less when…
> For example, when learning a new language That's a good point, because I think this "ability to speak multiple languages" will become commoditized too through technology. You already see pieces of technology that enable you to communicate in realtime (although clunky and not accessible enough at the moment) I agree that "realtime" aspect would be the last wall that will stand to distinguish humans from machines, th…
Re: AlphaGo's next move
#170Earlier quoted context omitted.
Google made fact recollection less important than before. However, Google itself prefers people who do well on whiteboard interview, which could be solved perfectly by some Google searches! Memorization of historical facts is one thing, but training your memory for fast retrieval of facts and associations is still highly valued. Therefore it is still important to train your memory to the extreme. You'll do something…
> Google itself prefers people who do well on whiteboard interview, which could be solved perfectly by some Google searches! I don't see the problem if these problems can also be solved without relying exclusively on knowledge. As an outsider, I'd say that Google's hiring strategy is pretty successful.