41–50 of 141 posts
Date Approximate cost per GFLOPS inflation adjusted to 2013 US dollars --------------------------------------------------------------------------------- 1961 $8.3 trillion 1984 $42,780,000 1997 $42,000 April 2000 $1,300 May 2000 $836 August 2003 $100 August 2007 $52 March 2011 $1.80 August 2012 $0.73 June 2013 $0.22 November 2013 $0.16 December 2013 $0.12 January 2015 $0.06
Date Approximate cost per GFLOPS inflation adjusted to 2013 US dollars --------------------------------------------------------------------------------- 1961 $8.3 trillion 1984 $42,780,000 1997 $42,000 April 2000 $1,300 May 2000 $836 August 2003 $100 August 2007 $52 March 2011 $1.80 August 2012 $0.73 June 2013 $0.22 November 2013 $0.16 December 2013 $0.12 January 2015 $0.06
It seems like the drop of costs from 2007 to 2011 is higher than the previous period. What happened in 2007? Or was it just a slow down during the start of 2000s ?
Date Approximate cost per GFLOPS inflation adjusted to 2013 US dollars --------------------------------------------------------------------------------- 1961 $8.3 trillion 1984 $42,780,000 1997 $42,000 April 2000 $1,300 May 2000 $836 August 2003 $100 August 2007 $52 March 2011 $1.80 August 2012 $0.73 June 2013 $0.22 November 2013 $0.16 December 2013 $0.12 January 2015 $0.06
And then there's the metric of how pitifully little intelligence we've managed to get from all those GFLOPS. I'd say that all the GFLOPS together don't add up to the intelligence of a single Portia africana. http://news.nationalgeographic.com/2016/01/160121-jumping-sp...
Whereas if you made a spider hunting video game, I bet researchers could train AI's that could beat it within a few months. Video game playing has actually become a big area of research recently and we will soon see deep nets that can beat starcraft and other real time games that take planning and skill.
We don't marvel over the ATM reading a handwritten paper check correctly. That's a considerable achievement.
TLDR from article which supplement's eli_gottlieb's comment: "Much of today’s A.I. boom goes back to 2006, when Amazon started selling cheap computing over the internet. Those measures built the public clouds of Amazon, Google, IBM and Microsoft, among others. That same year, Google and Yahoo released statistical methods for dealing with the unruly data of human behavior. In 2007, Apple released the first iPhone, a d…
AI is moving fast. Faster than it has in a long time. In research circles, "supervised learning", or data classification problems, are considered solved. Consider the magnitude of that statement: If we have sufficient labeled data, we can predict those labels accurately on data we haven't been exposed to: fraud, faces, diseases, you name it. AI is moving fast for three reasons, which Andrew Ng summarizes neatly: 1) W…
Quick note: I think this is historically inaccurate. In World War One, the Germans had essentially no tanks, unlike the British and French. In World War II, there's a popular rumor that Polish (not French) cavalry forces charged German tanks at Krojanty, but this is itself a myth (the cavalry attack was against infantry, tanks arrived afterwards).
Earlier quoted context omitted.
Consciousness of Things is an inevitable conclusion for humanity. The singularity is upon us with the advent of man merging into machine. We are driving that growth to go to the next level. Also, containerization.
Most of what we call 'AI' today is just fancy regression methods. No need to be so grandiose.
Date Approximate cost per GFLOPS inflation adjusted to 2013 US dollars --------------------------------------------------------------------------------- 1961 $8.3 trillion 1984 $42,780,000 1997 $42,000 April 2000 $1,300 May 2000 $836 August 2003 $100 August 2007 $52 March 2011 $1.80 August 2012 $0.73 June 2013 $0.22 November 2013 $0.16 December 2013 $0.12 January 2015 $0.06
I believe the NN/ Deep learning renaissance started around 2011 -- iirc Alex net was released in 2012 and the famous Google's paper on detecting cat on youtube also around that time. It seems like the drop of costs from 2007 to 2011 is higher than the previous period. What happened in 2007? Or was it just a slow down during the start of 2000s ?
Nevertheless prices still fell by a factor of 16 between just 2000 and 2007. So the 2,000's weren't stagnant.
Earlier quoted context omitted.
And then there's the metric of how pitifully little intelligence we've managed to get from all those GFLOPS. I'd say that all the GFLOPS together don't add up to the intelligence of a single Portia africana. http://news.nationalgeographic.com/2016/01/160121-jumping-sp...
I don't buy that. Spiders can't beat a human at Go. Sure, they weren't evolved to do that. But how many generations of selective breeding do you think it would take to evolve a spider that could beat the best humans at go? Whereas if you made a spider hunting video game, I bet researchers could train AI's that could beat it within a few months. Video game playing has actually become a big area of research recently an…
I mean, creating a machine that beats us at a game we invented ourselves is one thing, but how does that compare to a species that has survived much longer on this earth than us?
I mean most people are more worried about iPhone 7 than climate change.
I am not arguing that we are not smarter than spiders, but I'm also not going to argue we truly know that we are.
It would be wise to keep our egos under control.
Earlier quoted context omitted.
Convolutional layers have been around longer than that and don't have much to do with the vanishing gradient problem, which was never that big a problem to begin with. ReLUs are helpful, but they do not lead to THAT big of a speedup. Convolutional layers have definitely had a big impact for accuracy in image problems and sound problems. I think #2 is very important; they speed up both training and evaluation by a fac…
Consciousness of Things is an inevitable conclusion for humanity. The singularity is upon us with the advent of man merging into machine. We are driving that growth to go to the next level. Also, containerization.
Date Approximate cost per GFLOPS inflation adjusted to 2013 US dollars --------------------------------------------------------------------------------- 1961 $8.3 trillion 1984 $42,780,000 1997 $42,000 April 2000 $1,300 May 2000 $836 August 2003 $100 August 2007 $52 March 2011 $1.80 August 2012 $0.73 June 2013 $0.22 November 2013 $0.16 December 2013 $0.12 January 2015 $0.06