Earlier quoted context omitted.
One of the largest challenges in building an exascale cluster is communication. Computing power increases at a higher rate than memory throughput does, and memory throughput increases faster than communication infrastructure advances. Many argue that an exascale computer can only be cost efficient if the communication capabilities scale highly sublinearly with the computation done in the subsystems [1]. In particular…
You are incorrect saying MapReduce isn't locality aware. Hadoop supports machine, rack, row, and cluster locality scheduling. Also, most modern Internet HPC systems dedicate a ton of design and equipment to having very high cross-sectional bandwidth, which enables the locality restrictions to be relaxed.
Supercomputers: Obama orders world's fastest computer
141–150 of 179 posts
Re: Supercomputers: Obama orders world's fastest computer
#142Earlier quoted context omitted.
No, the people who run the clusters won't let you run any language just because it has an MPI binding. They invest a lot in ensuring peak performance, and right now, only C++ and FORTRAN can achieve that. Very few, if any, major supercomputer centers support Java codes.
Oh, you're talking about a policy limitation, not a technological one. (And if you're talking about the DOE or NSF/Teragrid/XSEDE clusters, then you're probably right. Haven't touched those in years -- and even when I did, I wasn't doing anything crazy.)
Re: Supercomputers: Obama orders world's fastest computer
#143Earlier quoted context omitted.
Clearly designed to run AI for cyber-warfare / cyber-defense purposes? William Gibson's Black Ice coming to life?
More likely its for modeling nuclear weapons which I believe is the primary purpose of NSCI.
Re: Supercomputers: Obama orders world's fastest computer
#144Earlier quoted context omitted.
Haha.. AWS?
Sure, I'm asking sincerely.
Re: Supercomputers: Obama orders world's fastest computer
#145Earlier quoted context omitted.
> "I'd say they're targeting around 60 megawatts, I can't imagine they'll get below that," [Mark Parsons] commented. "That's at least £60m a year just on your electricity bill."
I wouldn't trust a Brit to report the figures for the US Department of Energy. The DOE's budget is 20 Megawatts [source: http://science.energy.gov/~/media/ascr/ascac/pdf/meetings/20... ]
Re: Supercomputers: Obama orders world's fastest computer
#146Earlier quoted context omitted.
Yes: https://en.m.wikipedia.org/wiki/Utah_Data_Center
That seems to be more of a storage data centre. And if Wikipedia's figure of 60 megawatts is correct, it's well in the ballpark of a datacenter for Google or Facebook.
Edit: also should say it is amusing to hear Obama talking about exascale conputing by 2025 when the NSA's goal (read the Wired article) is to get there by 2018.
Re: Supercomputers: Obama orders world's fastest computer
#147A bit more informative is the actual fact sheet put out by the white house [1]. What they are really aiming for is exa scale computing, which they define as being capable of applying exaFlops to exabytes. From my limited knowledge, the latter will actually be the bigger deal. As pointed out elsewhere, an exaflop supercomputer will probably come around beforehand. [1] https://www.whitehouse.gov/sites/default/files/mic…
The real problem is getting 1 exaflop (or around it) within a reasonable power budget. The DOE's power budget for all of their supercomputing resources is 20 Megawatts, so at a full system level we would need to be at 50 GFLOPs per watt, while the best system right now is at 5.
Re: Supercomputers: Obama orders world's fastest computer
#148Earlier quoted context omitted.
> Rather than tell us how much you hate the military and capitalism maybe you can figure out a better way. Well, knowing a few scientists, I can say that I know well the creative and inquiring spirits that advance us. The world is structured so that the people who do the actual development and discovery have to sell their talents to the logic of property and capital, either directly, or to the government that enforce…
There may be a better solution. Just because no one has found it doesn't mean we can't do better. However, I'm not one for cursing the darkness. Light a small candle and lead the way.
Being conceptually slippery enough to get out of any problem comes naturally to skillful people in their fields. The situation at hand provides all the impetus for theory and practice there is. Conflict thrives off of superfluity: superfluous methods, superfluous justifications, and superfluous issues. Methodology and structure gets in the way of skillfulness.
I know that real human power scales on its own without armies and guns forcing it into a certain shape. People collaborate and collude very easily. People form groups very easily. People associate with people. It's probably the only culturally universal thing people do (well of course; culture only makes sense when there are associating people).
If we want association to work well, groups need to be able to disintegrate as easily as they come together. People need to be slippery, too. Without what makes groups cohere, they disintegrate on their own. When you see violence and hierarchy used to keep groups coherent, it means they've lost the essential power that makes them useful.
People like achieving status. Status is a social signal, and it communicates both ways. Status is not held like a title. Titles wax and wane in the status they confer just like every other human object and activity. When we pretend status can be held, that it can be concentrated and preserved, we get problems. If we let status come and go by its own logic, we'd have no problems with status. A society where status is maintained by a legal system will have hierarchies, and it will certainly have problems.
So ways that our current systems-- not just capitalism, fail: Labor is not free. Association is not free. Status is not free.
Even skillful people who believe in property as an organizing force wish to be locally free in these ways. Skillful people want to work unimpeded by the politics of labor, associating with likeminded people unimpeded by the politics of social groups, praised for the inherent virtue of their actions and unimpeded by the politics of status. They only believe in property because it helps them manage the world that is beyond their control, beyond the means of their skill. They use property to create a bubble in which they can live that is free from its control.
People who believe in property because they enjoy its logic, enjoy the wheeling and dealing, enjoy the frantic rush to get more of it, who feel more worthwhile the more property they have are nervous people, who can never be fulfilled, because property's logic does not lead to fullness, the only conclusion is 'not enough', the only purpose is 'more'.
I don't know how many people in the latter category actually exist. I suspect enough to cause a great deal of problems. In any case they require the assent of everyone else. I think all I have to say to everyone else is this:
The world without property is still full and whole, is still just, is still full of vitality, is still nourishing, and receptive to human power.
Re: Supercomputers: Obama orders world's fastest computer
#149Earlier quoted context omitted.
The real problem is getting 1 exaflop (or around it) within a reasonable power budget. The DOE's power budget for all of their supercomputing resources is 20 Megawatts, so at a full system level we would need to be at 50 GFLOPs per watt, while the best system right now is at 5.
Nvidia's Pascale GPU, due next year, is supposed to do 28 terraflops with 1300 watts which I make 21 GFLOPs per watt.
A huge amount of overall system power is spent in data transport. Plus, double everything for cooling. That brings the total system efficiency way down from what the actual computational components spend.
Re: Supercomputers: Obama orders world's fastest computer
#150Earlier quoted context omitted.
You might want to read up on Sibyl.
The information I've seen about Sibyl (the Google ML system, not the genomics package ( http://sybil.sourceforge.net/documentation.html) ) says it is basically doing logistic regression using a parallel algorithm (Collins, Schapire, Singer) with a transpose on each iteration. Without knowing more about the problem sizes and data sparsity/irregularity, I expect the transpose to be a significant expense. I'd be happy t…
What I meant by asynchronous is that not all terms in a gradient are required to be summed in the same step.
The transpose step in Sibyl is implemented in the Shuffle and Reduce phases. The filesystem is used to hold the temporary data. Nevertheless even for large systems, very few steps are required, and step times are reasonable, even compared to modern supercomputers. This is a tribute primarily to the design of sibyl and the implementation of MapReduce at Google.
This is all explained in online versions of the Sibyl presentation. I really wish more people from DOE who write modern solvers would pay attention to this stuff.