Live data from Hacker News

HPE unveils The Machine, a single-memory computer with 160 terabytes of memory

venturebeat.com

21–30 of 57 posts

Re: HPE unveils The Machine, a single-memory computer with 160 terabytes of memory

#21

I am not sure if I should be impressed until they reveal more details. 160 TB over 40 nodes is 4 TB per node, which assuming 512 GB dimms requires only 8 dimms (4 per socket) or with 256 GB dimms 16 dimms (8 per socket). How fast is the interconnect? 100Gb/s? So far it sounds like an common high memory HPC cluster unit with really unknown technical parameters.

Where can you get 512 GB dimms?

Re: HPE unveils The Machine, a single-memory computer with 160 terabytes of memory

#22
post #12

Earlier quoted context omitted.

~100 billions neurons in a human brain I guess. Not sure what 1.6KB per neuron is too close to

This comment currently has a reply ( http://i.imgur.com/N7BZJfu.png ) which shows why I wanted to leave my original post as a "riddle" rather than coming out and saying it. The following "crap" is not relevant to anything, only read it if you want the answer to why 1.6 KB is insufficient for a certain science fiction fantasy which will never, not in ten, a hundred, or a thousand years, become relevant any more than m…

Can someone downvote this for me? Gosh dude were you thinking putting this crap together?

Re: HPE unveils The Machine, a single-memory computer with 160 terabytes of memory

#23

I am not sure if I should be impressed until they reveal more details. 160 TB over 40 nodes is 4 TB per node, which assuming 512 GB dimms requires only 8 dimms (4 per socket) or with 256 GB dimms 16 dimms (8 per socket). How fast is the interconnect? 100Gb/s? So far it sounds like an common high memory HPC cluster unit with really unknown technical parameters.

There was a presentation about it done last year by Keith Packard at Linux.conf.au.

Hardware and Software Architecture of The Machine

https://www.youtube.com/watch?v=S--Kgseuy0Q

Re: HPE unveils The Machine, a single-memory computer with 160 terabytes of memory

#24
post #12

Earlier quoted context omitted.

~100 billions neurons in a human brain I guess. Not sure what 1.6KB per neuron is too close to

This comment currently has a reply ( http://i.imgur.com/N7BZJfu.png ) which shows why I wanted to leave my original post as a "riddle" rather than coming out and saying it. The following "crap" is not relevant to anything, only read it if you want the answer to why 1.6 KB is insufficient for a certain science fiction fantasy which will never, not in ten, a hundred, or a thousand years, become relevant any more than m…

You don't need a single memory machine to simulate the human brain though. Because neurons have a clear spatial structure, you can break the problem up into a mesh, give each piece of the mesh to a different machine, and give them some interconnect so they can broadcast relevant portions of their state to neighboring machines. You don't need low latency direct memory access for every node to all of the memory. Look at something like the https://en.wikipedia.org/wiki/Tianhe-2 which has about a petabyte of RAM

EDIT: I think you're also not considering the ample opportunities to compress this data set. For instance, you can represent the connections between neurons with a sparse adjacency matrix, and there is a whole body of literature devoted to coming up with small representations of that kind of data, while still being able to perform operations efficiently. For the genome variance, keep in mind the variance is going to be absolutely tiny in comparison to the whole genome, so you can just store the genome of one of the neurons and then the diffs between it and all the other neurons or something.

Re: HPE unveils The Machine, a single-memory computer with 160 terabytes of memory

#25

I am not sure if I should be impressed until they reveal more details. 160 TB over 40 nodes is 4 TB per node, which assuming 512 GB dimms requires only 8 dimms (4 per socket) or with 256 GB dimms 16 dimms (8 per socket). How fast is the interconnect? 100Gb/s? So far it sounds like an common high memory HPC cluster unit with really unknown technical parameters.

"So far it sounds like an common high memory HPC cluster unit with really unknown technical parameters."

And really anemic CPUs to boot...

Re: HPE unveils The Machine, a single-memory computer with 160 terabytes of memory

#27
post #19
post #16

This falls into a scale up type (vertical) architecture, in what scenarios would you need tin like this? Versus A more scale out/distributed (horizontal) architecture

It's a 40 node mesh. Isn't that scale-out?

Let me rephrase rather. a scale out architecture with commodity machines (using Hadoop, kube, mesos etc.) versus an engineered system in hardware. A client purchased a an HP super dome (another highly engineered system) the cost per CPU core, gb ram, tb of storage was horrendous. More than 10x comparable commodity hardware solutions. 8 months later and they hit performance problems, space issues and adding capacity is a serious chunk of change.

What I am trying to understand in what use cases would this make sense?

Re: HPE unveils The Machine, a single-memory computer with 160 terabytes of memory

#28
post #26

How does the Machine recover from software errors? If it has only persistent RAM, then when some important program goes bonkers (it always goes), there is no luxury of pressing the reset button to get back to a pristine state.

I suppose they have a 80GB ssd with the operational system on it.

Re: HPE unveils The Machine, a single-memory computer with 160 terabytes of memory

#30
post #21

I am not sure if I should be impressed until they reveal more details. 160 TB over 40 nodes is 4 TB per node, which assuming 512 GB dimms requires only 8 dimms (4 per socket) or with 256 GB dimms 16 dimms (8 per socket). How fast is the interconnect? 100Gb/s? So far it sounds like an common high memory HPC cluster unit with really unknown technical parameters.

Where can you get 512 GB dimms?

That is the assuming part because article tries to make it extremely impressive. Well, according to the link provided by pjmlp they most likely use 256 GB dimms https://youtu.be/S--Kgseuy0Q?t=450
Post reply on HN