In Europe it's also very common to just choose the components in a web shop and have them assembled, also for about $1000. (Not looking at Dell) Anyone interested in deep learning should go that path instead of burning their money on Amazon.
Build a fast deep learning machine for under $1K
11–20 of 65 posts
Re: Build a fast deep learning machine for under $1K
#12In Europe it's also very common to just choose the components in a web shop and have them assembled, also for about $1000. (Not looking at Dell) Anyone interested in deep learning should go that path instead of burning their money on Amazon.
+1 on that. There are a number of online build-to-order shops here in the UK which offer a truly vast range of component combinations. Better still, the order process automatically checks for compatibility with, for example, your choice of motherboard. Once you have the configuration you want, you just pay up and it arrives professionally assembled ready to rock. I don't think I'll ever by an off-the-shelf machine ag…
Compatibility, price checking and searching are all available with PcPartPicker (UK site: https://uk.pcpartpicker.com/) which saved me an astonishing amount of time.
The hour or two building the machine were worth the few hundred it saved me, but everyone has different priorities.
Re: Build a fast deep learning machine for under $1K
#13Earlier quoted context omitted.
Try to bring good in the conversation. What piece you would have use? Why? What tradeoffs you have considered? You sound expert in the field, try to share your knowledge with the community in a constructive way so that we can all benefit from it. I develop software for living and still I haven't any clue of what you said, while I followed quite well the article and I thought he was making reasonable choice. Please sh…
Not parent, but I've built my own computers for almost 20 years. As the articles author himself questions, he should have gotten the marginally more expensive CPU, and definitely the GPU with more RAM. * The overclockable CPU doesn't just mean that you very easily could get a 10%+ performance boost without much work, but also that you often (depending on your specific chip) can lower the voltage and make it run much…
It's been great sshing in from my laptop, submitting a job that completes far more quickly and keeping my laptop cool.
Re: Build a fast deep learning machine for under $1K
#14Earlier quoted context omitted.
Try to bring good in the conversation. What piece you would have use? Why? What tradeoffs you have considered? You sound expert in the field, try to share your knowledge with the community in a constructive way so that we can all benefit from it. I develop software for living and still I haven't any clue of what you said, while I followed quite well the article and I thought he was making reasonable choice. Please sh…
Not parent, but I've built my own computers for almost 20 years. As the articles author himself questions, he should have gotten the marginally more expensive CPU, and definitely the GPU with more RAM. * The overclockable CPU doesn't just mean that you very easily could get a 10%+ performance boost without much work, but also that you often (depending on your specific chip) can lower the voltage and make it run much…
Re: Build a fast deep learning machine for under $1K
#15Contrary to the claims there, the CPU does matter: if the network is relatively small, it's easy to get bottle-necked feeding the GPU. Same thing applies to storage, for the same reasons. There's a reason AMD is selling deep learning cards with Flash drives built in. The choice of CPU cooler is silly. The CPU chosen is a 65W model, which will be cooled quietly even by the boxed cooler (and we don't need to care about…
For those not familiar with them, this is the Radeon Pro SSG[1]
This has a built in M2 drive, but this is used as video card memory, NOT main storage. It could possibly allow big (HUGE) models or batches, but doesn't prove fast IO is often a bottleneck.
Practically no one[2] is using these for deep learning. They are marketed to the oil and gas modelling and visualization market and notably the product page (linked above) makes no mention of neural networks or deep learning, and it has never been mentioned in AMD's publicity.
Yes, it might be good for deep learning. And yet, modern deep models do want more memory. But there is a lot that needs to happen for this to be useful: AMD needs to release something like CuDNN and they need to make sure OpenCL is supported as well as CUDA is.
[1] https://arstechnica.com/gadgets/2016/07/amd-radeon-pro-ssg-g..., http://www.amd.com/en-us/press-releases/Pages/amd-radeon-pro...
[2] I'm sure you'll find someone. But show me a published paper or any kind, or even benchmarks showing the use of the extra memory somewhere.
Re: Build a fast deep learning machine for under $1K
#16Earlier quoted context omitted.
Not parent, but I've built my own computers for almost 20 years. As the articles author himself questions, he should have gotten the marginally more expensive CPU, and definitely the GPU with more RAM. * The overclockable CPU doesn't just mean that you very easily could get a 10%+ performance boost without much work, but also that you often (depending on your specific chip) can lower the voltage and make it run much…
I've got a near identical build, and my process was the same as you. I added a decent pcie nvme drive, and spent more than I guess I could have done on a motherboard that supports up to 128G ram so I can extend it later. I'm waiting for ram to drop in price a bit, or to hit a problem where I need more than 32 sooner, before bumping that up and probably adding more storage. It's been great sshing in from my laptop, su…
Yeah, it's supremely fast, my only regret is not having enough time to do something fun with it. For work I'm stuck with the clients platform approved machine, which is not what I would've picked. Tough to complain, but if I'm ever between contracts, I'll likely get into some fun project.
Re: Build a fast deep learning machine for under $1K
#17Contrary to the claims there, the CPU does matter: if the network is relatively small, it's easy to get bottle-necked feeding the GPU. Same thing applies to storage, for the same reasons. There's a reason AMD is selling deep learning cards with Flash drives built in. The choice of CPU cooler is silly. The CPU chosen is a 65W model, which will be cooled quietly even by the boxed cooler (and we don't need to care about…
There's a reason AMD is selling deep learning cards with Flash drives built in. For those not familiar with them, this is the Radeon Pro SSG[1] This has a built in M2 drive, but this is used as video card memory, NOT main storage. It could possibly allow big (HUGE) models or batches, but doesn't prove fast IO is often a bottleneck. Practically no one[2] is using these for deep learning. They are marketed to the oil a…
It's not often a bottleneck. In fact it usually isn't. But when it is, you're left wondering why you didn't get an SSD. They're cheap enough now.
Re: Build a fast deep learning machine for under $1K
#18Re: Build a fast deep learning machine for under $1K
#19Also, paying $125 for 16GB of ram but not spending the extra $20 to have your CPU be able to overclock? I'm not sure where OP is building but I can find that much RAM for $20 less than they paid, and overclocking isn't really that difficult or unreliable these days.
Re: Build a fast deep learning machine for under $1K
#20In Europe it's also very common to just choose the components in a web shop and have them assembled, also for about $1000. (Not looking at Dell) Anyone interested in deep learning should go that path instead of burning their money on Amazon.