Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Build a fast deep learning machine for under $1K

oreilly.com

Post reply on HN
Print view View original

21–30 of 65 posts

Re: Build a fast deep learning machine for under $1K

#21

Post by kharms »

mrmondo wrote: post #6

My home server has an i7 4790K, 32GB DDR3 and... a GTX 1080 Gamer Edition that's doing... well, bugger all. Why is the graphics card in there you might ask? Well, it was sitting on my desk collecting dust as I wait patiently for a Pascal driver for eGPUs on macOS but Nvidia had delayed these for long enough that I thought I'd chuck it in my home server, it is being used by ffmpeg for x265/HVEC transcoding with Plex m…

Not something for you to work on, but something you can do in the mean time:

https://en.m.wikipedia.org/wiki/List_of_distributed_computin...

Re: Build a fast deep learning machine for under $1K

#22

Post by hermiti »

croon wrote: post #10
siscia wrote: post #4

Earlier quoted context omitted.

Try to bring good in the conversation. What piece you would have use? Why? What tradeoffs you have considered? You sound expert in the field, try to share your knowledge with the community in a constructive way so that we can all benefit from it. I develop software for living and still I haven't any clue of what you said, while I followed quite well the article and I thought he was making reasonable choice. Please sh…

Not parent, but I've built my own computers for almost 20 years. As the articles author himself questions, he should have gotten the marginally more expensive CPU, and definitely the GPU with more RAM. * The overclockable CPU doesn't just mean that you very easily could get a 10%+ performance boost without much work, but also that you often (depending on your specific chip) can lower the voltage and make it run much…

I have a machine that I am using for deep learning and it has 32GB of ECC RAM paired with a Xeon CPU w/ Quadro, and that 32GB of RAM is gone almost instantly. Now I'm looking at building another machine as it has gotten to the point where I am spending a great deal of time waiting.

I would be interested to see what other people are using for their setups, and how that can differ for things like high-resolution style transfer or generic neural networks, etc...and at what point they have to switch from geforce/quadro cards to tesla.

Re: Build a fast deep learning machine for under $1K

#23

Post by coroxout »

PascLeRasc wrote: post #19

I'm not sure why mITX was chosen - in my experience it's almost always more expensive and leaves no room for additional GPU expansion (Or network adapters/whatever card you might need) in the future. You can get 1151 mATX motherboards for more like $60-70 on Amazon instead of the $125 they paid. Also, paying $125 for 16GB of ram but not spending the extra $20 to have your CPU be able to overclock? I'm not sure where…

I was wondering that too. For something like this maximum room for future expansion seems good. In the past I've used mITX to build low-power, low-noise machines, rather than building a high-powered processing beast.

On the other hand, it made the article more interesting for me. I can't really justify a home machine learning rig, but I was thinking I might soon replace that old mITX machine.

(edit - just reached the pics - really not sure why you'd go with a mini form factor and then add a 6" heatsink/fan!)

Re: Build a fast deep learning machine for under $1K

#25

Post by mamcx »

croon wrote: post #10
siscia wrote: post #4

Earlier quoted context omitted.

Try to bring good in the conversation. What piece you would have use? Why? What tradeoffs you have considered? You sound expert in the field, try to share your knowledge with the community in a constructive way so that we can all benefit from it. I develop software for living and still I haven't any clue of what you said, while I followed quite well the article and I thought he was making reasonable choice. Please sh…

Not parent, but I've built my own computers for almost 20 years. As the articles author himself questions, he should have gotten the marginally more expensive CPU, and definitely the GPU with more RAM. * The overclockable CPU doesn't just mean that you very easily could get a 10%+ performance boost without much work, but also that you often (depending on your specific chip) can lower the voltage and make it run much…

Was years ago when I build my last PC and I'm out of the game.

I'm tempted in build a hackintosh:

https://www.tonymacx86.com/threads/hackintosh-cutting-edge-k...

- Intel i7 Kaby Lake - No decided on motherboard. The one that cause me less trouble (for hackintosh) is fine. - GTI 750ti (have) or buy a pascal nvidia. - NVMe drive if possible - 32 GB RAM. - Probably a Thermaltake CORE P3 case. Not decided.

I was thinking in use a Liquid Cooler but wonder if the Noctua could be better/less noise?

Re: Build a fast deep learning machine for under $1K

#26

Post by EvgeniyZh »

croon wrote: post #10
siscia wrote: post #4

Earlier quoted context omitted.

Try to bring good in the conversation. What piece you would have use? Why? What tradeoffs you have considered? You sound expert in the field, try to share your knowledge with the community in a constructive way so that we can all benefit from it. I develop software for living and still I haven't any clue of what you said, while I followed quite well the article and I thought he was making reasonable choice. Please sh…

Not parent, but I've built my own computers for almost 20 years. As the articles author himself questions, he should have gotten the marginally more expensive CPU, and definitely the GPU with more RAM. * The overclockable CPU doesn't just mean that you very easily could get a 10%+ performance boost without much work, but also that you often (depending on your specific chip) can lower the voltage and make it run much…

Agree with a system you've linked. I believe 1060 has best price-to-value for deep learning in the market.

Re: Build a fast deep learning machine for under $1K

#29

Post by pdog »

PascLeRasc wrote: post #19

I'm not sure why mITX was chosen - in my experience it's almost always more expensive and leaves no room for additional GPU expansion (Or network adapters/whatever card you might need) in the future. You can get 1151 mATX motherboards for more like $60-70 on Amazon instead of the $125 they paid. Also, paying $125 for 16GB of ram but not spending the extra $20 to have your CPU be able to overclock? I'm not sure where…

Most people don't want a giant box under their desk. If you're building a machine learning rig for under $1,000, you don't need room for expansion because additional $200, $400 or even $700 cards are a useless expense at that price range.

Re: Build a fast deep learning machine for under $1K

#30

Post by gens »

PascLeRasc wrote: post #19

I'm not sure why mITX was chosen - in my experience it's almost always more expensive and leaves no room for additional GPU expansion (Or network adapters/whatever card you might need) in the future. You can get 1151 mATX motherboards for more like $60-70 on Amazon instead of the $125 they paid. Also, paying $125 for 16GB of ram but not spending the extra $20 to have your CPU be able to overclock? I'm not sure where…

You don't need a powerful cpu for gpu loads.
Post reply on HN