I've been considering a "thing" that allows monetization of an AI-enabled machine by others who need the capacity to do larger scale testing. Anyone interested in this? My contact info is in my profile.
Build a fast deep learning machine for under $1K
51–60 of 65 posts
Re: Build a fast deep learning machine for under $1K
#52I've been considering a "thing" that allows monetization of an AI-enabled machine by others who need the capacity to do larger scale testing. Anyone interested in this? My contact info is in my profile.
You won't be able to match price/expenses (fixed with hardware or variable with upkeep) of AWS/GCP due to their economy of scale. Even startups who are doing similar things sublicense from AWS.
Re: Build a fast deep learning machine for under $1K
#53I've been considering a "thing" that allows monetization of an AI-enabled machine by others who need the capacity to do larger scale testing. Anyone interested in this? My contact info is in my profile.
How is it better than AWS?
Re: Build a fast deep learning machine for under $1K
#54Contrary to the claims there, the CPU does matter: if the network is relatively small, it's easy to get bottle-necked feeding the GPU. Same thing applies to storage, for the same reasons. There's a reason AMD is selling deep learning cards with Flash drives built in. The choice of CPU cooler is silly. The CPU chosen is a 65W model, which will be cooled quietly even by the boxed cooler (and we don't need to care about…
There's a reason AMD is selling deep learning cards with Flash drives built in. For those not familiar with them, this is the Radeon Pro SSG[1] This has a built in M2 drive, but this is used as video card memory, NOT main storage. It could possibly allow big (HUGE) models or batches, but doesn't prove fast IO is often a bottleneck. Practically no one[2] is using these for deep learning. They are marketed to the oil a…
MIOpen is AMD's cuDNN alternative.
Re: Build a fast deep learning machine for under $1K
#55Earlier quoted context omitted.
There's a reason AMD is selling deep learning cards with Flash drives built in. For those not familiar with them, this is the Radeon Pro SSG[1] This has a built in M2 drive, but this is used as video card memory, NOT main storage. It could possibly allow big (HUGE) models or batches, but doesn't prove fast IO is often a bottleneck. Practically no one[2] is using these for deep learning. They are marketed to the oil a…
MIOpen is AMD's cuDNN alternative.
Which does not actually exist. It's announced but unreleased.
Re: Build a fast deep learning machine for under $1K
#56Earlier quoted context omitted.
I began building one a year and a half ago, starting with a 5930k, 1x980ti, 32GB. This put me in a position to incrementally upgrade it starting at ~$2.5k. That being said, at this point the smallest AWS p2 instances are equivalent to my current setup, and it would take 150 days worth of running my hardware to make it cost-effective vs. AWS.
When you build your first DL box you also get a moral boost. If you think every second is counted and penalized against you, you might use it less (such as when you're using cloud servers). But if it is already yours bought and paid for, then you can afford to run any crazy idea. A good compromise would be a local DL box and extra virtual machines on demand, for when you need to run extensive hyperparameter searches.…
On the flip side, dropping $2.5k for a hobby you haven't investigated yet and then looking back 6 months later on the computer collecting dust will likely dissuade you from investing any time into potential future hobbies. I play piano, and I'd never encourage anyone to go drop $2.5k on an electric keyboard just to provide a motivation. A decision to pick up a new hobby/skill should be based on desire, not a handcuff.
Re: Build a fast deep learning machine for under $1K
#57Re: Build a fast deep learning machine for under $1K
#58My home server has an i7 4790K, 32GB DDR3 and... a GTX 1080 Gamer Edition that's doing... well, bugger all. Why is the graphics card in there you might ask? Well, it was sitting on my desk collecting dust as I wait patiently for a Pascal driver for eGPUs on macOS but Nvidia had delayed these for long enough that I thought I'd chuck it in my home server, it is being used by ffmpeg for x265/HVEC transcoding with Plex m…
Can you ballpark today's price tag for such a setup? There seem to be several pricing tiers floating around in this discussion and I'd appreciate the chance to see how your setup fits in without having to shop for it.
Well it's all cheap kit with the exception of the disks, I guess you could just go online and have a look at what those parts cost you in your country etc...
Re: Build a fast deep learning machine for under $1K
#59I think there should be a disclaimer here that while, yes, this will work , it will quickly become suboptimal (perhaps even dysfunctional) for a lot of work as you scale your hobby into something resembling more professional work. I personally would not start with a thousand dollar machine if you have any intention of doing serious computation in the future. While you can trade out parts pretty easy on a custom built…
Can you share your PCPartPicker list? I'm curious how the costs breakdown.
Re: Build a fast deep learning machine for under $1K
#60Earlier quoted context omitted.
Was years ago when I build my last PC and I'm out of the game. I'm tempted in build a hackintosh: https://www.tonymacx86.com/threads/hackintosh-cutting-edge-k... - Intel i7 Kaby Lake - No decided on motherboard. The one that cause me less trouble (for hackintosh) is fine. - GTI 750ti (have) or buy a pascal nvidia. - NVMe drive if possible - 32 GB RAM. - Probably a Thermaltake CORE P3 case. Not decided. I was thinking…
> I was thinking in use a Liquid Cooler but wonder if the Noctua could be better/less noise? Depends, is your option of water cooling an All-In-One-solution that have become popular in recent years? Their performance is on par or slightly better than a large heat sink + large low speed fan(s), but they're not generally quieter, as you still have fans for them, as well as a pump. I considered those options when buildi…
I was planning in use Corsair Hydro H60 (http://amzn.to/2k9a9O1).
However, I wish to have a quiet system, and my brother have it and it sound louder than I wish. I don't plan on overcloking.