Live data from Hacker News

Building your own deep learning computer is 10x cheaper than AWS

medium.com

11–20 of 269 posts

Re: Building your own deep learning computer is 10x cheaper than AWS

#11

> Nvidia contractually prohibits the use of GeForce and Titan cards in datacenters. So Amazon and other providers have to use the $8,500 datacenter version of the GPUs, and they have to charge a lot for renting it.

How can Nvidia anymore enforce that than movie producers can stop rentals of physical media.

how would Amazon sell access to the GPUs without the customers being able to identify the models? Also, procuring data center amounts of GPUs is bound to leave quite the paper trail.

Re: Building your own deep learning computer is 10x cheaper than AWS

#12

> Nvidia contractually prohibits the use of GeForce and Titan cards in datacenters. So Amazon and other providers have to use the $8,500 datacenter version of the GPUs, and they have to charge a lot for renting it.

How can Nvidia anymore enforce that than movie producers can stop rentals of physical media.

I think via the driver licensing

Re: Building your own deep learning computer is 10x cheaper than AWS

#13

> Nvidia contractually prohibits the use of GeForce and Titan cards in datacenters. So Amazon and other providers have to use the $8,500 datacenter version of the GPUs, and they have to charge a lot for renting it.

Hasn't stopped Hetzner from offering 1080s in their servers.

Re: Building your own deep learning computer is 10x cheaper than AWS

#14
post #6

Of course building is cheaper than AWS... It also means you need to build the computer, maintain it, upgrade it, store it somewhere, connect it to the internet, and so on. And you can't just scale it if you need to. I mean, the cloud's here for a reason...

The cloud is there to store data that you don't mind other people seeing, that is all ;)

Re: Building your own deep learning computer is 10x cheaper than AWS

#15

> Nvidia contractually prohibits the use of GeForce and Titan cards in datacenters. So Amazon and other providers have to use the $8,500 datacenter version of the GPUs, and they have to charge a lot for renting it.

I wondered how it is possible that they can restrict the use of hardware after it is bought. After reading the article I learned that they key is the license to the drivers.

So I guess in theory it would be possible for AWS to develop their own (or enhance open source) drivers. On the other hand they would spoil the business relationship with Nvidia and have to do without any discounts.

Re: Building your own deep learning computer is 10x cheaper than AWS

#16
post #6

Of course building is cheaper than AWS... It also means you need to build the computer, maintain it, upgrade it, store it somewhere, connect it to the internet, and so on. And you can't just scale it if you need to. I mean, the cloud's here for a reason...

> Of course building is cheaper than AWS...

Why "of course"? Last time I checked baking my own cookies is more expensive than just buying a bag at Walmart.

Re: Building your own deep learning computer is 10x cheaper than AWS

#18
post #16
post #6

Of course building is cheaper than AWS... It also means you need to build the computer, maintain it, upgrade it, store it somewhere, connect it to the internet, and so on. And you can't just scale it if you need to. I mean, the cloud's here for a reason...

> Of course building is cheaper than AWS... Why "of course"? Last time I checked baking my own cookies is more expensive than just buying a bag at Walmart.

If you need 10k cookies every day for multiple years, you're better off building your own bakery. If you need multiple years of continuous DL work, you're better off building your own DL system.

If you need 5 cookies today (and maybe the next batch next week), go to Walmart. Same for an one-off DL job.

Re: Building your own deep learning computer is 10x cheaper than AWS

#19
post #13

> Nvidia contractually prohibits the use of GeForce and Titan cards in datacenters. So Amazon and other providers have to use the $8,500 datacenter version of the GPUs, and they have to charge a lot for renting it.

Hasn't stopped Hetzner from offering 1080s in their servers.

The Nvidia driver licenses that prohibit US companies from using the HW are probably void in Germany/EU. Happens a lot.

Re: Building your own deep learning computer is 10x cheaper than AWS

#20
post #18
post #16

Earlier quoted context omitted.

> Of course building is cheaper than AWS... Why "of course"? Last time I checked baking my own cookies is more expensive than just buying a bag at Walmart.

If you need 10k cookies every day for multiple years, you're better off building your own bakery. If you need multiple years of continuous DL work, you're better off building your own DL system. If you need 5 cookies today (and maybe the next batch next week), go to Walmart. Same for an one-off DL job.

According to the article you can break even after only two weeks which is far from "10k cookies every day for multiple years".
Post reply on HN