Vectordash: GPU instances for deep learning
vectordash.com
Vectordash: GPU instances for deep learning
1–10 of 12 posts
Re: Vectordash: GPU instances for deep learning
#2What's your licensing situation with Nvidia regards their prohibition [1] on datacenter deployment for 'consumer' cards?
Re: Vectordash: GPU instances for deep learning
#3What's your licensing situation with Nvidia regards their prohibition [1] on datacenter deployment for 'consumer' cards? [1] https://news.ycombinator.com/item?id=16002068
I have no real idea but sometimes its better to ask forgiveness rather than permission (i'm not in any way associated with this service).
Re: Vectordash: GPU instances for deep learning
#4What's your licensing situation with Nvidia regards their prohibition [1] on datacenter deployment for 'consumer' cards? [1] https://news.ycombinator.com/item?id=16002068
It does not sound like they are deploying in datacenters: https://vectordash.com/hosting/
That said, the license also has this:
No Sublicensing or Distribution. Customer may not sell, rent, sublicense, distribute or transfer the SOFTWARE; or use the SOFTWARE for public performance or broadcast; or provide commercial hosting services with the SOFTWARE.
which seems to prohibit Vectordash's individual hosts from participating.
Re: Vectordash: GPU instances for deep learning
#5If I understand correctly, the instances available are containerized instances that users run (i.e, the system matches hosts to guests and takes a cut).
Beyond being dangerous on multiple levels, there doesn't seem to be any guarantee of storage or network bandwidth/traffic. Having a multi-TFLOP GPU to train with is hardly useful if you can't get the training data on the device in a reasonable amount of time, or hold that data in local storage.
Re: Vectordash: GPU instances for deep learning
#6What's your licensing situation with Nvidia regards their prohibition [1] on datacenter deployment for 'consumer' cards? [1] https://news.ycombinator.com/item?id=16002068
It does not sound like they are deploying in datacenters: https://vectordash.com/hosting/ That said, the license also has this: No Sublicensing or Distribution. Customer may not sell, rent, sublicense, distribute or transfer the SOFTWARE; or use the SOFTWARE for public performance or broadcast; or provide commercial hosting services with the SOFTWARE. which seems to prohibit Vectordash's individual hosts from partici…
Ah right, hadn't seen that. Thanks!
If the vectordash team are reading, I'd make the nature of the service a bit clearer to potential users. There's no mention I can find outside the 'hosting' page that these aren't your machines.
Re: Vectordash: GPU instances for deep learning
#7With more GPU-in-the-cloud offerings coming on line, is there a utility to dump GPU memory to see if your cloud provider has wiped it between customers?
Re: Vectordash: GPU instances for deep learning
#8Earlier quoted context omitted.
It does not sound like they are deploying in datacenters: https://vectordash.com/hosting/ That said, the license also has this: No Sublicensing or Distribution. Customer may not sell, rent, sublicense, distribute or transfer the SOFTWARE; or use the SOFTWARE for public performance or broadcast; or provide commercial hosting services with the SOFTWARE. which seems to prohibit Vectordash's individual hosts from partici…
Ah right, hadn't seen that. Thanks! If the vectordash team are reading, I'd make the nature of the service a bit clearer to potential users. There's no mention I can find outside the 'hosting' page that these aren't your machines.
Gotcha! I’ll update the copy to make that a bit clearer.
Re: Vectordash: GPU instances for deep learning
#9If I understand correctly, the instances available are containerized instances that users run (i.e, the system matches hosts to guests and takes a cut). Beyond being dangerous on multiple levels, there doesn't seem to be any guarantee of storage or network bandwidth/traffic. Having a multi-TFLOP GPU to train with is hardly useful if you can't get the training data on the device in a reasonable amount of time, or hold…
We ensure each instance has ample storage (min 50GB), internet speeds, and hardware specs such that the GPU is the bottleneck! If a user isn’t satisfied with an instance, then there’s no charge whatsoever :)
Re: Vectordash: GPU instances for deep learning
#10With more GPU-in-the-cloud offerings coming on line, is there a utility to dump GPU memory to see if your cloud provider has wiped it between customers?
Just read a pretty interesting paper on just this recently - we actually load/unload the drivers for every instance, which in turn also wipes the GPU’s memory. There’s a tool I wrote to test just this, albeit I haven’t uploaded it to GitHub yet. Might do that sometime this weekend.