How do I know if I will make a profit given electricity costs?
This website has a pretty good calculator:
Just replace your miner earnings with the earnings listed on http://vectordash.com/hosting
Rent out GPUs to AI researchers and make ~2x more than mining cryptocurrencies
41–50 of 129 posts
Re: Rent out GPUs to AI researchers and make ~2x more than mining cryptocurrencies
#42There's a lot of comments on that reddit thread about how awesome this would be as a service. But there's a big problem of trust with this for ML. How do I know you actually ran what I paid you for and not just generated random data that looks right in the shape I wanted it? You could farm it out to two people and if the results disagree, then payment is decided by a third. But then you've just doubled the (paid) wor…
It's pretty much letting people with GPUs become a sort of 'mini-cloud provider'. There's no job queue or fancy distributing computing setup. We just let you SSH into a container on someone's computer, and pay for the time used. I was doing a lot of fun deep learning projects on the side & would often Venmo my friend who was mining Ethereum to use his GPU to train my models. He made more and I paid less than AWS spot…
> It's pretty much letting people with GPUs become a sort of 'mini-cloud provider'. There's no job queue or fancy distributing computing setup. We just let you SSH into a container on someone's computer, and pay for the time used.
I had the same idea a few days ago - but in my head, the process would be wrapped up as a "cryptocurrency" where the AI researchers pay real money and the "proof of work" is useful/"real" work. I ran into 2 issues regarding trust: the first is that how do you verify that the hardware owner is running the real job an not NOOP'ing and sending false results? The second issue is how do you protect the hardware from malicious jobs? GPUs have DMA access - how do you stop task submitters from rooting your box and recruiting it into an AI botnet (for free)?I ended up dismissing the idea, but if you could work out these 2 issues, there's money to be made...
Re: Rent out GPUs to AI researchers and make ~2x more than mining cryptocurrencies
#43Creator of Vectordash here! If you have any questions about the platform, feel free to ask away! P.S. I'm @samin100 on Twitter if you enjoy tweets about GPUs!
You mention "free unlimited bandwidth" on the homepage in a column named "1 TB transfer". A lot of people have upstreams in the order of 1MBit/s – with such speeds, uploading a TB would take 92 days.
That seems misleading ^^.
Re: Rent out GPUs to AI researchers and make ~2x more than mining cryptocurrencies
#44Earlier quoted context omitted.
This is a very, very valid point. I'm going to mention this on the website & even advise people to run the client on an isolated machine (instead of their daily driver gaming rig). Thank you for pointing this out. Also, one of my friends working on this project is a sophomore in the CS dept at CMU, and given your interest in distributed systems & DL, would it be possible to meet up for a couple of minutes and discuss…
Happy to. Drop me a note.
^^^ This is why HN is amazing.
Re: Rent out GPUs to AI researchers and make ~2x more than mining cryptocurrencies
#45GPUs are already too expensive for gamers and now you want to do this?!
AI research demand is a lot easier for AMD/Nvidia to project, which allows them to ramp up production and keep prices stable. Side note: AI research is more beneficial to society than running a few instances of Crysis 9 at 4K 120HZ.
Also much better than calculating the inverse of hash functions!
Re: Rent out GPUs to AI researchers and make ~2x more than mining cryptocurrencies
#46Creator of Vectordash here! If you have any questions about the platform, feel free to ask away! P.S. I'm @samin100 on Twitter if you enjoy tweets about GPUs!
You mention "free unlimited bandwidth" on the homepage in a column named "1 TB transfer". A lot of people have upstreams in the order of 1MBit/s – with such speeds, uploading a TB would take 92 days. That seems misleading ^^.
Agreed! A lot of hosts have requested for the ability to set a bandwidth cap. I'll change that part of the site & be a bit more clear!
Re: Rent out GPUs to AI researchers and make ~2x more than mining cryptocurrencies
#47There's a lot of comments on that reddit thread about how awesome this would be as a service. But there's a big problem of trust with this for ML. How do I know you actually ran what I paid you for and not just generated random data that looks right in the shape I wanted it? You could farm it out to two people and if the results disagree, then payment is decided by a third. But then you've just doubled the (paid) wor…
pepper data with known results, obviously
Re: Rent out GPUs to AI researchers and make ~2x more than mining cryptocurrencies
#48Creator of Vectordash here! If you have any questions about the platform, feel free to ask away! P.S. I'm @samin100 on Twitter if you enjoy tweets about GPUs!
I saw people on the Reddit thread saying the Ubuntu requirement was a showstopper for a lot of them. You might look into the Win 10 linux support, Ubuntu is one o the supported distros. Not sure if it would have full access to resources, have just used it a bit at work and setup was super simple.
I remember a few weeks ago a when some Microsoft software engineers came to the career fair at Univ. of Maryland. One of them was working on Bash on Ubuntu on Windows, so I ended up bugging him for about an hour on when they'd support GPU passthrough for Ubuntu on Windows.
He said it was on their list of most requested features, but refused give me a data on when it would be ready :/
Re: Rent out GPUs to AI researchers and make ~2x more than mining cryptocurrencies
#49Earlier quoted context omitted.
It's pretty much letting people with GPUs become a sort of 'mini-cloud provider'. There's no job queue or fancy distributing computing setup. We just let you SSH into a container on someone's computer, and pay for the time used. I was doing a lot of fun deep learning projects on the side & would often Venmo my friend who was mining Ethereum to use his GPU to train my models. He made more and I paid less than AWS spot…
> It's pretty much letting people with GPUs become a sort of 'mini-cloud provider'. There's no job queue or fancy distributing computing setup. We just let you SSH into a container on someone's computer, and pay for the time used. I had the same idea a few days ago - but in my head, the process would be wrapped up as a "cryptocurrency" where the AI researchers pay real money and the "proof of work" is useful/"real" w…
> how do you stop task submitters from rooting your box and recruiting it into an AI botnet (for free)?
Only real way to do this is run the job in a VM with a GPU and CPU+motherboard that support passthrough (read: not consumer NVidia GPU's, your CPU+board must support an IOMMU and your card cannot freak out when being reset after initialization).
Re: Rent out GPUs to AI researchers and make ~2x more than mining cryptocurrencies
#50There's a lot of comments on that reddit thread about how awesome this would be as a service. But there's a big problem of trust with this for ML. How do I know you actually ran what I paid you for and not just generated random data that looks right in the shape I wanted it? You could farm it out to two people and if the results disagree, then payment is decided by a third. But then you've just doubled the (paid) wor…
It's pretty much letting people with GPUs become a sort of 'mini-cloud provider'. There's no job queue or fancy distributing computing setup. We just let you SSH into a container on someone's computer, and pay for the time used. I was doing a lot of fun deep learning projects on the side & would often Venmo my friend who was mining Ethereum to use his GPU to train my models. He made more and I paid less than AWS spot…
Instead of having the party ssh into a VM installed on the user's machine, potentially exposing a high majority of the user's codebase, have you considered spinning up temporary containers on your back-end and having contributors install something like remote CUDA or remote OpenCL so that only the GPU kernels are transferred to the contributor, who's client software polls a network queue checking to see what kernel should be run and where the results should be sent?