61–70 of 114 posts
SkyPilot devs here, happy to answer any questions. GitHub repo (Apache 2 license): https://github.com/skypilot-org/skypilot Getting started is easy: $ pip install "skypilot[aws,gcp,azure]" # Pick your clouds $ sky check $ sky launch
Earlier quoted context omitted.
It really depends on the workload. GPU clusters are usually cheaper to run in house since Nvidia let you use regular GPUs for research which end up cheaper than cloud GPUs. And often Universities will charge less overhead for capital expenses on a grant which can artificially reduce the cost of running it yourself. The big downside of institutional HPC is it can be difficult to get stuff running on the ancient distri…
>since Nvidia let you use regular GPUs for research which end up cheaper than cloud GPUs. Funfact, that's illegal in Europe, producers have no right to tell you what to do with their products and your property.
Earlier quoted context omitted.
>since Nvidia let you use regular GPUs for research which end up cheaper than cloud GPUs. Funfact, that's illegal in Europe, producers have no right to tell you what to do with their products and your property.
Is it really though? The biggest country in Europe is Russia, also the biggest population is Russians living inside Russia. Maybe you meant the EU which is far from being all of Europe. It is not even half of Europe. There are 23 countries out of 44 in Europe that aren't in the EU. If you talk law then a small detail like that matters a lot.
Just a part of russia is europe...being as pedantic as you:
Earlier quoted context omitted.
>since Nvidia let you use regular GPUs for research which end up cheaper than cloud GPUs. Funfact, that's illegal in Europe, producers have no right to tell you what to do with their products and your property.
While you own the hardware you don't own the software necessary to make use of it, just a license.
It's fascinating to see the descendants of the original AMP Lab ( https://amplab.cs.berkeley.edu/ ) are still generating value long after it ended. For reference, Spark and Mesos are two other projects that came out of the same effort. This blog post from the authors https://medium.com/@zongheng_yang/skypilot-ml-and-data-scien... I believe autostop (simply stopping idle clusters) alone can masively (X times) costs fo…
Earlier quoted context omitted.
>since Nvidia let you use regular GPUs for research which end up cheaper than cloud GPUs. Funfact, that's illegal in Europe, producers have no right to tell you what to do with their products and your property.
Is it really though? The biggest country in Europe is Russia, also the biggest population is Russians living inside Russia. Maybe you meant the EU which is far from being all of Europe. It is not even half of Europe. There are 23 countries out of 44 in Europe that aren't in the EU. If you talk law then a small detail like that matters a lot.
Earlier quoted context omitted.
>since Nvidia let you use regular GPUs for research which end up cheaper than cloud GPUs. Funfact, that's illegal in Europe, producers have no right to tell you what to do with their products and your property.
I swear, every thread has at least one European bragging about something ridiculous like "fun fact, murder is illegal in Europe" without spending 10 seconds to check if it's also illegal in the US. Yes, we have property rights in the US. No, it's not obvious whether buying the hardware also gives you a license to use Nvidia's CUDA libraries without any limitations. Nobody has tested this in court. Personally, I've go…
Aren't AWS, Azure and GCP all comparatively expensive? They are good for certain workloads and it's good that this project exists, but if you wanted cheap cloud resources, you'd probably need to look at one of the smaller cloud vendors: Hetzner, Scaleway, DigitalOcean, Vultr, Contabo and others. Of course, if you need GPUs, things can get limiting.
I think Hetzner and other budget cloud providers are excellent choices for use cases that require always on, reasonably predictable workloads like webservers.
Earlier quoted context omitted.
As we are talking anecdotes. Universities I’ve been at that researched sensitive data like human genetics and some commercially sensitive data have been excellent at data security, and provided a centralised HPC cluster at a marginal cost than it would have been at AWS..
While hospital records are protected, traditionally genomics data is not considered PII so is not covered by HIPAA. It does seem a bit of a farce though considering it could be uploaded to GEDmatch and have a good chance of finding relations of person the sample was taken from...
Earlier quoted context omitted.
Is it really though? The biggest country in Europe is Russia, also the biggest population is Russians living inside Russia. Maybe you meant the EU which is far from being all of Europe. It is not even half of Europe. There are 23 countries out of 44 in Europe that aren't in the EU. If you talk law then a small detail like that matters a lot.
>The biggest country in Europe is Russia Just a part of russia is europe...being as pedantic as you: https://en.wikipedia.org/wiki/Ural_Mountains
European Russia covers the vast majority of Eastern Europe, and spans roughly 40% of Europe's total landmass, with over 15% of its total population, making Russia the largest and most populous country in Europe.