How does this compare to https://lambdalabs.com/ ?
My question too. At $2/hr for H100 that seems more flexible? But I haven’t tried to get 10k GPU-hours on any of these services, maybe that is where the bottleneck is.
Show HN: San Francisco Compute – 512 H100s at <$2/hr for research and startups
21–30 of 189 posts
Re: Show HN: San Francisco Compute – 512 H100s at <$2/hr for research and startups
#22Re: Show HN: San Francisco Compute – 512 H100s at <$2/hr for research and startups
#23I hope you succeed. TPU research cloud (TRC) tried this in 2019. It was how I got my start. In 2023 you can barely get a single TPU for more than an hour. Back then you could get literally hundreds, with an s. I believed in TRC. I thought they’d solve it by scaling, and building a whole continent of TPUs. But in the end, TPU time was cut short in favor of internal researchers — some researchers being more equal than…
> Your project has a youthful optimism that I hope you won’t lose as you go. And in fact it might be the way to win in the long run.
This is the nicest thing anyone has said to us about this. We're gonna frame this and hang it out on our wall.
> So whenever someone comes knocking, begging for a tiny slice of your H100s for their harebrained idea, I hope you’ll humor them.
Absolutely! :D
Re: Show HN: San Francisco Compute – 512 H100s at <$2/hr for research and startups
#24How does this compare to https://lambdalabs.com/ ?
Very similar price, but from what I gather very different model. One important difference might be if you regularly run short-ish training runs over many GPUs. Lambdalabs might not have 256 instances to give you right now. With OP you are basically buying the right to put jobs in the job queue for their 512 GPU cluster, so running a job that needs 256 GPUs isn't an issue (though you might wait behind someone running…
Yeah it’s pretty hard to find a big block of GPUs that you can use for a short time, esp if you need infiniband for multinode training. Lambda I think needs a min reservation of 6-12 months if you want IB.
Re: Show HN: San Francisco Compute – 512 H100s at <$2/hr for research and startups
#25Earlier quoted context omitted.
!!!!!! fixing this. For the moment, evan at roomservice dot dev
fwiw, https://roomservice.dev/ is currently a 404
http != smtp
roomservice.dev. 60 IN MX 5 alt1.aspmx.l.google.com.
roomservice.dev. 60 IN MX 5 alt2.aspmx.l.google.com.
roomservice.dev. 60 IN MX 1 aspmx.l.google.com.
roomservice.dev. 60 IN MX 10 alt3.aspmx.l.google.com.
roomservice.dev. 60 IN MX 10 alt4.aspmx.l.google.com.
roomservice.dev. 60 IN MX 15 4ig53n4pw7p3cuxm7n7xi7dpuyq6722aipexvhkngzbd2e4mudmq.mx-verification.google.com.Re: Show HN: San Francisco Compute – 512 H100s at <$2/hr for research and startups
#26How did you get the money to buy 512 H100s?
Re: Show HN: San Francisco Compute – 512 H100s at <$2/hr for research and startups
#27Re: Show HN: San Francisco Compute – 512 H100s at <$2/hr for research and startups
#28Earlier quoted context omitted.
fwiw, https://roomservice.dev/ is currently a 404
http != smtp roomservice.dev. 60 IN MX 5 alt1.aspmx.l.google.com. roomservice.dev. 60 IN MX 5 alt2.aspmx.l.google.com. roomservice.dev. 60 IN MX 1 aspmx.l.google.com. roomservice.dev. 60 IN MX 10 alt3.aspmx.l.google.com. roomservice.dev. 60 IN MX 10 alt4.aspmx.l.google.com. roomservice.dev. 60 IN MX 15 4ig53n4pw7p3cuxm7n7xi7dpuyq6722aipexvhkngzbd2e4mudmq.mx-verification.google.com.
[deleted]
Re: Show HN: San Francisco Compute – 512 H100s at <$2/hr for research and startups
#29Re: Show HN: San Francisco Compute – 512 H100s at <$2/hr for research and startups
#30I hope you succeed. TPU research cloud (TRC) tried this in 2019. It was how I got my start. In 2023 you can barely get a single TPU for more than an hour. Back then you could get literally hundreds, with an s. I believed in TRC. I thought they’d solve it by scaling, and building a whole continent of TPUs. But in the end, TPU time was cut short in favor of internal researchers — some researchers being more equal than…
> Your project has a youthful optimism that I hope you won’t lose as you go. And in fact it might be the way to win in the long run. This is the nicest thing anyone has said to us about this. We're gonna frame this and hang it out on our wall. > So whenever someone comes knocking, begging for a tiny slice of your H100s for their harebrained idea, I hope you’ll humor them. Absolutely! :D
Optimism is (almost) always required in order to accomplish anything of significance. Those who lose it, aren't living up to their potential.
I'm not encouraging the false belief that everything you do will work out. Instead I'm encouraging the realization that the greatest accomplishments almost always feel like long shots, and require significant amounts of optimism. Fear and pessimism, while helpful in appropriate doses, will limit you greatly in life if you let them rule you too significantly.
When I look back on my life, the greatest accomplishments I've achieved are ones where I was naive yet optimistic going into it. This was a good thing, because I would have been too scared to try had I really known the challenges that lay ahead.