Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: San Francisco Compute – 512 H100s at <$2/hr for research and startups

sfcompute.org

Post reply on HN
Print view View original

181–189 of 189 posts

Re: Show HN: San Francisco Compute – 512 H100s at <$2/hr for research and startups

#181

Post by alex_lav »

jiggawatts wrote: post #178
mikeravkine wrote: post #102

Earlier quoted context omitted.

Sorry where are these .50c many core servers you speak of exactly?

Azure's HB120rs_v3 size is about 36c per hour right now with Spot pricing in East US. These use 3rd generation AMD EPYC "Milan" processors. The instances with the 4th generation "Genoa-X" processors (HB176rs_v4) cost about $2.88 per hour. The HX176rs_v4 model with 1.7 TB of memory is $3.46 per hour. https://learn.microsoft.com/en-us/azure/virtual-machines/hbv... https://learn.microsoft.com/en-us/azure/virtual-machine…

Are these actually attainable, as in I can log in and launch an instances with these specifications right now, or are they just listings? I ask because literally last week I was unable to launch similar instances on AWS despite those specs being listed as available and online.

Re: Show HN: San Francisco Compute – 512 H100s at <$2/hr for research and startups

#182

Post by [deleted] »

jedberg wrote: post #126
version_five wrote: post #111

Earlier quoted context omitted.

FWIW I tired to look up some numbers, i found California "industrial" electricity at $0.18/Kwh https://www.eia.gov/electricity/monthly/epm_table_grapher.ph... and H100s using 300-700w https://www.nvidia.com/en-us/data-center/h100/ which implies a worst case marginal cost of .18*.7 = $.126 / gpu / hour. Looks like Montana is cheapest at ~$.05 / kwh which would bring that down to $.035. So there may be about a $0.09 Ca…

Retail residential power in the city of Santa Clara is $0.15/KwH, I'm sure commercial could be less. Especially if you throw some solar panels on the roof. The most expensive part would be the land, but honestly there is some pretty cheap land outside the cities.

[deleted]

Re: Show HN: San Francisco Compute – 512 H100s at <$2/hr for research and startups

#183

Post by jedberg »

fragmede wrote: post #155
jedberg wrote: post #126

Earlier quoted context omitted.

Retail residential power in the city of Santa Clara is $0.15/KwH, I'm sure commercial could be less. Especially if you throw some solar panels on the roof. The most expensive part would be the land, but honestly there is some pretty cheap land outside the cities.

For reference, I'm in SF and paid PGE $0.50938/KWh during peak hours, residential, last bill.

Yes, Santa Clara has their own non-profit power company so their rates are way less than PG&E

Re: Show HN: San Francisco Compute – 512 H100s at <$2/hr for research and startups

#184

Post by orf »

mdaniel wrote: post #61
fragmede wrote: post #55

Earlier quoted context omitted.

For consumer-grade cards, that's already here. Make money off your GPU with vast.AI https://cloud.vast.ai/host/setup

> Requirements > Ubuntu 18.04 or newer (required) > Dedicated machines only - the machine shouldn't be doing other stuff while rented well that's certainly not what I expected. ctrl-f "virtual" gives nothing, so it seems they really mean "take over your machine" > Note: you may need to install python2.7 to run the install script. what kind of nonsense is this? Did they write the script in 2001 and just abandon it?

Seems like it: https://s3.amazonaws.com/vast.ai/install

Re: Show HN: San Francisco Compute – 512 H100s at <$2/hr for research and startups

#185

Post by stavros »

xeromal wrote: post #170
stavros wrote: post #161

Earlier quoted context omitted.

I must say, this is the worst I've seen "beaucoup" spelled.

Hahahaha. I can honestly say no on has told me in my entire uneducated life that "bookoo" was a real word. I appreciate the lesson.

Haha, you're bookoo welcome!

Re: Show HN: San Francisco Compute – 512 H100s at <$2/hr for research and startups

#188

Post by zak »

sillysaurusx wrote: post #176
zak wrote: post #142

Earlier quoted context omitted.

It sounds like you're primarily using preemptible TPU quota, which doesn't come with any availability or uptime expectations at all. By default, the TRC program grants both on-demand quota and preemptible quota. If you are able to create a TPU VM with your on-demand quota, it should last quite a bit longer than a few hours. (There are situations in which on-demand TRC TPU VMs can be interrupted, but these ought to be…

I was using on-demand TPUs primarily, and preemptible TPUs secondarily. Neither would last more than an hour or two. And two was something of a minor miracle by the end.

For future reference, the team looked into this, and it appears that the interruptions you experienced were specific to your project and a small number of other projects. The vast majority of TRC projects should see much longer Cloud TPU uptimes when they are able to create on-demand TPUs.

I'm sorry that you had such a frustrating time and that we weren't able to sort it out via email while it was happening. If you decide to try TRC again and run into issues like this, please be sure to engage with TRC support!

Re: Show HN: San Francisco Compute – 512 H100s at <$2/hr for research and startups

#189

Post by jiggawatts »

alex_lav wrote: post #181
jiggawatts wrote: post #178

Earlier quoted context omitted.

Azure's HB120rs_v3 size is about 36c per hour right now with Spot pricing in East US. These use 3rd generation AMD EPYC "Milan" processors. The instances with the 4th generation "Genoa-X" processors (HB176rs_v4) cost about $2.88 per hour. The HX176rs_v4 model with 1.7 TB of memory is $3.46 per hour. https://learn.microsoft.com/en-us/azure/virtual-machines/hbv... https://learn.microsoft.com/en-us/azure/virtual-machine…

Are these actually attainable, as in I can log in and launch an instances with these specifications right now, or are they just listings? I ask because literally last week I was unable to launch similar instances on AWS despite those specs being listed as available and online.

I could. Availability tends to be region-dependent with all clouds.
Post reply on HN