Viewing profile — jonathanlei

It's as difficult as a serverless provider to grow as it was for CPUs before GPUs came along. Many companies overinvest in fully-owned hardware, rather than renting from clouds. Ow…

Absolutely - GPUs are definitely not a very liquid asset. As someone who works at a GPU neocloud provider (Voltage Park), server assets at scale definitely face a huge slippage, yo…

Hello! If you're interested in monetizing those GPUs, I'd be happy to rent them (all 400!) and offer those to customers of the cloud I work at :) jonathan [at] tensordock.com

Congrats on the launch! This is huge, and it's really cool to see a cloud provider moving this direction - auction pricing for customers so that you always know you're getting the …

Hmm I did include a training workload as the second chart. My test workload was relatively small so I guess if the workload I ran spends a bit less GPU time comparatively to the CP…

Oops, just noticed the link isn’t clickable, here you go! https://tensordock.com/benchmarks

I was playing around with some different GPUs yesterday and put all of the results here: https://www.tensordock.com/benchmarks I tried a vLLM and Resnet training workload. The H100…

Utilization is not going to be 100% --- ever. Discounts are often given, and servers break down, etc.

Thanks! :) We do have a managed container hosting service, but it's built on our own backend that auto-scales nodes for you when average GPU utilization surpasses a certain point, …

Hey folks! I’m Jonathan from TensorDock, and we’re building a cloud GPU marketplace. We want to make GPUs truly affordable and accessible. I once started a web hosting service on s…

Hi! Jonathan from TensorDock here :) We have our own supply base (sourced through https://tensordock.com/host ), operate some of our own servers, and are not related to any other m…

Jonathan from TensorDock ( https://tensordock.com/ ) here - we listed two of our A100 and H100 clusters on the site. The IB equipped on our clusters (can't speak to others) is 8x 4…

Non-paywalled snapshot: https://archive.ph/r6mkJ

Why?

A less anti-bill view: https://www.cnbc.com/2022/08/30/california-passes-bill-aimed...

I think if you offer to sell to them, they will probably give you a lowball offer. Instead, maybe consider trying to grow it on your own, see where you can take it, and if it shows…

Disco Diffusion (and generated art in general) is really cool: https://replicate.com/nightmareai/disco-diffusion/examples Happy to give you whatever credits you need (would $25 be …

Yeah, feel free to shoot me an email for like $25 of credit. For startups, we usually do $100 (just send a request from your startup email address). Even with $5 credits, we had pe…

Whoops, apologies for missing this! For our core cloud product, we only partner with established providers. Large-scale compute wholesalers with $5m+ of compute each in secure data…

We will consider! We are working with two potential suppliers in the area... expect more news by the end of the year if those deals go through! :)