Viewing profile — ioedward

AMD didn't submit results, despite geohot/Lisa Su's plan to get AMD on MLPerf: https://twitter.com/realGeorgeHotz/status/166980346408248934...

8 H100s would have enough VRAM to finetune a 70B model.

Not at all, PyTorch uses sub-classing (nn.Module) and other Pythonic features heavily that are not supported with Mojo.

Trying the fuse feature, seemed the most interesting: > spaghetti ≈ trumpet > Both spaghetti and a trumpet can be difficult to eat without making a mess—spaghetti with its long, sl…

Related: 1 year represented in a photo. https://eirikso.com/2011/01/04/one-year-in-one-image/

The technical term is GPGPU, general-purpose computing on GPUs, but I like to call them GPUs for short.

Nvidia's enterprise GPUs are surprisingly unreliable. Working on a 128 GPU A100 cluster on AWS, 1 would fail every few days. I didn't have any insight on whether it was a hardware …

You also need the optimizer (e.g. Adam)'s state, which is usually double the parameter's size. So if using fp16, one parameter takes up 6 bytes in memory.

TPUs are mostly hoarded by Google Research (including Deepmind) and Ads. Very few are being used by external people.

The twitter thread is worth reading, Yann responds to some of the questions raised here.

No it won't. Large language models are trained on 1,000 - 50,000 GPUs. No one's going to buy hundreds of Mac pros to mount them in a datacenter for training ML models.

Normally people split up the model across multiple GPUs, i.e. model/tensor parallelism.

Doesn't seem to be affiliated with OpenAI. Domain was registered in 2017, 2 years after OpenAI was created. Trolling/domain squatting?

> I understand that PyTorch is an awesome tool for researchers, but it doesn't necessarily fit into a prod environment. Some of the largest deployments of ML are using PyTorch mode…

Where did you buy the Instinct hardware and what's a good price?

Archive.org: https://web.archive.org/web/20150120162544/http://www.sbb.co...

So are you still shipping Python/Django as an executable with atom-shell? Or is this purely client-side javascript?

I'm getting stuck on the sign in page. After authorizing the app with Github, there's a black box that appears and the Sign In button shows up again. Edit: Looks like the server is…

dang killed it because he didn't like it. (I'll go look for the source) edit: source - https://news.ycombinator.com/item?id=7693262 > Ok, when people start racing to post these at …

Would love to hear more about the terminal as well - how did you input commands to it, and how does it compare to using a phone or computer?

I emailed you, but also wanted to express in the comments that I would be definitely interested in idempotent json patches.

Sure! I would _not_ advise getting the Nexus 5. As noted below in other comments, the image quality and autofocusing speed has much to be desired. The Camera2 API that supports DNG…