Live data from Hacker News

Building A16Z's Personal AI Workstation

a16z.com

51–60 of 75 posts

Re: Building A16Z's Personal AI Workstation

#51
post #45

A rough price out using new egg/microcenter pricing, substituting a few items where they didn't specify a specific item/brand. I didn't bother trying to figure out what case they used. Grand total: ~ $41,000 Motherboard https://www.newegg.com/gigabyte-mh53-g40-amd-ryzen-threadrip... $895 CPU https://www.microcenter.com/product/674313/amd-ryzen-threadr... - $3500 Cooler https://www.newegg.com/p/3C6-013W-002G6 $585 RAM…

As soon as you drive it off the lot, it is worth half the value.

Re: Building A16Z's Personal AI Workstation

#52
post #50

Earlier quoted context omitted.

In all fairness, not even Lambda Labs offers workstations with RTX6000 server variants.

There are no RTX6000 "server" variants. These GPUs are designed for workstation use. I mean it is even in the name.

https://www.nvidia.com/en-us/data-center/rtx-pro-6000-blackw...

The workstation versions are fine if you're running one or maybe two cards with an airflow gap between them, but if you pack four of them right next to each other then you're going to have a bad time when the fans get going.

Re: Building A16Z's Personal AI Workstation

#53
post #45

A rough price out using new egg/microcenter pricing, substituting a few items where they didn't specify a specific item/brand. I didn't bother trying to figure out what case they used. Grand total: ~ $41,000 Motherboard https://www.newegg.com/gigabyte-mh53-g40-amd-ryzen-threadrip... $895 CPU https://www.microcenter.com/product/674313/amd-ryzen-threadr... - $3500 Cooler https://www.newegg.com/p/3C6-013W-002G6 $585 RAM…

As soon as you drive it off the lot, it is worth half the value.

It'll lose another half if you spray paint it gold like in the OP photos.

Re: Building A16Z's Personal AI Workstation

#54
post #14
post #12

Earlier quoted context omitted.

> This article is a great way to showcase A16Z standinging head and shoulders above other VCs with REAL technical expertise in the partnership. what? a 12 year old with a titanic budget could put this PC together

I don't want to be insulting here, but have you sat down with a partner at a VC before? You may be surprised to discover their skill is rarely deeply technical...

There's almost 0 skill required to plug in components meant to be plugged in to each other...

Re: Building A16Z's Personal AI Workstation

#55

Earlier quoted context omitted.

Sequoia is also increasingly embarrassing. A shame because it wasn't but 10 years ago that these firms seemed like they were leading the charge of world-changing innovation, etc...

Increasingly? This is the Sequoia who wrote thousands of words on Sam Bankman-Fried that uncritically said little more than “he’s so quirky and smart! ^_^” https://web.archive.org/web/20221027181005/https://www.sequo...

A great example. This wasn't but just 3 years ago, so definitely part of their increasing slide into embarrassment...

Re: Building A16Z's Personal AI Workstation

#56
post #7

A16Z is consistently the most embarrassing VC firm at any given point in time. I guess optimistically they might be doing “outrage marketing” but it feels more like one of those places where the CEO is just an idiot and tells his employees to jump on every trend. The funny part is that they still make money. It seems like once you’ve got the connections, being a VC is a very easy job these days.

It's been such a mind-boggling decline in intellect, combined with really odd and intense conspiratorial behavior around crypto, that I went into a bit a few months ago. My weak, uncited, understanding from then they're poorly positioned, i.e in our set they're still the guys who write you a big check for software, but in the VC set they're a joke: i.e. they misunderstood carpet bombing investment as something that s…

If you're inferencing, you're not getting much more out of this than you would a ~$2K Framework desktop.

Well, you're getting the ability to maintain a context bigger than 8K or so, for one thing.

Re: Building A16Z's Personal AI Workstation

#57
post #3

Ok but what are you doing with them? Much more interested in that.

I imagine it runs civ 2 pretty well

Dude imagine mounting a virtual drive on that GPU and loading the game straight from that. You won’t even notice the loading screens!

Re: Building A16Z's Personal AI Workstation

#58
post #13
post #8

This article is a great way to showcase A16Z standinging head and shoulders above other VCs with REAL technical expertise in the partnership. Love reading this kind of stuff, but the article really needs a price to put this in perspective. It would be the VC that would ignore price, lol, but roughing this out it looks like it costs 45k to build this thing. Seems, at first glance, that this is a cost efficient way to…

The technical expertise of... buying four of the fanciest Nvidia GPU and plugging them into an off-the-shelf motherboard in an off-the-shelf chassis? A serious attempt at this kind of build would use the server variant of the RTX6000 and custom air ducts to cool them efficiently, but they packed four blower coolers like sardines so it no doubt sounds like a screaming jet engine under load.

Maybe they’re a vibe coder and to them this looks like engineering

Re: Building A16Z's Personal AI Workstation

#59
post #52
post #50

Earlier quoted context omitted.

There are no RTX6000 "server" variants. These GPUs are designed for workstation use. I mean it is even in the name.

https://www.nvidia.com/en-us/data-center/rtx-pro-6000-blackw... The workstation versions are fine if you're running one or maybe two cards with an airflow gap between them, but if you pack four of them right next to each other then you're going to have a bad time when the fans get going.

Ou, I was wrong. Unexpected. Are there (comparatively) a lot of uses for the that card in a server?

Re: Building A16Z's Personal AI Workstation

#60

Earlier quoted context omitted.

It's been such a mind-boggling decline in intellect, combined with really odd and intense conspiratorial behavior around crypto, that I went into a bit a few months ago. My weak, uncited, understanding from then they're poorly positioned, i.e in our set they're still the guys who write you a big check for software, but in the VC set they're a joke: i.e. they misunderstood carpet bombing investment as something that s…

> If you're inferencing, you're not getting much more out of this than you would a ~$2K Framework desktop. I was with you up till here. Come on! CPU inferencing is not it, even macs struggle with bigger models, longer contexts (esp. visible when agentic stuff gets > 32k tokens). The PRO6000 is the first gpu that actually makes sense to own from their "workstation" series.

Er, CPU inferencing? :) I didn't think I mentioned that!

The Framework Desktop thing is that has unified memory with the GPU, so much like an M-series, you can inference disproportionately large models.

Post reply on HN