A rough price out using new egg/microcenter pricing, substituting a few items where they didn't specify a specific item/brand. I didn't bother trying to figure out what case they used. Grand total: ~ $41,000 Motherboard https://www.newegg.com/gigabyte-mh53-g40-amd-ryzen-threadrip... $895 CPU https://www.microcenter.com/product/674313/amd-ryzen-threadr... - $3500 Cooler https://www.newegg.com/p/3C6-013W-002G6 $585 RAM…
Building A16Z's Personal AI Workstation
51–60 of 75 posts
Re: Building A16Z's Personal AI Workstation
#52Earlier quoted context omitted.
In all fairness, not even Lambda Labs offers workstations with RTX6000 server variants.
There are no RTX6000 "server" variants. These GPUs are designed for workstation use. I mean it is even in the name.
The workstation versions are fine if you're running one or maybe two cards with an airflow gap between them, but if you pack four of them right next to each other then you're going to have a bad time when the fans get going.
Re: Building A16Z's Personal AI Workstation
#53A rough price out using new egg/microcenter pricing, substituting a few items where they didn't specify a specific item/brand. I didn't bother trying to figure out what case they used. Grand total: ~ $41,000 Motherboard https://www.newegg.com/gigabyte-mh53-g40-amd-ryzen-threadrip... $895 CPU https://www.microcenter.com/product/674313/amd-ryzen-threadr... - $3500 Cooler https://www.newegg.com/p/3C6-013W-002G6 $585 RAM…
As soon as you drive it off the lot, it is worth half the value.
Re: Building A16Z's Personal AI Workstation
#54Earlier quoted context omitted.
> This article is a great way to showcase A16Z standinging head and shoulders above other VCs with REAL technical expertise in the partnership. what? a 12 year old with a titanic budget could put this PC together
I don't want to be insulting here, but have you sat down with a partner at a VC before? You may be surprised to discover their skill is rarely deeply technical...
Re: Building A16Z's Personal AI Workstation
#55Earlier quoted context omitted.
Sequoia is also increasingly embarrassing. A shame because it wasn't but 10 years ago that these firms seemed like they were leading the charge of world-changing innovation, etc...
Increasingly? This is the Sequoia who wrote thousands of words on Sam Bankman-Fried that uncritically said little more than “he’s so quirky and smart! ^_^” https://web.archive.org/web/20221027181005/https://www.sequo...
Re: Building A16Z's Personal AI Workstation
#56A16Z is consistently the most embarrassing VC firm at any given point in time. I guess optimistically they might be doing “outrage marketing” but it feels more like one of those places where the CEO is just an idiot and tells his employees to jump on every trend. The funny part is that they still make money. It seems like once you’ve got the connections, being a VC is a very easy job these days.
It's been such a mind-boggling decline in intellect, combined with really odd and intense conspiratorial behavior around crypto, that I went into a bit a few months ago. My weak, uncited, understanding from then they're poorly positioned, i.e in our set they're still the guys who write you a big check for software, but in the VC set they're a joke: i.e. they misunderstood carpet bombing investment as something that s…
Well, you're getting the ability to maintain a context bigger than 8K or so, for one thing.
Re: Building A16Z's Personal AI Workstation
#57Re: Building A16Z's Personal AI Workstation
#58This article is a great way to showcase A16Z standinging head and shoulders above other VCs with REAL technical expertise in the partnership. Love reading this kind of stuff, but the article really needs a price to put this in perspective. It would be the VC that would ignore price, lol, but roughing this out it looks like it costs 45k to build this thing. Seems, at first glance, that this is a cost efficient way to…
The technical expertise of... buying four of the fanciest Nvidia GPU and plugging them into an off-the-shelf motherboard in an off-the-shelf chassis? A serious attempt at this kind of build would use the server variant of the RTX6000 and custom air ducts to cool them efficiently, but they packed four blower coolers like sardines so it no doubt sounds like a screaming jet engine under load.
Re: Building A16Z's Personal AI Workstation
#59Earlier quoted context omitted.
There are no RTX6000 "server" variants. These GPUs are designed for workstation use. I mean it is even in the name.
https://www.nvidia.com/en-us/data-center/rtx-pro-6000-blackw... The workstation versions are fine if you're running one or maybe two cards with an airflow gap between them, but if you pack four of them right next to each other then you're going to have a bad time when the fans get going.
Re: Building A16Z's Personal AI Workstation
#60Earlier quoted context omitted.
It's been such a mind-boggling decline in intellect, combined with really odd and intense conspiratorial behavior around crypto, that I went into a bit a few months ago. My weak, uncited, understanding from then they're poorly positioned, i.e in our set they're still the guys who write you a big check for software, but in the VC set they're a joke: i.e. they misunderstood carpet bombing investment as something that s…
> If you're inferencing, you're not getting much more out of this than you would a ~$2K Framework desktop. I was with you up till here. Come on! CPU inferencing is not it, even macs struggle with bigger models, longer contexts (esp. visible when agentic stuff gets > 32k tokens). The PRO6000 is the first gpu that actually makes sense to own from their "workstation" series.
The Framework Desktop thing is that has unified memory with the GPU, so much like an M-series, you can inference disproportionately large models.