Live data from Hacker News

Threadripper 3990X: The Quest To Compile 1B Lines Of C++ On 64 Cores

blogs.embarcadero.com

31–40 of 187 posts

Re: Threadripper 3990X: The Quest To Compile 1B Lines Of C++ On 64 Cores

#34

Earlier quoted context omitted.

> i actually put HDDs on some workstations as SSD just die after 2-3 years of active build on them That sounds very low for modern SSDs, even consumer-grade. Have you tried different vendors?

If spending hours a day at 100% utility, SSDs will rarely last 5 years.

Depends on the kind of SSD. If it's using SLC, the write endurance is much much higher. If you're going with cheap SSDs (TLC or QLC), your write endurance will suck.

see: https://www.anandtech.com/show/6459/samsung-ssd-840-testing-...

Re: Threadripper 3990X: The Quest To Compile 1B Lines Of C++ On 64 Cores

#35

Earlier quoted context omitted.

> i actually put HDDs on some workstations as SSD just die after 2-3 years of active build on them That sounds very low for modern SSDs, even consumer-grade. Have you tried different vendors?

If spending hours a day at 100% utility, SSDs will rarely last 5 years.

What kind of workload will do that?

Re: Threadripper 3990X: The Quest To Compile 1B Lines Of C++ On 64 Cores

#36

Earlier quoted context omitted.

Make forces you to choose between being able to do full parallel builds or using recursive make, you can’t do both.

I might be misunderstanding something, but the common gnumake does no such thing. https://www.gnu.org/software/make/manual/html_node/Job-Slots...

I didn’t go into great detail of the reasons, but the jobserver doesn’t address the problem except for the most trivial cases—the core problem is that you can’t cross to a recursive make invocation via multiple edges.

This is fairly common in larger projects, so you end up having to do some hackery to manually sequence make invocations if you want to use recursive make (which is pretty awful).

Honestly, for large projects, Make is an insane choice, notwithstanding the fact that people who are sufficiently savvy at Make can sometimes make it work. (If your tools are bad, you can make up for it with extra staff time and expertise.)

Re: Threadripper 3990X: The Quest To Compile 1B Lines Of C++ On 64 Cores

#37

Earlier quoted context omitted.

If spending hours a day at 100% utility, SSDs will rarely last 5 years.

What kind of workload will do that?

a build server recompiling multiple branches over and over in response to changes.

Re: Threadripper 3990X: The Quest To Compile 1B Lines Of C++ On 64 Cores

#38
post #29
post #24

Earlier quoted context omitted.

i (and some teamates) actually put HDDs on some workstations as SSD just die after 2-3 years of active build on them and with modern HDDs you have practically unlimited storage while you can have only limited number of 400G builds on SSD (the org has psychological barriers to having more than 1-2Tb SSD in a machine) and the SSD start to have perf issues when at 70-80% capacity . With HDD the build time didn't change…

Those are pretty beefy workstations, does every developer have one or are these really build servers? As I noted you could always throw money at this and end up somewhere reasonable, but it introduces workflow considerations for your devs.

It is one per dev, and in reality it is at least a couple - I have 4 of them for example. The product itself is a beast too.

Re: Threadripper 3990X: The Quest To Compile 1B Lines Of C++ On 64 Cores

#39

Earlier quoted context omitted.

What kind of workload will do that?

a build server recompiling multiple branches over and over in response to changes.

And logging all of those unit tests associated with all of those builds (and rolling over those logs with TRACE level debugging).

Every build gets fully tested at maximum TRACE logging, so that anyone who looks at the build / test later can search the logs for the bug.

8TBs of storage is a $200 hard drive. Fill it up, save everything. Buy 5 hard drives, copy data across them redundantly with ZFS and stuff.

1TBs of SSD storage is $100 (for 4GBps) to $200 (for 7GBps). Copy data from the hard drive array on the build server to the local workstation as you try to debug what went wrong in some unit test.

Post reply on HN