Serving 90TB/Day of Linux Updates from Thin Clients

#1

Post by phirephly » Wed, May 10, 2023, 2:45 AM UTC

Serving 90TB/Day of Linux Updates from Thin Clients
blog.thelifeofkenneth.com

Re: Serving 90TB/Day of Linux Updates from Thin Clients

#2

Post by guenthert » Wed, May 10, 2023, 5:34 PM UTC

Thin clients aren't mentioned and I don't see how they are involved. Who writes such head lines?

Re: Serving 90TB/Day of Linux Updates from Thin Clients

#3

Post by krunck » Wed, May 10, 2023, 5:40 PM UTC

guenthert wrote: post #2

Thin clients aren't mentioned and I don't see how they are involved. Who writes such head lines?

Read.

"... we settled on a design consisting of the following:

    HP T620 thin client
    2x4GB DIMMs
    2TB M.2 SSD"

Re: Serving 90TB/Day of Linux Updates from Thin Clients

#4

Post by guenthert » Wed, May 10, 2023, 5:50 PM UTC

krunck wrote: post #3

guenthert wrote: post #2

Thin clients aren't mentioned and I don't see how they are involved. Who writes such head lines?

Read. "... we settled on a design consisting of the following: HP T620 thin client 2x4GB DIMMs 2TB M.2 SSD"

I stand corrected (no excuses, I had my coffee already).

I managed to miss 'thin' when searching the web site (first hit from where I was happened to be 'thinking' and then I saw the Dell rack servers).

So the "thin clients" (with local storage they look like small PCs to me) are for the hottest content only: "Setting the tiny mirror up only hosting Ubuntu ISOs, Extra Packages for Enterprise Linux, and the CentOS repo for servers easily exceeded our design objective of >1TB/day of network traffic. Not a replacement for traditional "heavy iron" mirrors that can host a longer tail of projects, but this is 1TB of network traffic which we were able to peel off of those bigger mirrors so they could spend their resources serving the less popular content, which we wouldn't be able to fit on the single 2TB SSD inside this box."

Re: Serving 90TB/Day of Linux Updates from Thin Clients

#5

Post by nadermx » Wed, May 10, 2023, 7:27 PM UTC

That amount of data a day is none trivial amount. Cool write up.

Re: Serving 90TB/Day of Linux Updates from Thin Clients

#6

Post by Havoc » Wed, May 10, 2023, 11:09 PM UTC

Cool project & glad to see there are datacenters willing to help out. Kinda amused that they can't accomodate 1gig anymore. Progress!

As a side note, if you have a lot of VMs setting up a local proxy (Apt-Cacher NG) is pretty straight forward. Catches the majority of my apt traffic especially since I'm rebuilding stuff nightly tends to hit the same packages over & over

Re: Serving 90TB/Day of Linux Updates from Thin Clients

#7

Post by toast0 » Thu, May 11, 2023, 1:48 AM UTC

guenthert wrote: post #4

krunck wrote: post #3

Earlier quoted context omitted.

Read. "... we settled on a design consisting of the following: HP T620 thin client 2x4GB DIMMs 2TB M.2 SSD"

I stand corrected (no excuses, I had my coffee already). I managed to miss 'thin' when searching the web site (first hit from where I was happened to be 'thinking' and then I saw the Dell rack servers). So the "thin clients" (with local storage they look like small PCs to me) are for the hottest content only: "Setting the tiny mirror up only hosting Ubuntu ISOs, Extra Packages for Enterprise Linux, and the CentOS rep…

> "thin clients" (with local storage they look like small PCs to me)

That's what modern thin clients mostly are. Small pcs, preconfigured to run remotedesktop and similar. Like a lot of enterprise gear, they often get surplused for cheap though, and if the hardware meets your needs and the price is right...