GLB: GitHub's open source load balancer

#1

Post by csteinbe » Wed, Aug 08, 2018, 4:49 PM UTC

GLB: GitHub's open source load balancer
githubengineering.com

Re: GLB: GitHub's open source load balancer

#2

Post by toomuchtodo » Wed, Aug 08, 2018, 5:28 PM UTC

Previous discussion (September 2016): https://news.ycombinator.com/item?id=12558053

Re: GLB: GitHub's open source load balancer

#3

Post by jsiepkes » Wed, Aug 08, 2018, 5:40 PM UTC

Looks really cool! Though a simpler solution for most people will probably be OpenBSD's CARP protocol to share a single virtual IP between multiple boxes (with for example relayd). ECMP routing can get complex fast.

Re: GLB: GitHub's open source load balancer

#4

Post by [deleted] » Wed, Aug 08, 2018, 5:49 PM UTC

[deleted]

Re: GLB: GitHub's open source load balancer

#5

Post by justinsaccount » Wed, Aug 08, 2018, 5:58 PM UTC

Re: GLB: GitHub's open source load balancer

#6

Post by Chris911 » Wed, Aug 08, 2018, 5:59 PM UTC

toomuchtodo wrote: post #2

Previous discussion (September 2016): https://news.ycombinator.com/item?id=12558053

This new post is about the newly released GLB Director. The title should be changed.

Re: GLB: GitHub's open source load balancer

#7

Post by SEJeff » Wed, Aug 08, 2018, 6:04 PM UTC

jsiepkes wrote: post #3

Looks really cool! Though a simpler solution for most people will probably be OpenBSD's CARP protocol to share a single virtual IP between multiple boxes (with for example relayd). ECMP routing can get complex fast.

Or VRRP with the open source keepalived, which has been around for a decade+ and works wonderfully on Linux.

Re: GLB: GitHub's open source load balancer

#8

Post by ahoka » Wed, Aug 08, 2018, 6:09 PM UTC

jsiepkes wrote: post #3

Looks really cool! Though a simpler solution for most people will probably be OpenBSD's CARP protocol to share a single virtual IP between multiple boxes (with for example relayd). ECMP routing can get complex fast.

Unfortunately it is not an option on some cloud providers, because you don't get true layer 2.

Re: GLB: GitHub's open source load balancer

#9

Post by ded31 » Wed, Aug 08, 2018, 6:40 PM UTC

justinsaccount wrote: post #5

See also: Facebook: https://code.fb.com/open-source/open-sourcing-katran-a-scala... Google: https://cloudplatform.googleblog.com/2016/03/Google-shares-s... The design of all 3 is very similar.

The Github folks could have used XDP similar as with Katran, I think their solution is very elegant in that the same node would still be able to process other workloads/jobs which is one of the reasons why Facebook decided against DPDK:

https://atscaleconference.com/videos/networking-scale-2018-l...

Re: GLB: GitHub's open source load balancer

#10

Post by vbernat » Wed, Aug 08, 2018, 6:44 PM UTC

jsiepkes wrote: post #3

Looks really cool! Though a simpler solution for most people will probably be OpenBSD's CARP protocol to share a single virtual IP between multiple boxes (with for example relayd). ECMP routing can get complex fast.

CARP and the likes rely on the presence of an L2 layer which means you get limited scale or increased risk of a global outage. An L3 design scales very well and is resilient (notably because of the distributed control plane and the inability to create a loop).