Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Edge Computing at Chick-fil-A

medium.com

Post reply on HN
Print view View original

171–180 of 401 posts

Re: Edge Computing at Chick-fil-A

#171

Post by coffeesn0b »

swampthinker wrote: post #143
coffeesn0b wrote: post #130

Earlier quoted context omitted.

Hey! Caleb here... I'm the lead SRE building the clusters on the restaurants. Each individual restaurant gets it's own cluster (we aren't fully deployed yet). There are too many network latency challenges and too much immaturity around federated clusters to take the route (unfortunately). We currently use gitops, which houses all the configs per cluster in a single repo per restaurant (CRAZY amount of corgis!)... we…

What were the main issues you faced with Helm?

The primary challenge was just reasoning with the template and using Helm at scale... ie; what exactly did we deploy on those hundreds of varying clusters?

Other issues included; tiller would sometimes become unstable... version mismatch issues between helm local and roller... lack of a clear, outage free canary deployment... we even found cases where helm would not cleanup after itself during a deployment and retain previous config settings within k8s.

Re: Edge Computing at Chick-fil-A

#173

Post by chipotle_coyote »

pvg wrote: post #124
chipotle_coyote wrote: post #112

Earlier quoted context omitted.

The quoted definition of bigotry as "intolerance toward those who hold different opinions from oneself" is from the New Oxford American Dictionary, from Oxford University Press (the OED people). If that's what Google is using, I don't think I can rely on your definition of "crappy."

Yep, it's a crappy definition that does not reflect current usage. It doesn't even reflect the definition in the OED, if you want to check there. 'Bigotry' is not limited to difference of opinion. Nobody uses it like that, you can take a look at the quoted usage examples here, which are from current publications. https://www.merriam-webster.com/dictionary/bigotry

The OED is a historical dictionary; the Oxford Dictionary of English and the New Oxford American Dictionary are explicitly meant to reflect more current usage. At any rate, I think this is getting awfully pedantic; the definition you linked is "obstinate or intolerant devotion to one's own opinions and prejudices," which seems similar enough that I'm not really sure what the point of this argument is. Given that I'm fairly sure the point of this was whether Chick-Fil-A's executives and in-the-company's-name giving exhibits bigotry, by any dictionary anyone's linked to, the answer is "yes."

Re: Edge Computing at Chick-fil-A

#174

Post by rileyphone »

This is a pretty cool example of cybernetics ala Stafford Beer - constant information and reaction to streamline production. I'm excited to see this be brought in to more production (though maybe it has, and most places aren't as upfront as this). It's truly a shame the Chilean experiment in the early 70s didn't work out.

On a side note, it's interesting that Kubernetes is the word from which cybernetics is derived, meaning "governance".

Re: Edge Computing at Chick-fil-A

#175

Post by coffeesn0b »

jaytaylor wrote: post #65

Since we have a highly available Kubernetes cluster with data replicated across all nodes .. This sounds like one of the more cutting-edge bare-metal kubernetes setups I've heard of! Curious what the kubernetes implementation / configuration looks like for the setup they've described. Particularly in terms of HA-cluster k8s configuration, networking solutions integrated, and replicated storage. Considering there is n…

Well, it’s a 6 man team so most of our trade offs were for expedience, not the worlds greatest architecture. We cheated and sync’d data using a HA MongoDB setup amongst the cluster. RKE for K8s clustering was a life saver (nothing easier at this point on bare metal IMO), although RKE can be brittle at times.

Re: Edge Computing at Chick-fil-A

#176

Post by smhost »

factsaresacred wrote: post #126
caconym_ wrote: post #108

Earlier quoted context omitted.

I love seeing this argument. It's like you people think you can raise any arbitrary instance of hate/intolerance/ bigotry onto a criticism-proof pedestal simply by brandishing a dictionary. Like, who are the real bigots: Nazis, or the nasty people who have the gall to disagree with their racist, antisemitic, etc. views? Is the answer not obvious? Does the question send you scuttling back under your dictionary? I'm fi…

You're missing the point. I'm not concerned about the word. I'm concerned about the definition - those quickest to cry bigot are often guilty of acting like one themselves. Case-in-point: Twitter CEO Jack Dorsey being forced to apologise for eating at Chick-fil-A during LGBT Month. What kind of bizarre intolerant nonsense is that? Another case-in-point: Boston and Chicago mayors claim "Chick-fil-A values are not [our…

That's very intolerant of you to cry bigot about people who support LGBT rights.

Totally bizarre intolerant nonsense.

Re: Edge Computing at Chick-fil-A

#177

Post by coffeesn0b »

nvahalik wrote: post #142
coffeesn0b wrote: post #131

Earlier quoted context omitted.

We will have an order of magnitude more cloud datacenters than AWS! :)

Do you also have a CDN (Chicken Delivery Network)? (Stolen from a guy in a slack channel.)

My coworkers found this one quite amusing.

Re: Edge Computing at Chick-fil-A

#178

Post by coffeesn0b »

reaperducer wrote: post #141
coffeesn0b wrote: post #132

Earlier quoted context omitted.

Interesting - why? (this is Caleb, one of the authors and lead SRE for the project)

Interesting - why? Because more than one person on the team has a background in meteorology, and to them a localized cloud event is "fog." I think it started as a joke, but it just kind of stuck. It helps that our events that require localized cloud infrastructure are sporadic, just the way real fog is. And just like real fog, we don't always know where it will be. Once or twice a year we have to deploy about 150 dev…

That is epic, and i am stealing that name.

Re: Edge Computing at Chick-fil-A

#179

Post by swaggyBoatswain »

abraham_lincoln wrote: post #155
reaperducer wrote: post #114

Earlier quoted context omitted.

One thing I question is what kind of WAN link a single chicken fast food restaurant can get, or is economical At this point, I don't think it's a problem for CFA. CFA doesn't try to go into every little town in the nation like McDonald's. It's expansion is very deliberate and only seems to go into very high value locations, where internet presumably isn't a problem. Moreover, landlords fall all over themselves to lan…

Meh. Unless you personally own a franchise, or work for corporate, this is pure conjecture. The article did mention if a failed node is detected, a next-day restore 'disk' is delivered to the store, so obviously that is faster/more reliable than random ISP.

Having a chickfila greatly increases realestate value for the landlord though, more so than other restaurant chains like McDonalds.

Re: Edge Computing at Chick-fil-A

#180

Post by coffeesn0b »

barbecue_sauce wrote: post #12

Interesting that they use Kubernetes exclusively for edge computing resources (as opposed to their cloud architecture). Never really considered this approach before.

If you decide to play around with it, we use RKE to build and manage the k8s environments locally.
Post reply on HN