Live data from Hacker News

Kage shadows production traffic to QA servers

github.com

1–9 of 9 posts

Re: Kage shadows production traffic to QA servers

#7
post #3

Great project, I'd be a little cautious proxying all my production traffic through a new experimental piece of software though. Another solution using only netcat and tee is described on ServerFault: http://serverfault.com/questions/309583/duplicate-incoming-t...

Yeah good point. We actually run kage proxy behind another load balancer, and only send traffic with a sampling cookie set, which can be controlled from our main app.

Re: Kage shadows production traffic to QA servers

#8

It's probably a good thing that this doesn't support SSL, as you wouldn't want this application as your main contact on the outside web. I'd suggest going using a frontend (such as Nginx or Apache) => Kage => Backend boxes.

Yep, we run kage behind another load balancer that does SSL decryption etc.

Re: Kage shadows production traffic to QA servers

#9
post #6

Good concept. But this design is insane. The shadow should be attached via a logging plugin to your trusted webserver or load balancer, so it doesn't destabilize your production system.

Well, I take "insane" as a compliment :) While it is true you can emulate the traffic by looking at web server logs, it was crucial for us to send the exact same request including the same HTTP headers and request body (think POST requests), in real time with the same access pattern.

It was easier for us to write EM based proxy like this than writing a web server plugin that does it, etc.