I've been building Replaybook as an incident replay trainer. Recently, I started using it as an evaluation framework for infrastructure agents.

Show HN: Replaybook, an Infrastructure Agent Evaluation Framework
github.com