Viewing profile — skeegan

Building Cost (cost.botzone.ai): an SDK that attributes LLM spend to the feature, route, or user actually burning the tokens, and checks whether a cheaper model holds up against your real traffic before you switch.

Mostly here for the cost/perf threads. Interested in eval harnesses,LLM-as-judge, and shadow-running model swaps in production. Always up to compare notes.