It’s been a fun, practical way to continuously evaluate the latest models two ways - via coding assistance & swapping between models to power the conversational AI voice partner. I’ve been trying to add one big new feature each time the model generation updates.
The next thing I want to add is a self improving feedback loop where it uses user ratings of the calls & evaluations to refine the prompts that generate them.
Plus it has a few real customers which is sweet!