The interesting bottleneck I keep running into isn’t just model quality — it’s lifecycle management of models in constrained environments (load → run → unload patterns, plus routing between different models depending on task type).
Curious if anyone else is exploring per-request model execution rather than keeping models resident all the time.