You can predict LLM output sensitivity in closed form
noahgolmant.com