Earlier quoted context omitted.
> LLMs are an abstraction just like machine code -> assembly -> C/JVM -> some lang -> LLMs? People keep trying to make that analogy, but it doesn't really work because LLMs aren't deterministic like compilers and assemblers.
They don’t need to be dererministic, only reproducible. They’re not reproducible, nor are they even reliable right now.
Regardless, you can make them deterministic by turning the temperature down to zero. Just nobody likes doing that for whatever reason. I guess it ruins some sort of illusion people seem to like.