Viewing profile — 33hsiidhkl

When should a model's output be deterministic? When should a model's output be non-deterministic? When many humans interact with the same model, then maybe the model should try dif…

temperature does not affect token prediction in the way you think. The seed value is still the seed value, before temperature calculations are performed. The randomness of an LLM i…

I don't really understand your point. An LLM is loaded with a seed value, which is a number. The number may be chosen through some pseudo- or random process, or specified manually.…

It absolutely is deterministic, for any given seed value. Same seed = same output, every time, which is by definition deterministic.

For any given seed value, the output of an LLM will be identical- it is deterministic. You can try this at home with Llama.cpp by specifying a seed value when you load a LLM, and t…