> To improve determinism, define a system instruction with explicit rules for your specific use case. "Please be deterministic".
> improve determinism Oh well. I might be to picky here, but how I see things, determinism cannot be improved or worsened, but achieved or not achieved. Or Partially archieved, when analyzing a system that has both components that are deterministic or non deterministic. There are times to think in absolutes, and when talking about deterministic behavior of technical systems, this is one of them. Join the sith side, w…
Gemini last models: temperature, top_p, and top_k are deprecated and ignored
51–53 of 53 posts
Re: Gemini last models: temperature, top_p, and top_k are deprecated and ignored
#52Earlier quoted context omitted.
ironically, any frontier LLM will easily generate a tutorial at any detail you like explaining what these are. if don't have time for that, just know that these are technical parameters that affect how likely it is an llm will produce the same result after being asked the same question.
Is an llm able to explain to itself what these parameters do, and change its own parameter settings?
Re: Gemini last models: temperature, top_p, and top_k are deprecated and ignored
#53Earlier quoted context omitted.
> improve determinism Oh well. I might be to picky here, but how I see things, determinism cannot be improved or worsened, but achieved or not achieved. Or Partially archieved, when analyzing a system that has both components that are deterministic or non deterministic. There are times to think in absolutes, and when talking about deterministic behavior of technical systems, this is one of them. Join the sith side, w…
Would "decrease randomness" be acceptable to you?
Another further distinction would be between "true randomness" and "We do not know all input factors yet, hence, the outcome appears random to us". The former is something that genuinely exists in the universe as far as I understand physics (i.e. even if all input parameters are known, it is not possible to predict the outcome reliably, which seems to be the case for quantum physics, which I have the surfacest or surface levels of understandings about), the later boils down to reducing "unknown unkowns".
In practise, this means stuff like using seeds for random number generators, fixing things that look random like day of the week of a DateTime.now(), and so on. Depending on what you do, it might be never possible to get rid of all randomness, but I am 100% convinced that you can always contain it into a well-defined cage, and control everything else down to the last bit.
That also made me think of the opposite: "Increasing predictability" would be acceptable for me too, and a deterministic process/component/system/whatever is one that is at maximum possible predictability for me then.