Live data from Hacker News

Gemini last models: temperature, top_p, and top_k are deprecated and ignored

ai.google.dev

51–53 of 53 posts

Re: Gemini last models: temperature, top_p, and top_k are deprecated and ignored

#51

> To improve determinism, define a system instruction with explicit rules for your specific use case. "Please be deterministic".

> improve determinism Oh well. I might be to picky here, but how I see things, determinism cannot be improved or worsened, but achieved or not achieved. Or Partially archieved, when analyzing a system that has both components that are deterministic or non deterministic. There are times to think in absolutes, and when talking about deterministic behavior of technical systems, this is one of them. Join the sith side, w…

Would "decrease randomness" be acceptable to you?

Re: Gemini last models: temperature, top_p, and top_k are deprecated and ignored

#52
post #15

Earlier quoted context omitted.

ironically, any frontier LLM will easily generate a tutorial at any detail you like explaining what these are. if don't have time for that, just know that these are technical parameters that affect how likely it is an llm will produce the same result after being asked the same question.

Is an llm able to explain to itself what these parameters do, and change its own parameter settings?

Yes but it implies it's doing its own "brain surgery" so if it got params wrong it could break itself. In that case you would have another AI behind the scenes doing the tweaking so it can understand you at a "subconscious" level.

Re: Gemini last models: temperature, top_p, and top_k are deprecated and ignored

#53

Earlier quoted context omitted.

> improve determinism Oh well. I might be to picky here, but how I see things, determinism cannot be improved or worsened, but achieved or not achieved. Or Partially archieved, when analyzing a system that has both components that are deterministic or non deterministic. There are times to think in absolutes, and when talking about deterministic behavior of technical systems, this is one of them. Join the sith side, w…

Would "decrease randomness" be acceptable to you?

Yes! The "-ness" implies some degree of spectrum already, and from what I know and understand, one can talk about different degrees/classes of randomness. "decreasing entropy" would work too, I guess (Intuitively: If one would open a bet on a system outcome, how high would the quotas be? If there is some degree of randomness in the system, it would make sense to put money on multiple different outcomes to minimize ones losses. Only if there is no randomness at all, it would be rational to bet all money on the one option we expect).

Another further distinction would be between "true randomness" and "We do not know all input factors yet, hence, the outcome appears random to us". The former is something that genuinely exists in the universe as far as I understand physics (i.e. even if all input parameters are known, it is not possible to predict the outcome reliably, which seems to be the case for quantum physics, which I have the surfacest or surface levels of understandings about), the later boils down to reducing "unknown unkowns".

In practise, this means stuff like using seeds for random number generators, fixing things that look random like day of the week of a DateTime.now(), and so on. Depending on what you do, it might be never possible to get rid of all randomness, but I am 100% convinced that you can always contain it into a well-defined cage, and control everything else down to the last bit.

That also made me think of the opposite: "Increasing predictability" would be acceptable for me too, and a deterministic process/component/system/whatever is one that is at maximum possible predictability for me then.

Post reply on HN