Viewing profile — kathleenfromgdm

The context length for these models is 8192 tokens.

Good catch - just corrected. Thanks!

The context length for these models is 8192 tokens.

Great question - we compare to the Mistral 7B 0.1 pretrained models (since there were no pretrained checkpoint updates in 0.2) and the Mistral 7B 0.2 instruction-tuned models in th…

We release our non-aligned models (marked as pretrained or PT models across platforms) alongside our fine-tuned checkpoints; for example, here is our pretrained 7B checkpoint for d…

Corrected - thanks :)

Yes, you can get started downloading the model and running inference on Kaggle: https://www.kaggle.com/models/google/gemma ; for a full list of ways to interact with the model, you…

Thank you! You can get started downloading the model and running inference on Kaggle: https://www.kaggle.com/models/google/gemma ; for a full list of ways to interact with the mode…

We've documented the architecture (including key differences) in our technical report here ( https://goo.gle/GemmaReport ), and you can see the architecture implementation in our G…