Hello on behalf of the Gemma team! We are really excited to answer any questions you may have about our models. Opinions are our own and not of Google DeepMind.
Will there be Gemma-vision models or multimodal Gemma models?
Gemma: New Open Models
71–80 of 543 posts
Re: Gemma: New Open Models
#72What is the context window?
Re: Gemma: New Open Models
#73Looking forward to Gemma 7bx8 moe
Re: Gemma: New Open Models
#74Go back 5 years and ask anyone on this site what companies do you think will be the most open about AI in the future OpenAI, Meta, or Google. I bet 10/10 people would pick OpenAI. Now today Meta and Google, both trillion dollars companies, are releasing very powerful open models with the ability to be used commercially. Ironic.
This article states quite an impressive list of open source tools that Google has released for years in the past. This is no surprise coming from* them. Google has released some large pieces of source in other domains as well, Chromium comes to mind, which probably impacts most Internet users directly. The question is not about Google but about OpenAI.
Did you miss a footnote with your asterisks?
Re: Gemma: New Open Models
#75Is there a chance we'll get a model without the "aligment" (lobotomization)? There are many examples where answers from Gemini are garbage because of the ideological fine tuning.
You can (and someone will) fine tune it away. There are datasets which are foss you can use on hugging face.
Or you can just wait, it'll be done soon...
Re: Gemma: New Open Models
#76Hello on behalf of the Gemma team! We are really excited to answer any questions you may have about our models. Opinions are our own and not of Google DeepMind.
What are the supported languages of these models?
This v1 model is focused on English support, but you may find some multilingual capabilities.
Re: Gemma: New Open Models
#77Earlier quoted context omitted.
True, though to be fair, when OpenAI embraced "openness" it was also a PR stunt.
My impression is that OpenAI was founded by true believers, with the best intentions; whose hopes were ultimately sidelined in the inexorable crush of business and finance.
[deleted]
Re: Gemma: New Open Models
#78Is there a chance we'll get a model without the "aligment" (lobotomization)? There are many examples where answers from Gemini are garbage because of the ideological fine tuning.
We release our non-aligned models (marked as pretrained or PT models across platforms) alongside our fine-tuned checkpoints; for example, here is our pretrained 7B checkpoint for download: https://www.kaggle.com/models/google/gemma/frameworks/keras/...
Re: Gemma: New Open Models
#79[dead]
Re: Gemma: New Open Models
#80Hello on behalf of the Gemma team! We are really excited to answer any questions you may have about our models. Opinions are our own and not of Google DeepMind.
Congrats on the launch and thanks for the contribution! This looks like it's on-par or better compared to mistral 7B 0.1 or is that 0.2? Are there plans for MoE or 70B models?
Great question - we compare to the Mistral 7B 0.1 pretrained models (since there were no pretrained checkpoint updates in 0.2) and the Mistral 7B 0.2 instruction-tuned models in the technical report here: https://goo.gle/GemmaReport