I wonder if people will get confused with the naming
Gemma, Gemini pro, Gemini advanced, Gemini ultra
To a layperson it is not obvious which one is better than the other
Gemma: New Open Models
181–190 of 543 posts
Re: Gemma: New Open Models
#182Unbefkglievable — Another week, another new name?
Re: Gemma: New Open Models
#183Available on Ollama?
It's now in the 0.1.26 pre-release: https://github.com/ollama/ollama/releases/tag/v0.1.26
Re: Gemma: New Open Models
#184Hello on behalf of the Gemma team! We are really excited to answer any questions you may have about our models. Opinions are our own and not of Google DeepMind.
Will there be "extended context" releases like 01.ai did for Yi? Also, is the model GQA?
It's MQA, documented in the tech report
Re: Gemma: New Open Models
#185The utter bullshit of these licenses has got to stop. Do not, under any circumstances, consider using these commercially. "Google reserves the right to restrict (remotely or otherwise) usage of any of the Gemma Services that Google reasonably believes are in violation of this Agreement." This is a kill switch that Google maintains in perpetuity over any system you build relying on these models. Our legal review of th…
Could you share what models you consider to be OK for commercialization?
Mistral series in particular but those with OSI approved licenses such as Apache 2.0, MIT, etc.
Re: Gemma: New Open Models
#186Hopefully not totally gimped like Gemini. Are they releasing an uncensored version?
When you say this, do you mean the chat product or the underlying model available via the API? I think it's reasonable that the chat be censored to be acceptable to a wide range of people, but my understanding is that the "raw" model access for these sorts of things tends to be a little less restricted.
Re: Gemma: New Open Models
#187Earlier quoted context omitted.
Honestly, this is more of a PR stunt to advertise the Google Dev ecosystem than a contribution to open-source. I'm not complaining, just calling it what it is. Barely an improvement over the 5-month-old Mistral model, with the same context length of 8k. And this is a release after their announcement of Gemini Pro 1.5, which had an exponential increase in context length.
mistral 7b v0.2 supports 32k
This is a good point actually, and an underappreciated fact.
I think so many people (including me) effectively ignored Mistral 0.1's sliding window that few realized 0.2 instruct is native 32K.
Re: Gemma: New Open Models
#188Earlier quoted context omitted.
Strong disagree - a Mistral fine tune of llama 70b was the top performing llama fine tune. They have lots of data the community simply does not.
Miqu was (allegedly) an internal continued pretrain Mistral did as a test, that was leaked as a GGUF. Maybe its just semantics, it is technically a finetune... But to me theres a big difference between expensive "continuation training" (like Solar 10.7B or Mistral 70B) and a much less intense finetuning. The former is almost like releasing a whole new base model. It would be awesome if Mistral did that with their dat…
There’s typically a difference in LR between a ‘continued pretrain’ and ‘fine tune.’ I don’t have the details around miqu, but was merely trying to say that Mistral could produce a better version of these models than the OSS community might. If the size of the corpora they use means we are no longer in fine tuning territory, then okay.
Re: Gemma: New Open Models
#189I wonder if people will get confused with the naming Gemma, Gemini pro, Gemini advanced, Gemini ultra To a layperson it is not obvious which one is better than the other
I doubt Gemma is targeted for use by a layperson.
Re: Gemma: New Open Models
#190Hello on behalf of the Gemma team! We are really excited to answer any questions you may have about our models. Opinions are our own and not of Google DeepMind.
Will this be available as a Vertex AI foundational model like Gemini 1.0, without deploying a custom endpoint? Any info on pricing? (Also, when will Gemini 1.5 be available on Vertex?)