Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Gemma: New Open Models

blog.google

Post reply on HN
Print view View original

131–140 of 543 posts

Re: Gemma: New Open Models

#131

Post by trisfromgoogle »

artninja1988 wrote: post #46
silentsanctuary wrote: post #30

Earlier quoted context omitted.

Which remarks are you referring to?

The synde remarks at metas llama license that doesn't allow companies with 700 million monthly active users to use it, while this model also doesn't have a really 'open' license itself and also this paragraph: >As the ecosystem evolves, we urge the wider AI community to move beyond simplistic ’open vs. closed’ debates, and avoid either exaggerating or minimising potential harms, as we believe a nuanced, collaborative…

Quick question -- can you tell me where you got that quote? It's not in the main blog or any of the launch communications that I can see.

Re: Gemma: New Open Models

#133

Post by [deleted] »

ta8645 wrote: post #65
kibwen wrote: post #38

Earlier quoted context omitted.

True, though to be fair, when OpenAI embraced "openness" it was also a PR stunt.

My impression is that OpenAI was founded by true believers, with the best intentions; whose hopes were ultimately sidelined in the inexorable crush of business and finance.

[deleted]

Re: Gemma: New Open Models

#134

Post by GaggiX »

espadrine wrote: post #29

I notice a few divergences to common models: - The feedforward hidden size is 16x the d_model, unlike most models which are typically 4x; - The vocabulary size is 10x (256K vs. Mistral’s 32K); - The training token count is tripled (6T vs. Llama2's 2T) Apart from that, it uses the classic transformer variations: MQA, RoPE, RMSNorm. How big was the batch size that it could be trained so fast? https://huggingface.co/mis…

Looking at the config.json of Gemma 7B the feedfoarward hidden size is 8x, not 16x

Re: Gemma: New Open Models

#135

Post by staticman2 »

rvz wrote: post #64

Great! Google is now participating in the AI race to zero with Meta, as predicted that $0 free AI models would eventually catch up against cloud-based ones. You would not want to be in the middle of this as there is no moat around this at all. Not even OpenAI.

If meta keeps spending tens of millions of dollars each year to release free AI models it might seem like there is no moat, but under normal circumstances wouldn't the cost to develop a free model be considered a moat?

Re: Gemma: New Open Models

#136

Post by lordswork »

milliams wrote: post #120

They're really trying hard to avoid saying what kind of "models" these are. I think they're language models, but it's hard to say for sure.

You're right that they don't call them language models. The technical report says:

    Gemma models demonstrate strong performance across
    academic benchmarks for language understanding, 
    reasoning, and safety.
Maybe they are reserving the right to expand Gemma model family to multi-modal models.

Re: Gemma: New Open Models

#137

Post by austinvhuang »

sbarre wrote: post #39
alekandreev wrote: post #3

Hello on behalf of the Gemma team! We are really excited to answer any questions you may have about our models. Opinions are our own and not of Google DeepMind.

Can the Gemma models be downloaded to run locally, like open-source models Llama2, Mistral, etc ? Or is your definition of "open" different?

Yes models can be downloaded locally. In addition to the python NN frameworks and ggml as options, we also implemented a standalone C++ implementation that you can run locally at https://github.com/google/gemma.cpp

Re: Gemma: New Open Models

#139

Post by lordswork »

Kelteseth wrote: post #13

Can this run on my AMD Vega VII on Windows 11? As always, AMD is missing: > Optimization across multiple AI hardware platforms ensures industry-leading performance, including NVIDIA GPUs and Google Cloud TPUs.

AMD Vega VII meets the memory requirements. Once tools like LM Studio, ollama, etc. add support for the model, you should be able to run locally like you would any other open weights model.

Re: Gemma: New Open Models

#140

Post by phillipcarter »

impulser_ wrote: post #27

Go back 5 years and ask anyone on this site what companies do you think will be the most open about AI in the future OpenAI, Meta, or Google. I bet 10/10 people would pick OpenAI. Now today Meta and Google, both trillion dollars companies, are releasing very powerful open models with the ability to be used commercially. Ironic.

I would have picked Google five years ago, since nobody was releasing commercially viable LLMs at the time, and Google was the center of all the research that I knew of.
Post reply on HN