Live data from Hacker News

Gemma 4 12B: A unified, encoder-free multimodal model

blog.google

41–50 of 421 posts

Re: Gemma 4 12B: A unified, encoder-free multimodal model

#41

What's Google's business case for releasing open models? Don't get me wrong, I am grateful and appreciative of these releases. I'm trying to understand how it fits into their bigger picture as a for profit company? Are they not helping competitors build on the novel technology they have developed? Is it simply goodwill and/or marketing? Or am I missing something strategic?

My guess is testing for Apple’s Siri replacement and partnership but that’s a total SWAG

Re: Gemma 4 12B: A unified, encoder-free multimodal model

#43

The big story here is the encoder-free part, which I still don't fully understand. > Vision: We replaced Gemma 4’s vision encoder with a lightweight embedding module consisting of a single matrix multiplication, positional embedding and normalizations. That's technically encoding, just without using a dedicated model for it like SigLIP? The Developer's Guide elaborates, it's still a 35M layer which I am curious is ro…

One side-effect, is that the separate .mmproj file (Multi-Modal Projection encoder) is no longer needed, when using the model with llama.cpp etc.

Re: Gemma 4 12B: A unified, encoder-free multimodal model

#44
post #32

Is this Mac only? Or is that an Ollama issue that it only supports this release of models on Mac? It seems like every tag with the MLX badge is only supported on Mac[0], and that includes all of the tags in this release. [0] https://ollama.com/library/gemma4/tags Edit: MLX being Mac-only is independent of the model being MLX (and therefore Mac) only. The latter is what I am asking about.

MLX is Apple’s own machine learning framework, designed for Apple Silicon: https://opensource.apple.com/projects/mlx/

Re: Gemma 4 12B: A unified, encoder-free multimodal model

#45

What's Google's business case for releasing open models? Don't get me wrong, I am grateful and appreciative of these releases. I'm trying to understand how it fits into their bigger picture as a for profit company? Are they not helping competitors build on the novel technology they have developed? Is it simply goodwill and/or marketing? Or am I missing something strategic?

Google is one of the few verticalized options in AI: Data, models, cloud services, low-level silicon (TPUs), internal use cases, retail use cases, B2B uses, distribution (browser & mobile), etc.

They rise with the tide of AI adoption. But they gain ground if people opt into Google solutions. And any token sent to a Google model (free or paid) actively punishes their competitors that are then required to spend vast sums to remain bleeding edge.

Re: Gemma 4 12B: A unified, encoder-free multimodal model

#46

Earlier quoted context omitted.

Totally agree that it is "encoding" in the general sense, but I think they are referring to the lack of an "encoder" neural network.

In hindsight I may have been pedantic.

I had a similar thought to you, and found your question and the resulting discussion helpful!

Re: Gemma 4 12B: A unified, encoder-free multimodal model

#47
post #31

What's Google's business case for releasing open models? Don't get me wrong, I am grateful and appreciative of these releases. I'm trying to understand how it fits into their bigger picture as a for profit company? Are they not helping competitors build on the novel technology they have developed? Is it simply goodwill and/or marketing? Or am I missing something strategic?

Android and Chrome need on-device AI capabilities. Google can't lock down those weights like it can with server-side ML. So it's easier to just release those models as open source and make it official, since someone would inevitably hack the weights out anyway.

Could say the same for camera processing in the Pixel Camera app or any other binary someone wants to re-use that comes included in a software distribution (seemingly for 'free'). They can't lock the instructions up on the server so they might as well make the binary be freely distributable?

Companies don't commonly give away executable binaries "just because", why'd they start now for these binary blobs that are the models?

Not that I'm unhappy about it! Yay for open data any day, I'm just not understanding why, at least beyond PR in nerd circles

Re: Gemma 4 12B: A unified, encoder-free multimodal model

#48

What's Google's business case for releasing open models? Don't get me wrong, I am grateful and appreciative of these releases. I'm trying to understand how it fits into their bigger picture as a for profit company? Are they not helping competitors build on the novel technology they have developed? Is it simply goodwill and/or marketing? Or am I missing something strategic?

Google's MO since always has been to release great products or services for free, position themselves high and then abandon them or just find uses for Enterprise sales. I'm pretty sure they are doing it because they get some research experience by shrinking and improving these models, and because they know that by doing this they get some good PR among the dev community.

Google's "free" is and was ad-supported, even if some products now have a paid tier. These models don't include ads. Doesn't seem like the same underlying reason

Re: Gemma 4 12B: A unified, encoder-free multimodal model

#49

Earlier quoted context omitted.

Totally agree that it is "encoding" in the general sense, but I think they are referring to the lack of an "encoder" neural network.

In hindsight I may have been pedantic.

Not at all. Getting really pedantic, tokenization is also a form of encoding, so it doesn't matter the modality you're using, you'll end up doing some type of encoding in some way.
Post reply on HN