Gemma 3 Technical Report [pdf]

Post by bigdict » Thu, Mar 13, 2025, 2:38 AM UTC

setgree wrote: post #203

meetpateltech wrote: post #2

Gemma 3 is out! Multimodal (image + text), 128K context, supports 140+ languages, and comes in 1B, 4B, 12B, and 27B sizes with open weights & commercial use. Gemma 3 model overview: https://ai.google.dev/gemma/docs/core Huggingface collection: https://huggingface.co/collections/google/gemma-3-release-67... ollama: https://ollama.com/library/gemma3

A kind of ancillary note, but it's amazing to me how fragmented this presentation and documentation is: * the parent link is to storage.googleapis.com * There's documentation on ai.google.dev * The announcement blogpost is https://blog.google/technology/developers/gemma-3/ * you try it on https://aistudio.google.com/ It's helpful to have a top-level post like this, but can some PM please consolidate this into, IDK, a…

Post by PKop » Thu, Mar 13, 2025, 3:42 AM UTC

andai wrote: post #114

miki123211 wrote: post #70

Earlier quoted context omitted.

It's harmful in that there exists a significant and vocal subset of users who does not wish to see that content or does not wish their children to do so. It's easier to teach your model never to produce that kind of content than to teach it to perfectly distinguish whether this user should see that content or not. TV channels are barred from broadcasting this kind of content for similar reasons. Sure, there are alway…

I heard of this described as the minority effect, that a small minority can have a disproportionate impact. The example given is that it's cheaper to make all instances of a product kosher or halal than to make an entirely separate product.

Post by matteocontrini » Thu, Mar 13, 2025, 9:27 AM UTC

setgree wrote: post #203

meetpateltech wrote: post #2

Gemma 3 is out! Multimodal (image + text), 128K context, supports 140+ languages, and comes in 1B, 4B, 12B, and 27B sizes with open weights & commercial use. Gemma 3 model overview: https://ai.google.dev/gemma/docs/core Huggingface collection: https://huggingface.co/collections/google/gemma-3-release-67... ollama: https://ollama.com/library/gemma3

A kind of ancillary note, but it's amazing to me how fragmented this presentation and documentation is: * the parent link is to storage.googleapis.com * There's documentation on ai.google.dev * The announcement blogpost is https://blog.google/technology/developers/gemma-3/ * you try it on https://aistudio.google.com/ It's helpful to have a top-level post like this, but can some PM please consolidate this into, IDK, a…

Post by genewitch » Thu, Mar 13, 2025, 11:01 AM UTC

LeoPanthera wrote: post #20

meetpateltech wrote: post #2

Gemma 3 is out! Multimodal (image + text), 128K context, supports 140+ languages, and comes in 1B, 4B, 12B, and 27B sizes with open weights & commercial use. Gemma 3 model overview: https://ai.google.dev/gemma/docs/core Huggingface collection: https://huggingface.co/collections/google/gemma-3-release-67... ollama: https://ollama.com/library/gemma3

Doesn't yet work in LM Studio. Barfs an error when trying to load the model. (Error 6, whatever that means. Happy I missed the first 5.)

Post by mtrovo » Thu, Mar 13, 2025, 12:00 PM UTC

jhayward wrote: post #225

klysm wrote: post #208

Earlier quoted context omitted.

I don't see how this actually matters - who cares if it it's different top level domains?

Two reasons it matters: 1) Discoverability 2) "System structure mirrors organization". I.E., it's an indicator of a fragmented and disorganized structure that's not likely to produce cohesive product results.