Google releases Gemma 4 open models

Post by polishdude20 » Thu, Apr 02, 2026, 8:25 PM UTC

chrisweekly wrote: post #221

polishdude20 wrote: post #132

Earlier quoted context omitted.

Hey in really interested in your pipeline techniques. I've got some pdfs I need to get processed but processing them in the cloud with big providers requires redaction. Wondering if a local model or a self hosted one would work just as well.

Disclaimer: I'm an AI novice relative to many here. FWIW last wknd I spent a couple hours setting up self-hosted n8n with ollama and gemma3:4b [EDIT: not Qwen-3.5], using PDF content extraction for my PoC. 100% local workflow, no runtime dependency on cloud providers. I doubt it'd scale very well (macbook air m4, measly 16GB RAM), but it works as intended.

Post by danielhanchen » Thu, Apr 02, 2026, 8:27 PM UTC

egeres wrote: post #222

danielhanchen wrote: post #2

Thinking / reasoning + multimodal + tool calling. We made some quants at https://huggingface.co/collections/unsloth/gemma-4 for folks to run them - they work really well! Guide for those interested: https://unsloth.ai/docs/models/gemma-4 Also note to use temperature = 1.0, top_p = 0.95, top_k = 64 and the EOS is " ". " thought\n" is also used for the thinking trace!

Thank you and your brother for all the amazing work, it's really inspiring to others <3

Post by popinman322 » Thu, Apr 02, 2026, 8:28 PM UTC

Post by jjcm » Thu, Apr 02, 2026, 8:28 PM UTC

chrislattner wrote: post #67

If you want the fastest open source implementation on Blackwell and AMD MI355, check out Modular's MAX nightly. You can pip install it super fast, check it out here: https://www.modular.com/blog/day-zero-launch-fastest-perform... -Chris Lattner (yes, affiliated with Modular :-)

Post by coder543 » Thu, Apr 02, 2026, 8:30 PM UTC

culi wrote: post #169

kpw94 wrote: post #45

Earlier quoted context omitted.

Wild differences in ELO compared to tfa's graph: https://storage.googleapis.com/gdm-deepmind-com-prod-public/... (Comparing Q3.5-27B to G4 26B A4B and G4 31B specifically) I'd assume Q3.5-35B-A3B would performe worse than the Q3.5 deep 27B model, but the cards you pasted above, somehow show that for ELO and TAU2 it's the other way around... Very impressed by unsloth's team releasing the GGUF so quickly, if that's lik…

You're conflating lmarena ELO scores. Qwen actually has a higher ELO there. The top Pareto frontier open models are: model |elo |price qwen3.5-397b-a17b |1449 |$1.85 glm-4.7 |1443 | 1.41 deepseek-v3.2-exp-thinking |1425 | 0.38 deepseek-v3.2 |1424 | 0.35 mimo-v2-flash (non-thinking) |1393 | 0.24 gemma-3-27b-it |1365 | 0.14 gemma-3-12b-it |1341 | 0.11 gpt-oss-20b |1318 | 0.09 gemma-3n-e4b-it |1318 | 0.03 https://arena.…