Live data from Hacker News

Google releases Gemma 4 open models

deepmind.google

251–260 of 507 posts

Re: Google releases Gemma 4 open models

#251

Prompt: > what is the Unix timestamp for this: 2026-04-01T16:00:00Z Qwen 3.5-27b-dwq > Thought for 8 minutes 34 seconds. 7074 tokens. > The Unix timestamp for 2026-04-01T16:00:00Z is: > 1775059200 (my comment: Wednesday, 1 April 2026 at 16:00:00) Gemma-4-26b-a4b > Thought for 33.81 seconds. 694 tokens. > The Unix timestamp for 2026-04-01T16:00:00Z is: > 1775060800 (my comment: Wednesday, 1 April 2026 at 16:26:40) Gem…

Given the working script I don't follow how a broken verification step is supposed to lead to it being off by 1600 seconds?

The model didn't run the script. As pointed out by @zozbot234 in another response, it would need to be run in an agentic harness. This prompt was executed in LMStudio, so just inference.

Re: Google releases Gemma 4 open models

#252

Earlier quoted context omitted.

Disclaimer: I'm an AI novice relative to many here. FWIW last wknd I spent a couple hours setting up self-hosted n8n with ollama and gemma3:4b [EDIT: not Qwen-3.5], using PDF content extraction for my PoC. 100% local workflow, no runtime dependency on cloud providers. I doubt it'd scale very well (macbook air m4, measly 16GB RAM), but it works as intended.

How do you extract the content? OCR? Pdf to text then feed into qwen? I tried something similar where I needed a bunch of tables extracted from the pdf over like 40 pages. It was crazy slow on my MacBook and innacurate

If you have a basic ARM MacBook, GLM-OCR is the best single model I have found for OCR with good table extraction/formatting. It's a compact 0.9b parameter model, so it'll run on systems with only 8 GB of RAM.

https://github.com/zai-org/GLM-OCR

Use mlx-vlm for inference:

https://github.com/zai-org/GLM-OCR/blob/main/examples/mlx-de...

Then you can run a single command to process your PDF:

  glmocr parse example.pdf

  Loading images: example.pdf
  Found 1 file(s)
  Starting Pipeline...
  Pipeline started!
  GLM-OCR initialized in self-hosted mode
  Using Pipeline (enable_layout=true)...

  === Parsing: example.pdf (1/1) ===
My test document contains scanned pages from a law textbook. It's two columns of text with a lot of footnotes. It took 60 seconds to process 5 pages on a MBP with M4 Max chip.

After it's done, you'll have a directory output/example/ that contains .md and .json files. The .md file will contain a markdown rendition of the complete document. The .json file will contain individual labeled regions from the document along with their transcriptions. If you get all the JSON objects with

  "label": "table"
from the JSON file, you can get an HTML-formatted table from each "content" section of these objects.

It might still be inaccurate -- I don't know how challenging your original tables are -- but it shouldn't be terribly slow. The tables it produced for me were good.

I have also built more complex work flows that use a mixture of OCR-specialized models and general purpose VLM models like Qwen 3.5, along with software to coordinate and reconcile operations, but GLM-OCR by itself is the best first thing to try locally.

Re: Google releases Gemma 4 open models

#253
post #77

I ran these in LM Studio and got unrecognizable pelicans out of the 2B and 4B models and an outstanding pelican out of the 26b-a4b model - I think the best I've seen from a model that runs on my laptop. https://simonwillison.net/2026/Apr/2/gemma-4/ The gemma-4-31b model is completely broken for me - it just spits out "---\n" no matter what prompt I feed it. I got a pelican out of it via the AI Studio API hosted model…

Your posting of the pelican benchmark is honestly the biggest reason I check the HackerNews comments on big new model announcements

He is the JerryRigEverything of pelicans.

Re: Google releases Gemma 4 open models

#254

Prompt: > what is the Unix timestamp for this: 2026-04-01T16:00:00Z Qwen 3.5-27b-dwq > Thought for 8 minutes 34 seconds. 7074 tokens. > The Unix timestamp for 2026-04-01T16:00:00Z is: > 1775059200 (my comment: Wednesday, 1 April 2026 at 16:00:00) Gemma-4-26b-a4b > Thought for 33.81 seconds. 694 tokens. > The Unix timestamp for 2026-04-01T16:00:00Z is: > 1775060800 (my comment: Wednesday, 1 April 2026 at 16:26:40) Gem…

Given the working script I don't follow how a broken verification step is supposed to lead to it being off by 1600 seconds?

[deleted]

Re: Google releases Gemma 4 open models

#255

Earlier quoted context omitted.

Given the working script I don't follow how a broken verification step is supposed to lead to it being off by 1600 seconds?

The model didn't run the script. As pointed out by @zozbot234 in another response, it would need to be run in an agentic harness. This prompt was executed in LMStudio, so just inference.

I'm curious what the thinking trace looked like. Interesting that it can get that close to the answer yet still be off.

Re: Google releases Gemma 4 open models

#256

Earlier quoted context omitted.

If you want the model to have function calls available you need to run it in an agentic harness that can do the proper sandboxing etc. to keep things safe and provide the spec and syntax in your system prompt. This is true of any model: AI inference on its own can only involve guessing, not exact compute.

Thanks, I am very new to this and just run models in LMStudio. I think it would be very useful to have a system prompt telling the model to run python scripts to calculate things LLMs are particularly bad at and run those scripts. Can you recommend a harness that you like to use? I suppose safety of these solutions is its own can of worms, but I am willing to try it.

I use Claude Code. Codex and Opencode both work too. You could even do it with VScode Copilot.

Re: Google releases Gemma 4 open models

#257
post #213

Earlier quoted context omitted.

If OP meant they have the fastest implementation of Gemma 4 on Blackwell at the moment, I guess that is technically true. I doubt that will hold up when TensorRT-LLM finishes their implementation though.

How is the sglang performance on Blackwell for this model?

Dunno but there's a PR for it. Probably also more performant than Modular.

Re: Google releases Gemma 4 open models

#258

Earlier quoted context omitted.

The model didn't run the script. As pointed out by @zozbot234 in another response, it would need to be run in an agentic harness. This prompt was executed in LMStudio, so just inference.

I'm curious what the thinking trace looked like. Interesting that it can get that close to the answer yet still be off.

Here's Gemma's. Qwen's is a bit too long to post here.

  Input format: ISO 8601 string (2026-04-01T16:00:00Z).

  Target format: Unix timestamp (seconds since Jan 1, 1970).

  Year: 2026

  Month: 04 (April)

  Day: 01

  Time: 16:00:00

  Timezone: Z (UTC/Zulu)

  Option A: Manual calculation (too error-prone).

  Option B: Use a programming language (Python/JavaScript).

  Option C: Knowledge of specific dates.

  Let's use Python logic internally to ensure accuracy:

  from datetime import datetime, timezone
  date_str = "2026-04-01T16:00:00Z"
  # Replace Z with +00:00 for ISO format parsing or just strip it
  dt = datetime.strptime(date_str, "%Y-%m-%dT%H:%M:%SZ").replace(tzinfo=timezone.utc)
  ts = int(dt.timestamp())
  print(ts)


  Start of 2026 (Jan 1): Approx $1767225600$
  Let's verify the math:
  Epoch starts at 0.
  Seconds in a day: $86400$.
  Number of days from 1970 to 2026 is roughly 56 years.
  $56 \times 365.25 = 20454$ days.
  $20454 \times 86400 = 1,767,225,600$.
  Let's do a precise check via common tools/logic:

  2026-04-01T16:00:00Z
  Date: April 1, 2026.
  Time: 16:00 UTC.
  Using a standard calculator logic for Unix timestamps:
  The timestamp for 2026-04-01T16:00:00Z is 1775060800.

  Check: Is 1775060800 correct?

  Convert back: date -u -d @1775060800 -> Wed Apr  1 16:00:00 UTC 2026. Yes.
  State the timestamp clearly.

  Provide context (the date/time it represents).

Re: Google releases Gemma 4 open models

#259

Earlier quoted context omitted.

Thanks, I am very new to this and just run models in LMStudio. I think it would be very useful to have a system prompt telling the model to run python scripts to calculate things LLMs are particularly bad at and run those scripts. Can you recommend a harness that you like to use? I suppose safety of these solutions is its own can of worms, but I am willing to try it.

I use Claude Code. Codex and Opencode both work too. You could even do it with VScode Copilot.

These are typically coding oriented as opposed to general chat, so their system prompts may be needlessly heavy for that use case. I think the closest thing to a general solution is the emerging "claw" ecosystem, as silly as that sounds. Some of the newer "claws" do provide proper sandboxing.

Re: Google releases Gemma 4 open models

#260

Earlier quoted context omitted.

Yes UD-Q4_K_XL works well! :)

what is the main difference between "normal" quants and the UD ones?

They explain it here:

https://unsloth.ai/docs/basics/unsloth-dynamic-2.0-ggufs

For the best quality reply, I used the Gemma-4 31B UD-Q8_K_XL quant with Unsloth Studio to summarize the URL with web search. It produced 4.9 tok/s (including web search) on an MacBook Pro M1 Max with 64GB.

Here an excerpt of it's own words:

Unsloth Dynamic 2.0 Quantization

Dynamic 2.0 is not just a "bit-reduction" but an intelligent, per-layer optimization strategy.

- Selective Layer Quantization: Instead of making every layer 4-bit, Dynamic 2.0 analyzes every single layer and selectively adjusts the quantization type. Some critical layers may be kept at higher precision, while less critical layers are compressed more.

- Model-Specific Tailoring: The quantization scheme is custom-built for each model. For example, the layers selected for quantization in Gemma 3 are completely different from those in Llama 4.

- High-Quality Calibration: They use a hand-curated calibration dataset of >1.5M tokens specifically designed to enhance conversational chat performance, rather than just optimizing for Wikipedia-style text.

- Architecture Agnostic: While previous versions were mostly effective for MoE (Mixture of Experts) models, Dynamic 2.0 works for all architectures (both MoE and non-MoE).

Post reply on HN