Live data from Hacker News

Gemma 3 Technical Report [pdf]

storage.googleapis.com

131–140 of 260 posts

Re: Gemma 3 Technical Report [pdf]

#131
post #15

> They are designed to help prevent our models from generating harmful content, i.e., > [...] > Sexually explicit content Dear tech companies. Sexually explicit content is not harmful. Why are you all run by puritans? I don't even want to make edgy porn, I just want to be treated like an adult.

usual answer to "why can't I have nice things": lawyers. (on both sides)

Lawyering by puritans, maybe. The lawyers themselves are not particularly imposing their prejudices.

Re: Gemma 3 Technical Report [pdf]

#132

Greetings from the Gemma team! We just got Gemma 3 out of the oven and are super excited to show it to you! Please drop any questions here and we'll answer ASAP. (Opinions our own and not of Google DeepMind.) PS we are hiring: https://boards.greenhouse.io/deepmind/jobs/6590957

What's the official take on the system prompt? The technical report doesn't mention it, but the official QAT GGUFs include some form of prepending it to the first user message. Has it been trained with any system turns with tool calls and such?

Re: Gemma 3 Technical Report [pdf]

#133

> They are designed to help prevent our models from generating harmful content, i.e., > [...] > Sexually explicit content Dear tech companies. Sexually explicit content is not harmful. Why are you all run by puritans? I don't even want to make edgy porn, I just want to be treated like an adult.

Wireheading humanity into population collapse via pervasive sexual hyperstimuli (which is realistically what is on the table here) is basically the definition of "harmful".

This is just silly because it only takes one AI company to defect and start enabling it, and the problem is already pretty bad even without AI.

I think all of the solutions are demand-side, not supply side. I would expect differential reproductive rate trends between populations with and without proscriptions on ersatz reality consumption (i.e. aniconist Muslims, Mennonites, etc.) to accelerate

Re: Gemma 3 Technical Report [pdf]

#134
post #115

Earlier quoted context omitted.

>censored and uncensored Well here you still have the same problem, since they're not gonna release an actually uncensored version, that tells you how to do awful things (or indeed, that tells you to do them). So then you'd have censored and less censored, and it would still be a matter of where to draw those lines.

True, "uncensored" is not the best term for what I meant (as I'm aware that fully uncensored is not a realistic thing to ask from companies). What I mean is a model for all audiences and an adult model, and the line would be drawn at the law of the country producing it (if it's something that would be legal to publish for a human author at a website, then it should be allowed as an LLM response). So erotica would be…

Companies release uncensored models all the time. They're called "text" models. I just had llama3.2:3b-text-fp16 give me step by step instructions on how to make a pipe bomb.

Re: Gemma 3 Technical Report [pdf]

#136

Earlier quoted context omitted.

It's harmful in that there exists a significant and vocal subset of users who does not wish to see that content or does not wish their children to do so. It's easier to teach your model never to produce that kind of content than to teach it to perfectly distinguish whether this user should see that content or not. TV channels are barred from broadcasting this kind of content for similar reasons. Sure, there are alway…

All of this is true but then it's as easy as releasing censored and uncensored versions of the model. Then it's up to users (or parents, in the case of children) to choose the adequate version for each purpose. Just like there are child-friendly movies and adult-only movies, and no one beyond fringe puritan crusaders would say that the latter should outright not exist.

I think it's easy to released the uncensored version, it's just the censored version that's likely super super hard.

Since this is just giving the model directly, there's no ability to do any filtering as part of inference, so I would imagine you have to assume the worst (intent) on any input coming into it.

Re: Gemma 3 Technical Report [pdf]

#138
Quote:

The Gemma 3 models are trained with distillation and achieve superior performance to Gemma 2 for both pre-trained and instruction finetuned versions. In particular, our novel post-training recipe significantly improves the math, chat, instruction-following and multilingual abilities, making Gemma3- 4B-IT competitive with Gemma2-27B-IT and Gemma3-27B-IT comparable to Gemini-1.5-Pro across benchmarks. We release all our models to the community.

Really cool

Re: Gemma 3 Technical Report [pdf]

#139

Greetings from the Gemma team! We just got Gemma 3 out of the oven and are super excited to show it to you! Please drop any questions here and we'll answer ASAP. (Opinions our own and not of Google DeepMind.) PS we are hiring: https://boards.greenhouse.io/deepmind/jobs/6590957

How good is Gemma at structured output generation, JSON schema compliance and tool use? Particularly the smaller versions, particularly in foreign languages? We will run our internal evals on it for sure, but just wanted to ask whether that's even a use case that the team considered and trained for.

Just tried gemma3:4b for structured output and it fails with a strange error ( ollama is the latest):

Ollama error: POST predict: Post "http://127.0.0.1:49675/completion": read tcp 127.0.0.1:49677->127.0.0.1:49675: wsarecv: An existing connection was forcibly closed by the remote host.

Not sure this is Ollama or gemma3:4b problem. At the same time, gemma3:12b works fine for the same API request (100% identical, only difference is model id).

Re: Gemma 3 Technical Report [pdf]

#140
post #129

Earlier quoted context omitted.

Porn sites are blocked in many jurisdictions, so I would not use that argument.

No, there's no movement to shut down pornography on the internet. There's a movement to shut down specific websites and make a lot of noise about it but continue consuming pornography behind closed doors. People like pornography. They'll as soon ban alcohol again (which worked so well last time)

On the contrary. Porn is inaccessible, along with many other things, in much of the world. https://worldpopulationreview.com/country-rankings/countries...

Alcohol is another good example.

Post reply on HN