Live data from Hacker News

Gemma 3 Technical Report [pdf]

storage.googleapis.com

51–60 of 260 posts

Re: Gemma 3 Technical Report [pdf]

#51

> They are designed to help prevent our models from generating harmful content, i.e., > [...] > Sexually explicit content Dear tech companies. Sexually explicit content is not harmful. Why are you all run by puritans? I don't even want to make edgy porn, I just want to be treated like an adult.

on the other hand running with guns is fine.

Re: Gemma 3 Technical Report [pdf]

#52

> They are designed to help prevent our models from generating harmful content, i.e., > [...] > Sexually explicit content Dear tech companies. Sexually explicit content is not harmful. Why are you all run by puritans? I don't even want to make edgy porn, I just want to be treated like an adult.

[flagged]

The transformer algorithm was originally intended for AI language translation use-cases, and it excels at this task. It's far better than anything else I've tried.

Except that nearly 100% of the capable models out there refuse to translate swearing, sexual, or violent content.

Legal content! Content you can see in the cinema, borrow from a library, or watch on free-to-air television!

Most models will regularly refuse to translate subtitles, for example, because they've been indoctrinated by Puritan priests to put their fingers in their digital ears and scream la-la-la-la to avoid their pure digital souls from being sullied by the bad words.

Re: Gemma 3 Technical Report [pdf]

#53

Earlier quoted context omitted.

The model is open weight, I'll bet someone or the other will abliterate it soon. Maybe you want to do the honors? I have an abliterated Llama running on a server shared with friends and it works great.

This only works until it doesn't. Start with a model that simply hasn't been trained on anything your shareholders find objectionable, and there will be nothing to reveal with abliteration.

Maybe there exists a dataset consisting entirely of objectionable content, so people can finetune neutered models on it?

Re: Gemma 3 Technical Report [pdf]

#54

Greetings from the Gemma team! We just got Gemma 3 out of the oven and are super excited to show it to you! Please drop any questions here and we'll answer ASAP. (Opinions our own and not of Google DeepMind.) PS we are hiring: https://boards.greenhouse.io/deepmind/jobs/6590957

Thanks, been using Gemma 2 a lot at home as it still holds up very well and the 9B version runs great on my 2080Ti. Strong prompt adherence coupled with overall capability makes it very useful. Looking forward to trying Gemma 3.

I have some dumb questions though, might as well ask. How do you decide on the model sizes? And how do you train them? Independently or are they related somehow?

Re: Gemma 3 Technical Report [pdf]

#56

Earlier quoted context omitted.

The model is open weight, I'll bet someone or the other will abliterate it soon. Maybe you want to do the honors? I have an abliterated Llama running on a server shared with friends and it works great.

This only works until it doesn't. Start with a model that simply hasn't been trained on anything your shareholders find objectionable, and there will be nothing to reveal with abliteration.

Such models would actually run against their long term interests of being able to automate away the work currently done by humans.

Re: Gemma 3 Technical Report [pdf]

#57

> They are designed to help prevent our models from generating harmful content, i.e., > [...] > Sexually explicit content Dear tech companies. Sexually explicit content is not harmful. Why are you all run by puritans? I don't even want to make edgy porn, I just want to be treated like an adult.

Have you considered that selection of material contributes to specialization and efficiency? This is meant to be a weights-small model.

Re: Gemma 3 Technical Report [pdf]

#58
post #53

Earlier quoted context omitted.

This only works until it doesn't. Start with a model that simply hasn't been trained on anything your shareholders find objectionable, and there will be nothing to reveal with abliteration.

Maybe there exists a dataset consisting entirely of objectionable content, so people can finetune neutered models on it?

PH maybe?

Re: Gemma 3 Technical Report [pdf]

#59
post #37

What do companies like Meta and Google gain from releasing open models? Is it just reputational? Attractive to top AI talent?

I believe (and some other people on the internet having more knowledge in LLM believe too) that open source local models are the future. Probably big models with API and chat like OpenAI is doing will have its niche toot but it is very costly and it is not AGI and it will not be in the near future. On the other hand with rise of NPU chips and small models you can have your own assistant on your phone using your own data almost instaneously with almost no cost. Whoever will build the best OS model will win this race. As the winner you will be able to set the standard. Basically it is why we have Linux on the severs not Windows and why even browsers are free you still get one from every tech giant.

Re: Gemma 3 Technical Report [pdf]

#60

> They are designed to help prevent our models from generating harmful content, i.e., > [...] > Sexually explicit content Dear tech companies. Sexually explicit content is not harmful. Why are you all run by puritans? I don't even want to make edgy porn, I just want to be treated like an adult.

Everyone is treating this like corps have anything to gain from an open uncensored model. Switch your view and give me a single argument for it? That random nerds on HN stop jerking each other about what „open“ means? You are just not their target group. Having this discussion every time no matter if the model released is censored or not is just insanity. Bring new arguments or don’t use the models you don’t like. There will be a new sota „tomorrow“, maybe even one open enough for you.
Post reply on HN