Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Mistral's Shieldstral: 3B open-weights model for multimodal moderation

mistral.ai

Post reply on HN
Print view View original

11–20 of 154 posts

Re: Mistral's Shieldstral: 3B open-weights model for multimodal moderation

#11

Post by lava_pidgeon »

petcat wrote: post #10
mosura wrote: post #8

Someone should use this to do the exact opposite of the intention: filter for “offensive” content, and boost it or collate it into a newsletter/email blast for people of culture. You have to give it to Mistral they do at least know what the market near them says they want right now. The great problem is in a few years of this that market won’t be worth anything. Edit to add, you could also add this to an AI workflow…

> they do at least know what the market near them says they want right now It does seem to be a very European approach to AI that their flagship AI lab is just making models that do nothing other than monitor and moderate internet content. I guess they know that the EU AI Act, Chat Control, etc are going to cause a lot of companies to need this kind of compliance.

Some of the best social media is heavily moderate. This includes HN and r/credible defense . With a Quiet transparent and cheap LLM I imagine a social media website where you can have good discussion about everything around the world it would be a game changer and on my to-do list.

Re: Mistral's Shieldstral: 3B open-weights model for multimodal moderation

#12

Post by petcat »

lava_pidgeon wrote: post #11
petcat wrote: post #10

Earlier quoted context omitted.

> they do at least know what the market near them says they want right now It does seem to be a very European approach to AI that their flagship AI lab is just making models that do nothing other than monitor and moderate internet content. I guess they know that the EU AI Act, Chat Control, etc are going to cause a lot of companies to need this kind of compliance.

Some of the best social media is heavily moderate. This includes HN and r/credible defense . With a Quiet transparent and cheap LLM I imagine a social media website where you can have good discussion about everything around the world it would be a game changer and on my to-do list.

> Some of the best social media is heavily moderate

Heavily moderated by humans with discretion.

Not AI chat bots following a rules engine.

Re: Mistral's Shieldstral: 3B open-weights model for multimodal moderation

#13

Post by simlevesque »

petcat wrote: post #4

Mistral needs to abandon their Everything-stral branding. Getting kind of lame. "Shieldstral" is an awkward and bad name

People complain when a product use a familiar name that might collide and there's also people complaining when they invent new words altogether.

Naming things is hard.

Re: Mistral's Shieldstral: 3B open-weights model for multimodal moderation

#15

Post by hypfer »

I would be curious if this can do moderation with an arbitrary ruleset, or if it's just "that one moderation style" we already know from current big tech platforms.

The kind where malicious intent is okay if the words are nice.

___

Or, rephrased: How big is the space in which you can tune this model without retraining.

Is it just "we hate sex"/"we don't hate sex" "We hate violence"/"we don't hate violence" or is it _truly_ as flexible as claimed?

__

Maybe something like "Is this guy a corporate fraud that is going to waste my time with performative nonsense?"

That would be the true test for a moderation model and I would be immensely impressed if it could manage to pull that off.

___

Edit: Looking at the paper though.. probably not.

I suppose this is useful for B2B, which seems to be mistrals whole thing. Question is just if it is also useful for society to hand the SV prefab morals down like that. Kinda like cultural imperialism but with an ethical spin.

Maybe opinions on those base datasets could occasionally differ more than the model can be steered.

Re: Mistral's Shieldstral: 3B open-weights model for multimodal moderation

#16

Post by yborg »

BlackRabbit1 wrote: post #6
lenerdenator wrote: post #3

I'd really like to see more conversation around Mistral's models. It's good to see Europe developing AI.

The problem is that their performance is too far away from the latest generation of Asian models. They had kept up in the mid-range a few years ago. But this standing is sadly long gone. If you need a fast Opensource'ed LLMs you can go for EU-hosted DeepSeek or Qwen.

By this logic the Chinese should have just given up and let the American AI companies have the market because they were so far behind. I'm sure Europe has the capability to distill other people's frontier models to catch up if they wish to do so.

Re: Mistral's Shieldstral: 3B open-weights model for multimodal moderation

#17

Post by winwang »

petcat wrote: post #12
lava_pidgeon wrote: post #11

Earlier quoted context omitted.

Some of the best social media is heavily moderate. This includes HN and r/credible defense . With a Quiet transparent and cheap LLM I imagine a social media website where you can have good discussion about everything around the world it would be a game changer and on my to-do list.

> Some of the best social media is heavily moderate Heavily moderated by humans with discretion. Not AI chat bots following a rules engine.

Wouldn't discretion "just" be a really good rules engine?

Re: Mistral's Shieldstral: 3B open-weights model for multimodal moderation

#19

Post by colechristensen »

petcat wrote: post #12
lava_pidgeon wrote: post #11

Earlier quoted context omitted.

Some of the best social media is heavily moderate. This includes HN and r/credible defense . With a Quiet transparent and cheap LLM I imagine a social media website where you can have good discussion about everything around the world it would be a game changer and on my to-do list.

> Some of the best social media is heavily moderate Heavily moderated by humans with discretion. Not AI chat bots following a rules engine.

The bulk of moderation work is things which are easy and obvious.

The correct way to moderate is automation with certainty falling back to humans with discretion.

The new frontier of moderation should be blocking illiterate comments, as in the commenter is replying as though they didn't read or read and didn't understand.

Re: Mistral's Shieldstral: 3B open-weights model for multimodal moderation

#20

Post by baq »

petcat wrote: post #12
lava_pidgeon wrote: post #11

Earlier quoted context omitted.

Some of the best social media is heavily moderate. This includes HN and r/credible defense . With a Quiet transparent and cheap LLM I imagine a social media website where you can have good discussion about everything around the world it would be a game changer and on my to-do list.

> Some of the best social media is heavily moderate Heavily moderated by humans with discretion. Not AI chat bots following a rules engine.

> Heavily moderated by humans with discretion.

Pretty sure both of the above have extensive automation in their moderation.

Post reply on HN