Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Mistral's Shieldstral: 3B open-weights model for multimodal moderation

mistral.ai

Post reply on HN
Print view View original

41–50 of 154 posts

Re: Mistral's Shieldstral: 3B open-weights model for multimodal moderation

#41

Post by kergonath »

baq wrote: post #31
LunaSea wrote: post #26

Earlier quoted context omitted.

US judges have already rules that output of an LLM can't be copyrighted so not sure what would prevent Chinese companies to use said output for distillation purposes.

Note I didn't mention copyright

By which other mechanism could American AI companies prevent this? Other companies don’t really care about EULAs and even if they needed to care it’s trivial to let third parties do it. Why would they? Almost nobody in the space cares about copyright and play fast and loose with laws and regulations.

What’s the mechanism that could today prevent other companies from using LLM outputs to train their models?

Re: Mistral's Shieldstral: 3B open-weights model for multimodal moderation

#42

Post by pwython »

kergonath wrote: post #36
pwython wrote: post #34

I've had dreams of building something in the image sharing or social platform realm, but stopped short of planning because of obvious content moderation responsibilities. This seems to be a realistic, cost effective solution to that one piece of the puzzle.

I am not sure how reliable it is in the real world. Also, in terms of liability, I don’t know how effective it would be to satisfy various regulations compared to a human moderator team.

I hear ya, but one could set different operating thresholds: auto-approve low-risk posts, hold ambiguous posts for review, and automatically reject very high-confidence violations. So HITL for sure, but MUCH less H in the L.

Re: Mistral's Shieldstral: 3B open-weights model for multimodal moderation

#43

Post by cyanydeez »

mosura wrote: post #8

Someone should use this to do the exact opposite of the intention: filter for “offensive” content, and boost it or collate it into a newsletter/email blast for people of culture. You have to give it to Mistral they do at least know what the market near them says they want right now. The great problem is in a few years of this that market won’t be worth anything. Edit to add, you could also add this to an AI workflow…

[flagged]

Re: Mistral's Shieldstral: 3B open-weights model for multimodal moderation

#44

Post by gspr »

petcat wrote: post #10
mosura wrote: post #8

Someone should use this to do the exact opposite of the intention: filter for “offensive” content, and boost it or collate it into a newsletter/email blast for people of culture. You have to give it to Mistral they do at least know what the market near them says they want right now. The great problem is in a few years of this that market won’t be worth anything. Edit to add, you could also add this to an AI workflow…

> they do at least know what the market near them says they want right now It does seem to be a very European approach to AI that their flagship AI lab is just making models that do nothing other than monitor and moderate internet content. I guess they know that the EU AI Act, Chat Control, etc are going to cause a lot of companies to need this kind of compliance.

Ugh. There's nothing inherently European about Chat Control. It's a dumb proposal, and it's European. Any free society has a bunch of dumb proposals.

Nor is there anything inherently European about the AI Act. But that one I wouldn't even call dumb. At times misguided and confused, perhaps, but some of its core principles are valuable.

Re: Mistral's Shieldstral: 3B open-weights model for multimodal moderation

#45

Post by cyanregiment »

lenerdenator wrote: post #3

I'd really like to see more conversation around Mistral's models. It's good to see Europe developing AI.

I'm from nor cal but always liked Mistral.

Mistral 7b is still one of the best free/open models you can run locally on a MacBook. So fast too.

Re: Mistral's Shieldstral: 3B open-weights model for multimodal moderation

#46

Post by maelito »

himata4113 wrote: post #28
fastball wrote: post #7

Should've called it Safestral. Also I do like Mistral's seemingly newer strategy of focusing on smaller, more fine-tuned models for various use-cases, presumably the result of their large MoE models not competing effectively with the frontier models.

It's not that their strategy is to train smaller models, it's the only choice they have. Training SOTA takes anywhere from 1.5b to 150b. We don't know the real cost of training for the chinese models, but mistral neither has the compute nor money to do that.

Do you have a reference explaining these costs ? Part by part.

Re: Mistral's Shieldstral: 3B open-weights model for multimodal moderation

#48

Post by bee_rider »

petcat wrote: post #4

Mistral needs to abandon their Everything-stral branding. Getting kind of lame. "Shieldstral" is an awkward and bad name

Their web chat UI seems to be called “Vibe.” I think? I’m not sure if that’s the name of the product or just what they decided to label it in the browser. I wonder if -strap is just what they call the actual models, which are meant to be run “under the hood” anyway, so not really part of the branding.

But I wish they could commit to the bit fully and call everything -stral. It’s quirky and self aware to give your products silly names.

Re: Mistral's Shieldstral: 3B open-weights model for multimodal moderation

#50

Post by [deleted] »

kergonath wrote: post #36
pwython wrote: post #34

I've had dreams of building something in the image sharing or social platform realm, but stopped short of planning because of obvious content moderation responsibilities. This seems to be a realistic, cost effective solution to that one piece of the puzzle.

I am not sure how reliable it is in the real world. Also, in terms of liability, I don’t know how effective it would be to satisfy various regulations compared to a human moderator team.

[deleted]
Post reply on HN