Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Mistral ships Le Chat – enterprise AI assistant that can run on prem

mistral.ai

Post reply on HN
Print view View original

21–30 of 166 posts

Re: Mistral ships Le Chat – enterprise AI assistant that can run on prem

#21

Post by fhd2 »

distances wrote: post #18
kergonath wrote: post #7

Earlier quoted context omitted.

> I think this is a game changer, because data privacy is a legitimate concern for many enterprise users. Indeed. At work, we are experimenting with this. Using a cloud platform is a non-starter for data confidentiality reasons. On-premise is the way to go. Also, they’re not American, which helps. > Btw, you can also run Mistral locally within the Docker model runner on a Mac. True, but you can do that only with thei…

I also kind of don't understand how it seems everyone is using AI for coding. I haven't had a client yet which would have approved any external AI usage. So I basically use them as search engines on steroids, but code can't go directly in or out.

You might be able to get your clients to sign something to allow usage, but if you don't, as you say, it doesn't seem wise to vibe code for them. For two reasons:

1. A typical contract transfers the rights to the work. The ownership of AI generated code is legally a wee bit disputed. If you modify and refactor generated code heavily it's probably fine, but if you just accept AI generated code en masse, making your client think that you wrote it and it is therefore their copyright, that seems dangerous.

2. A typical contract or NDA also contains non disclosure, i.e. you can't share confidential information, e.g. code (including code you _just_ wrote, due to #1) with external parties or the general public willy nilly. Whether any terms of service assurances from OpenAI or Anthropic that your model inputs and outputs will probably not be used for training are legally sufficient, I have doubts.

IANAL, and _perhaps_ I'm wrong about one or both of these, in one or more countries, but by and large I'd say the risk is not worth the benefit.

I mostly use third party LLMs like I would StackOverflow: Don't post company code there verbatim, make an isolated example. And also don't paste from SO verbatim. I tried other ways of using LLMs for programming a few times in personal projects and can't say I worry about lower productivity with these limitations. YMMV.

(All this also generally goes for employees with typical employment contracts: It's probably a contract violation.)

Re: Mistral ships Le Chat – enterprise AI assistant that can run on prem

#22

Post by binsquare »

_pdp_ wrote: post #10

While I am rooting for Mistral, having access to a diverse set of models is the killer app IMHO. Sometimes you want to code. Sometimes you want to write. Not all models are made equal.

Well that sounds right up the alley of what I built here: www.labophase.com

Re: Mistral ships Le Chat – enterprise AI assistant that can run on prem

#23

Post by dismalaf »

resource_waste wrote: post #20
byefruit wrote: post #17

Earlier quoted context omitted.

You are probably getting downvoted because you don't give any model generations or versions ('ChatGPT') which makes this not very credible.

[flagged]

In your first comment you mentioned you used Mistral because of its permissive license (so guessing you used 7B, right?). Then you compare it to a bunch of cutting edge proprietary models.

Have you tried Mistral's newest and proprietary models? Or even their newest open model?

Re: Mistral ships Le Chat – enterprise AI assistant that can run on prem

#24

Post by trollbridge »

distances wrote: post #18
kergonath wrote: post #7

Earlier quoted context omitted.

> I think this is a game changer, because data privacy is a legitimate concern for many enterprise users. Indeed. At work, we are experimenting with this. Using a cloud platform is a non-starter for data confidentiality reasons. On-premise is the way to go. Also, they’re not American, which helps. > Btw, you can also run Mistral locally within the Docker model runner on a Mac. True, but you can do that only with thei…

I also kind of don't understand how it seems everyone is using AI for coding. I haven't had a client yet which would have approved any external AI usage. So I basically use them as search engines on steroids, but code can't go directly in or out.

Most my clients have the same requirement. Given the code bases I see my competition generating, I suspect other vendors are simply violating this rule.

Re: Mistral ships Le Chat – enterprise AI assistant that can run on prem

#25

Post by burnte »

codingbot3000 wrote: post #3

I think this is a game changer, because data privacy is a legitimate concern for many enterprise users. Btw, you can also run Mistral locally within the Docker model runner on a Mac.

I have an M4 Mac Mini with 24GB of RAM. I loaded Studio.LM on it 2 days ago and had Mistral NeMo running in ten minutes. It's a great model, I need to figure out how to add my own writing to it, I want it to generate some starter letters for me. Impressive model.

Re: Mistral ships Le Chat – enterprise AI assistant that can run on prem

#26

Post by mark_l_watson »

distances wrote: post #18
kergonath wrote: post #7

Earlier quoted context omitted.

> I think this is a game changer, because data privacy is a legitimate concern for many enterprise users. Indeed. At work, we are experimenting with this. Using a cloud platform is a non-starter for data confidentiality reasons. On-premise is the way to go. Also, they’re not American, which helps. > Btw, you can also run Mistral locally within the Docker model runner on a Mac. True, but you can do that only with thei…

I also kind of don't understand how it seems everyone is using AI for coding. I haven't had a client yet which would have approved any external AI usage. So I basically use them as search engines on steroids, but code can't go directly in or out.

I have good results running Ollama locally with olen models like Gemma 3, Qwen 3, etc. The major drawback is slower inference speed. Commercial APIs like Google Gemini are so much faster.

Still, I find local models very much worth using after taking the time to set them up with Emacs, open-codex, etc.

Re: Mistral ships Le Chat – enterprise AI assistant that can run on prem

#27

Post by thrance »

resource_waste wrote: post #20
byefruit wrote: post #17

Earlier quoted context omitted.

You are probably getting downvoted because you don't give any model generations or versions ('ChatGPT') which makes this not very credible.

[flagged]

"patriotic Europeans" is an... interesting combination of words. I'd almost call it an oxymoron.

Re: Mistral ships Le Chat – enterprise AI assistant that can run on prem

#29

Post by ulnarkressty »

codingbot3000 wrote: post #3

I think this is a game changer, because data privacy is a legitimate concern for many enterprise users. Btw, you can also run Mistral locally within the Docker model runner on a Mac.

I think many in this thread are underestimating the desire of VPs and CTOs to just offload the risk somewhere else. Quite a lot of companies handling sensitive data are already using various services in the cloud and it hasn't been a problem before - even in Europe with its GDPR laws. Just sign an NDA or whatever with OpenAI/Google/etc. and if any data gets leaked they are on the hook.

Re: Mistral ships Le Chat – enterprise AI assistant that can run on prem

#30

Post by shmel »

distances wrote: post #18
kergonath wrote: post #7

Earlier quoted context omitted.

> I think this is a game changer, because data privacy is a legitimate concern for many enterprise users. Indeed. At work, we are experimenting with this. Using a cloud platform is a non-starter for data confidentiality reasons. On-premise is the way to go. Also, they’re not American, which helps. > Btw, you can also run Mistral locally within the Docker model runner on a Mac. True, but you can do that only with thei…

I also kind of don't understand how it seems everyone is using AI for coding. I haven't had a client yet which would have approved any external AI usage. So I basically use them as search engines on steroids, but code can't go directly in or out.

How is it different from the cloud? Plenty startups store their code on github, run prod on aws, and keep all communications on gmail anyway. What's so different about LLMs?
Post reply on HN