Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Mistral ships Le Chat – enterprise AI assistant that can run on prem

mistral.ai

Post reply on HN
Print view View original

41–50 of 166 posts

Re: Mistral ships Le Chat – enterprise AI assistant that can run on prem

#41

Post by tcoff91 »

jamessinghal wrote: post #35
shmel wrote: post #30

Earlier quoted context omitted.

How is it different from the cloud? Plenty startups store their code on github, run prod on aws, and keep all communications on gmail anyway. What's so different about LLMs?

I think it's a combination of a fundamental distrust of the model makers and a history of them training on user data with and without consent. The main players all allow some form of zero data retention but I'm sure the more cautious CISO/CIOs flat out don't trust it.

I think that using something like Claude on Amazon Bedrock makes more sense than directly using Anthropic. Maybe I'm naive but I trust AWS more than Anthropic, OpenAI, or Google to not misuse data.

Re: Mistral ships Le Chat – enterprise AI assistant that can run on prem

#43

Post by amelius »

resource_waste wrote: post #14
guerrilla wrote: post #9

Interesting. Europe is really putting up a fight for once. I'm into it.

Expected this comment. Mistral has been consistently last place, or at least last place among ChatGPT, Claude, Llama, and Gemini/Gemma. I know this because I had to use a permissive license for a side project and I was tortured by how miserably bad Mistral was, and how much better every other LLM was. Need the best? ChatGPT Need local stuff? Llama(maybe Gemma) Need to do barely legal things that break most company's…

I certainly had some opposite experiences lately, where Mistral was outperforming Chatgpt for some hard questions.

Re: Mistral ships Le Chat – enterprise AI assistant that can run on prem

#44

Post by pfannkuchen »

genghisjahn wrote: post #38
fhd2 wrote: post #21

Earlier quoted context omitted.

You might be able to get your clients to sign something to allow usage, but if you don't, as you say, it doesn't seem wise to vibe code for them. For two reasons: 1. A typical contract transfers the rights to the work. The ownership of AI generated code is legally a wee bit disputed. If you modify and refactor generated code heavily it's probably fine, but if you just accept AI generated code en masse, making your cl…

What about 10 years ago when we all copied code from SO? Did we worry about copyright then? Maybe we did and I don’t recall.

SO seems different because the author of the post is republishing it. If they are republishing copyrighted material without notice, it seems like the SO author is the one in violation of copyright.

In the LLM case, I think it’s more of an open question whether the LLM output is republishing the copyrighted content without notice, or simply providing access to copyrighted content. I think the former would put the LLM provider in hot water, while the latter would put the user in hot water.

Re: Mistral ships Le Chat – enterprise AI assistant that can run on prem

#45

Post by genghisjahn »

fhd2 wrote: post #39
genghisjahn wrote: post #38

Earlier quoted context omitted.

What about 10 years ago when we all copied code from SO? Did we worry about copyright then? Maybe we did and I don’t recall.

It's roughly the same, legally, and I was well aware of that. Legally speaking, you also want to be careful about your dependencies and their licenses, a company that's afraid to get sued usually goes to quite some lengths to ensure they play this stuff safe. A lot of smaller companies and startups don't know or don't care. From a professional ethics perspective, personally, I don't want to put my clients in that pos…

You raise a good point. It was kinda gray in the SO days. You almost always had to change something to get your code to work. But at lot of LLM's can spit out code that you can just paste in. And, I guess maybe the tests all pass, but if it goes wrong, you, the coder probably don't know where it went wrong. But if you'd written it all yourself, you could probably guess.

I'm still sorting all this stuff out personally. I like LLM's when I work in an area I know well. But vibing in areas of technology that I don't know well just feels weird.

Re: Mistral ships Le Chat – enterprise AI assistant that can run on prem

#46

Post by betterThanTexas »

distances wrote: post #18
kergonath wrote: post #7

Earlier quoted context omitted.

> I think this is a game changer, because data privacy is a legitimate concern for many enterprise users. Indeed. At work, we are experimenting with this. Using a cloud platform is a non-starter for data confidentiality reasons. On-premise is the way to go. Also, they’re not American, which helps. > Btw, you can also run Mistral locally within the Docker model runner on a Mac. True, but you can do that only with thei…

I also kind of don't understand how it seems everyone is using AI for coding. I haven't had a client yet which would have approved any external AI usage. So I basically use them as search engines on steroids, but code can't go directly in or out.

I would take any such claim with a heavy rock of salt because the usefulness of AI is going to vary drastically with the sort of work you're tasked with producing.

Re: Mistral ships Le Chat – enterprise AI assistant that can run on prem

#47

Post by lysace »

resource_waste wrote: post #14
guerrilla wrote: post #9

Interesting. Europe is really putting up a fight for once. I'm into it.

Expected this comment. Mistral has been consistently last place, or at least last place among ChatGPT, Claude, Llama, and Gemini/Gemma. I know this because I had to use a permissive license for a side project and I was tortured by how miserably bad Mistral was, and how much better every other LLM was. Need the best? ChatGPT Need local stuff? Llama(maybe Gemma) Need to do barely legal things that break most company's…

[flagged]

Re: Mistral ships Le Chat – enterprise AI assistant that can run on prem

#48

Post by _bin_ »

lysace wrote: post #47
resource_waste wrote: post #14

Earlier quoted context omitted.

Expected this comment. Mistral has been consistently last place, or at least last place among ChatGPT, Claude, Llama, and Gemini/Gemma. I know this because I had to use a permissive license for a side project and I was tortured by how miserably bad Mistral was, and how much better every other LLM was. Need the best? ChatGPT Need local stuff? Llama(maybe Gemma) Need to do barely legal things that break most company's…

[flagged]

[flagged]

Re: Mistral ships Le Chat – enterprise AI assistant that can run on prem

#49

Post by nicce »

codingbot3000 wrote: post #3

I think this is a game changer, because data privacy is a legitimate concern for many enterprise users. Btw, you can also run Mistral locally within the Docker model runner on a Mac.

> Btw, you can also run Mistral locally within the Docker model runner on a Mac.

Efficiently? I thought macOS does not have API so that Docker could use GPU.

Re: Mistral ships Le Chat – enterprise AI assistant that can run on prem

#50

Post by simion314 »

shmel wrote: post #30
distances wrote: post #18

Earlier quoted context omitted.

I also kind of don't understand how it seems everyone is using AI for coding. I haven't had a client yet which would have approved any external AI usage. So I basically use them as search engines on steroids, but code can't go directly in or out.

How is it different from the cloud? Plenty startups store their code on github, run prod on aws, and keep all communications on gmail anyway. What's so different about LLMs?

>How is it different from the cloud? Plenty startups store their code on github, run prod on aws, and keep all communications on gmail anyway. What's so different about LLMs?

Those plenty startups will also use Google, OpenAi or the built in Microsoft AI.

This is clearly for companies that need to keep the sensitive data under their control. I think they also get support with adding more training to the model to be personalized for your needs.

Post reply on HN