[deleted]
Mistral ships Le Chat – enterprise AI assistant that can run on prem
151–160 of 166 posts
Re: Mistral ships Le Chat – enterprise AI assistant that can run on prem
#152Re: Mistral ships Le Chat – enterprise AI assistant that can run on prem
#153the site doesn't work with dark mode, the text is dark also
Re: Mistral ships Le Chat – enterprise AI assistant that can run on prem
#154Earlier quoted context omitted.
"patriotic Europeans" is an... interesting combination of words. I'd almost call it an oxymoron.
To me that's a clue that it's written by an American :-).
Interesting. I'd say that Americans tend to overestimate the degree of common identity among Europeans. The polls are clear: for most Europeans, their European identity comes a distant second. The EU in particular is an elitist project and it's only slowly gaining popular legitimacy.
That said, I personally am a very patriotic European.
Re: Mistral ships Le Chat – enterprise AI assistant that can run on prem
#155Earlier quoted context omitted.
Last I checked France is in Europe. It would be like saying Google or Apple are not American because they are in California.
The big picture incongruence in the thread is using terms as patriotic, allegories to US states, which imo is but a US-centric projection. Even proponents don’t think of the EU to be a supreme government with federated states, and they certainly don’t think of ”Europeans” as a unified demographic. At best, the EU protects against stupid shit from other EU countries (tariffs, freedom of movement) and stupid shit again…
The NAFTA Parliament
Re: Mistral ships Le Chat – enterprise AI assistant that can run on prem
#156Mistral really became what all the other over-hyped EU AI start-ups / collectives (Stability, Eleuther, Aleph Alpha, Nyonic, possibly Black Forest Labs, government-funded collaborations, ...) failed to achieve, although many of them existed way before Mistral. Congrats to them, great work.
It feels to me they turned into a generic AI consulting & solutions company. That does not mean it's a bad business, especially since they might benefit from the "built in EU" spin (whether through government contracts, regulation, or otherwise). One can deploy similar solution (on-prem) using better and more cost efficient open-source models and infrastructure already. What Mistral offers here is managing that deplo…
That's what we do with Hopsworks - EU built platform for developing and operating AI systems. We have customers running DeepSeek-v3 and Llama models. I never thought about slapping a Chat UI on it and selling the Chat app as a ready made product for the sovereign AI market. But why not.
Re: Mistral ships Le Chat – enterprise AI assistant that can run on prem
#157Earlier quoted context omitted.
Why would that be? I can see why Americans wouldn't want to do that, but Europeans? In the current political climate, where the US openly claims their desire to annex European territory and so on? I'd rather see them prefer a locally hostable open source solution like DeepSeek.
My two cents, as European, is that since we are more and more asking to LLMs for information, it wouldn't be wise to let a foreign country, not even truly democratic, to choose the information we get.
The Chinese don't get any of information if we use self-hosted DeepSeek or Qwen. They are open-source. You can run them in an air-gapped environment that can't phone home.
Re: Mistral ships Le Chat – enterprise AI assistant that can run on prem
#158Earlier quoted context omitted.
That’s a perfectly valid idea in theory, but in practice you’ll run into a few painful trade-offs, especially in multi-user environments. Trust me, I'm currently doing exactly that in our fairly limited exploration of how we can leverage local LLMs at work (SME). Unless you have sufficient VRAM to keep all potential specialized models loaded simultaneously (which negates some of the "lightweight" benefit for the over…
Have you looked into semantic router? It will be a faster way to look up the right model for the right task. I agree that using a llm for routing is not good, takes money, takes time, and can often take the wrong route.
Semantic router is on my radar, but I haven't had a good look at it yet. The primary bottleneck in our current setup, isn't really the routing decision time. The lightweight LLM I chose (Gemma3 4B) handles the task identification fairly well in terms of both speed and accuracy from what I've found.
For some context: this is a fairly limited exploratory deployment which runs alongside other priority projects for me, so I'm not too obsessed with optimizing the decision-making time. Those three seconds are relatively minor when compared with the 20–60 seconds it takes to unload the old and load a new model.
I can see semantic router being really useful in scenarios built around commercial, API-accessed models, though. There, it could yield significant cost savings by, for example, intelligently directing simpler queries to a less capable but cheaper model instead of the latest and greatest (and likely significantly more expensive) model users might feel drawn to. You're basically burning money if you let your employees use Claude 3.7 to format a .csv file.
Re: Mistral ships Le Chat – enterprise AI assistant that can run on prem
#159Earlier quoted context omitted.
The big picture incongruence in the thread is using terms as patriotic, allegories to US states, which imo is but a US-centric projection. Even proponents don’t think of the EU to be a supreme government with federated states, and they certainly don’t think of ”Europeans” as a unified demographic. At best, the EU protects against stupid shit from other EU countries (tariffs, freedom of movement) and stupid shit again…
The NAFTA Parliament
Yes, analogies do have differences. And parliament is better than handshakes behind closed doors, even if it’s not perfect.
Comparing to states is much more far fetched. The UK left the union without any serious retaliation, let alone military conflict. What would happen if Texas or California tried to secede seriously?
Re: Mistral ships Le Chat – enterprise AI assistant that can run on prem
#160This is so fast it took me by surprise. I'm used to wait for ages until the response is finished on Gemini and ChatGPT, but this is instantaneous.