Mistral Releases Deep Research, Voice, Projects in Le Chat

#1

Post by pember » Thu, Jul 17, 2025, 3:00 PM UTC

Mistral Releases Deep Research, Voice, Projects in Le Chat
mistral.ai

Re: Mistral Releases Deep Research, Voice, Projects in Le Chat

#2

Post by jddj » Thu, Jul 17, 2025, 4:43 PM UTC

The examples aren't great. The personal planning one for example answers the prompt better without deep research than with (with answers only the Visas point)

Re: Mistral Releases Deep Research, Voice, Projects in Le Chat

#3

Post by tdhz77 » Thu, Jul 17, 2025, 4:51 PM UTC

I’m struggling with MRF. Model Release Fatigue. It’s a syndrome of constantly context switching new large models. Claude 4, gpt, llama, Gemini 2.5, pro-mini, mistrial.

I fire off the ide switch the model and think oh great this is better. I switch to something that worked before and man, this sucks now.

Context switching llm, Model Release Fatigue

Re: Mistral Releases Deep Research, Voice, Projects in Le Chat

#4

Post by htrp » Thu, Jul 17, 2025, 4:57 PM UTC

is anyone doing online reviews of model performance ? (I know artificial analysis does some work on infrastructure and has an intelligence index)

Re: Mistral Releases Deep Research, Voice, Projects in Le Chat

#5

Post by vpShane » Thu, Jul 17, 2025, 4:59 PM UTC

tdhz77 wrote: post #3

I’m struggling with MRF. Model Release Fatigue. It’s a syndrome of constantly context switching new large models. Claude 4, gpt, llama, Gemini 2.5, pro-mini, mistrial. I fire off the ide switch the model and think oh great this is better. I switch to something that worked before and man, this sucks now. Context switching llm, Model Release Fatigue

Now just make a chatbot for each model and then compete them all against each other in the ultimate showdown.

Winner gets your attention for a week.

Re: Mistral Releases Deep Research, Voice, Projects in Le Chat

#6

Post by didibear » Thu, Jul 17, 2025, 5:03 PM UTC

tdhz77 wrote: post #3

I’m struggling with MRF. Model Release Fatigue. It’s a syndrome of constantly context switching new large models. Claude 4, gpt, llama, Gemini 2.5, pro-mini, mistrial. I fire off the ide switch the model and think oh great this is better. I switch to something that worked before and man, this sucks now. Context switching llm, Model Release Fatigue

I believe perfs of previous versions are worse because providers reallocate resources to newer versions. Also because of training data cut-off to previous years. This is what happened between claude sonnet 3.5 and 3.7.

Personally I only use Claude/Anthropic and ignore other providers because I understand it the more. It's smart enough, I rarely need the latest greatest.

Re: Mistral Releases Deep Research, Voice, Projects in Le Chat

#7

Post by emilsedgh » Thu, Jul 17, 2025, 5:03 PM UTC

tdhz77 wrote: post #3

I’m struggling with MRF. Model Release Fatigue. It’s a syndrome of constantly context switching new large models. Claude 4, gpt, llama, Gemini 2.5, pro-mini, mistrial. I fire off the ide switch the model and think oh great this is better. I switch to something that worked before and man, this sucks now. Context switching llm, Model Release Fatigue

Why do you even follow? Just stick to one that works well for you?

Re: Mistral Releases Deep Research, Voice, Projects in Le Chat

#8

Post by reckless » Thu, Jul 17, 2025, 5:14 PM UTC

htrp wrote: post #4

is anyone doing online reviews of model performance ? (I know artificial analysis does some work on infrastructure and has an intelligence index)

The aggregate picture only tells you so much.

Sites like simonwillison.net/2025/jul/ and channels like https://www.youtube.com/@aiexplained-official also cover new model releases pretty quickly for some "out of the box thinking/reasoning" evaluations.

For me and my usage I can really only tell if I start using the new model for tasks I actually use them for.

My personal benchmark andrew.ginns.uk/merbench has full code and data on GitHub if you want a staring point!

Re: Mistral Releases Deep Research, Voice, Projects in Le Chat

#9

Post by mrcwinn » Thu, Jul 17, 2025, 5:14 PM UTC

tdhz77 wrote: post #3

I’m struggling with MRF. Model Release Fatigue. It’s a syndrome of constantly context switching new large models. Claude 4, gpt, llama, Gemini 2.5, pro-mini, mistrial. I fire off the ide switch the model and think oh great this is better. I switch to something that worked before and man, this sucks now. Context switching llm, Model Release Fatigue

What a luxury!

One way to avoid this: stick with one LLM and bet on the company behind it (meaning, over time, they’ll always have the best offering). I’ve bet on OpenAI. Others can make different conclusions.

Re: Mistral Releases Deep Research, Voice, Projects in Le Chat

#10

Post by barbazoo » Thu, Jul 17, 2025, 5:17 PM UTC

emilsedgh wrote: post #7

tdhz77 wrote: post #3

I’m struggling with MRF. Model Release Fatigue. It’s a syndrome of constantly context switching new large models. Claude 4, gpt, llama, Gemini 2.5, pro-mini, mistrial. I fire off the ide switch the model and think oh great this is better. I switch to something that worked before and man, this sucks now. Context switching llm, Model Release Fatigue

Why do you even follow? Just stick to one that works well for you?

Totally, I feel like though you do have to pay some attention for example in the context I'm working on, for the last while, Gemini was our gold standard for code generation whereas today, Claude subjectively produces the better results. Sure you can stick to what worked abut then you're missing the opportunity to be more productive or less busy, whichever one you choose.