My bet is that the solution to continuous learning is with external storage. There is a lot of talk about context engineering - but I have not seen anyone taking context as the main bottleneck and building a system around that. This would show that even context engineering is kind of wrong term - because context does not enter the llm in some mysterious way - it goes through prompt and the whole model of passing chat…
What do you mean when you say "external storage?"
Mistral AI Releases Forge
81–90 of 210 posts
Re: Mistral AI Releases Forge
#82Would love to take it for a spin, if that is even possible.
Re: Mistral AI Releases Forge
#83Re: Mistral AI Releases Forge
#84Dissapointing.
Re: Mistral AI Releases Forge
#85Earlier quoted context omitted.
Even that doesn't make sense. Why would you not build a vector database to complement your RAG engine?
For coding use cases you may want a way to search for symbols themselves or do a plain text exact match for the name of a symbol to find the relevant documents to include. There is more to searching than building a basic similarity search.
Even with the coding use-case you would still likely want to build a similarity search engine because searching through plain symbols isn't enough to build a contextual understanding of higher-level concepts in the code.
Re: Mistral AI Releases Forge
#86I think it’s interesting what this approach suggests about who will profit from AI. I’m sceptical that having huge numbers of GPUs is a moat. After all, real humans – even geniuses – are trained on much much less data than the whole Internet. But proprietary and specialised data could very well be a moat. It’s hard to train a scientist/lawyer/analyst without reading a lot of science/law/finance. Companies’ proprietar…
It's certainly different data, but one could argue that real humans have been trained on 3.5 billion years of evolution data.
Re: Mistral AI Releases Forge
#87I like Mistral, it hits the exact sweet spot between cost and my data staying in the EU, withouth a significant drop in quality, but man are their model naming conventions confusing af. They mention they have a model called Devstral 2, which is neither Codestral nor Devestral. I want to use it, but the api only lists devstral-2512, devstral-latest, devstral-medium-latest, devstral-medium-2507, devstral-small, devstra…
Re: Mistral AI Releases Forge
#88Re: Mistral AI Releases Forge
#89Re: Mistral AI Releases Forge
#90I like Mistral, it hits the exact sweet spot between cost and my data staying in the EU, withouth a significant drop in quality, but man are their model naming conventions confusing af. They mention they have a model called Devstral 2, which is neither Codestral nor Devestral. I want to use it, but the api only lists devstral-2512, devstral-latest, devstral-medium-latest, devstral-medium-2507, devstral-small, devstra…
I had the same experience. It's even more confusing when you want to create an API key because they are separated by product, maybe?