[deleted]
Codestral Mamba
31–40 of 148 posts
Re: Codestral Mamba
#32What are the steps required to get this running in VS Code? If they had linked to the instructions in their post (or better yet a link to a one click install of a VS Code Extension), it would help a lot with adoption. (BTW I consider it malpractice that they are at the top of hacker news with a model that is of great interest to a large portion of the users where and they do not have a monetizable call to action on t…
If you can run this using ollama, then you should be able to use https://www.continue.dev/ with both IntelliJ and VSCode. Haven’t tried this model yet - but overall this plugin works well.
They say no llama.cpp support yet, so no ollama yet (which uses llama.cpp)
Re: Codestral Mamba
#33What are the steps required to get this running in VS Code? If they had linked to the instructions in their post (or better yet a link to a one click install of a VS Code Extension), it would help a lot with adoption. (BTW I consider it malpractice that they are at the top of hacker news with a model that is of great interest to a large portion of the users where and they do not have a monetizable call to action on t…
Looking through the Quickstart docs, they have an API that can generate code. However, I don't think they have a way to do "Day 2" code editing. Also, doesn't seem to have a freemium tier...need to start paying even before trying it out ? "Our API is currently available through La Plateforme. You need to activate payments on your account to enable your API keys."
I signed up when codestral was first available and put my payment details in. Been using it daily since then with continue.dev but my usage dashboard shows 0 tokens, and so far have not been billed for anything... Definitely not clear anywhere, but it seems to be free for now? Or some sort of free limit that I am not hitting.
Re: Codestral Mamba
#34They announce the model is on HuggingFace but don't link to it. Here it is: https://huggingface.co/mistralai/mamba-codestral-7B-v0.1
The link is already there in the text, they probably just fixed it.
Re: Codestral Mamba
#35Earlier quoted context omitted.
If you can run this using ollama, then you should be able to use https://www.continue.dev/ with both IntelliJ and VSCode. Haven’t tried this model yet - but overall this plugin works well.
They say no llama.cpp support yet, so no ollama yet (which uses llama.cpp)
[deleted]
Re: Codestral Mamba
#36But I JUST switched from GPT4o to Claude! :( Kidding, but it isn't clear how to use this thing, as others have pointed out.
What made you switch?
Re: Codestral Mamba
#37Earlier quoted context omitted.
If you can run this using ollama, then you should be able to use https://www.continue.dev/ with both IntelliJ and VSCode. Haven’t tried this model yet - but overall this plugin works well.
They say no llama.cpp support yet, so no ollama yet (which uses llama.cpp)
Ollama is supported: https://docs.continue.dev/setup/select-provider
Re: Codestral Mamba
#38The MBPP column should bold DeepSeek as it has a better score than Codestral.
Which means Codestral Mamba and DeepSeek both lead four benchmarks. Kinda takes the air out the announcement a bit.
It should be corrected but the interesting aspect of this release is the architecture. To stay competitive while only needing linear inference time and supporting 256k context is pretty neat.
Re: Codestral Mamba
#39The MBPP column should bold DeepSeek as it has a better score than Codestral.
Which means Codestral Mamba and DeepSeek both lead four benchmarks. Kinda takes the air out the announcement a bit.
They're in roughly the same class but totally different architectures
Deepseek uses a 4k sliding window compared to Codestral Mamba's 256k+ tokens