They announce the model is on HuggingFace but don't link to it. Here it is: https://huggingface.co/mistralai/mamba-codestral-7B-v0.1
Codestral Mamba
21–30 of 148 posts
Re: Codestral Mamba
#22What are the steps required to get this running in VS Code? If they had linked to the instructions in their post (or better yet a link to a one click install of a VS Code Extension), it would help a lot with adoption. (BTW I consider it malpractice that they are at the top of hacker news with a model that is of great interest to a large portion of the users where and they do not have a monetizable call to action on t…
Looking through the Quickstart docs, they have an API that can generate code. However, I don't think they have a way to do "Day 2" code editing.
Also, doesn't seem to have a freemium tier...need to start paying even before trying it out ?
"Our API is currently available through La Plateforme. You need to activate payments on your account to enable your API keys."
Re: Codestral Mamba
#23The first sentence is wrong. The website says: > As a tribute to Cleopatra, whose glorious destiny ended in tragic snake circumstances but according to Wikipedia this is not true: > When Cleopatra learned that Octavian planned to bring her to his Roman triumphal procession, she killed herself by poisoning, contrary to the popular belief that she was bitten by an asp.
Yes, that seems to be a myth, but exact circumstances seem rather uncertain according to the Wikipedia article [1]:
> [A]ccording to the Roman-era writers Strabo, Plutarch, and Cassius Dio, Cleopatra poisoned herself using either a toxic ointment or by introducing the poison with a sharp implement such as a hairpin. Modern scholars debate the validity of ancient reports involving snakebites as the cause of death and whether she was murdered. Some academics hypothesize that her Roman political rival Octavian forced her to kill herself in a manner of her choosing. The location of Cleopatra's tomb is unknown. It was recorded that Octavian allowed for her and her husband, the Roman politician and general Mark Antony, who stabbed himself with a sword, to be buried together properly.
I think this rounds to “nobody really knows.”
The “glorious destiny” seems kind of shaky, too. It’s just a throwaway line anyway.
Re: Codestral Mamba
#24The MBPP column should bold DeepSeek as it has a better score than Codestral.
Re: Codestral Mamba
#25The first sentence is wrong. The website says: > As a tribute to Cleopatra, whose glorious destiny ended in tragic snake circumstances but according to Wikipedia this is not true: > When Cleopatra learned that Octavian planned to bring her to his Roman triumphal procession, she killed herself by poisoning, contrary to the popular belief that she was bitten by an asp.
I believe this is in dispute among sources.
[deleted]
Re: Codestral Mamba
#26The MBPP column should bold DeepSeek as it has a better score than Codestral.
Which means Codestral Mamba and DeepSeek both lead four benchmarks. Kinda takes the air out the announcement a bit.
Re: Codestral Mamba
#27Does anyone have a video or written article that would get one up to speed with a bit of the history/progression and current products that are out there for one to try locally? This is coming from someone that understands the general concepts of how LLMs work but only used the general publicly available tools like ChatGPT, Claude, etc. I want to see if I have any hardware I can stress and run something locally, but d…
Most the 7b instruct models are very bad outside very simple queries. You can run a 7b on most modern hardware.How fast will vary. To run 30-70b models you're getting in the realm of needing 24gb or more of vRAM.
I'm looking to run something on a 24gb GPU for the purpose of running wild with agentic use of LLMs. Is there anything worth trying that would fit on that amount of vRAM? Or are all the open-source PC-sized LLMs laughable still?
Re: Codestral Mamba
#28any sort of evals on how it compares to closed models like chat gpt 4 or open ones like WizardLLM ?
Re: Codestral Mamba
#29What are the steps required to get this running in VS Code? If they had linked to the instructions in their post (or better yet a link to a one click install of a VS Code Extension), it would help a lot with adoption. (BTW I consider it malpractice that they are at the top of hacker news with a model that is of great interest to a large portion of the users where and they do not have a monetizable call to action on t…
"All you need is users" doesn't seem optimal IMHO, Stability.ai providing an object lesson in that.
They just released weights, and being a for profit, need to optimize for making money, not eyeballs. It seems wise to guide people to the API offering.
Re: Codestral Mamba
#30Earlier quoted context omitted.
If I understand correctly what you are looking for, Ollama might be a solution ( https://ollama.com/ )?. I have no affiliation, but I lazily use this solution when I want to run a quick model locally.
Better yet install Open Web GUI and ollama at the same time via docker. Most people will want a familiar GUI rather than the terminal. https://github.com/open-webui/open-webui This will install ollama and open web GUI: For GPU support run: docker run -d -p 3000:8080 --gpus=all -v ollama:/root/.ollama -v open-webui:/app/backend/data --name open-webui --restart always ghcr.io/open-webui/open-webui:ollama Use for CPU on…
Why do people recommend this instead of the much better oobabooga text-gen-webui?
https://github.com/oobabooga/text-generation-webui
It's like you hate settings, features, and access to many backends!