51–60 of 148 posts
Jargon naivete question: isn't "on the edge" normally implying on a server side with minimal routers hops to the client, not on client side?
I get why Meta releases tons of models, but still can’t quite understand what stability is trying to achieve
Earlier quoted context omitted.
Deepseek-coder-6.7B really is a quite surprisingly capable model. It's easy to give it a spin with ollama via `ollama run deepseek-coder:6.7b`.
Thanks for the tip with ollama
1. ollama run deepseek-coder:6.7b
2. pip install litellm
3. litellm --model deepseek-coder:6.7b
You will have a local OpenAI compatible API for it.
Can anyone explain what’s Stability’s business model (or plan for one)? I get why Meta releases tons of models, but still can’t quite understand what stability is trying to achieve
Can anyone explain what’s Stability’s business model (or plan for one)? I get why Meta releases tons of models, but still can’t quite understand what stability is trying to achieve
> This model is included in our new Stability AI Membership. Visit our Membership page to take advantage of our commercial Core Model offerings, including SDXL Turbo & Stable Video Diffusion.
A hypothetical Stable Code 13B/70B could be hosted only, with more languages or specialized use-cases (Stable Code 3B iOS-Swift-Turbo)
Many other startups in the space will like face similar issues given the rapid commoditization of these models and the underlying tech. It’s very easy to spend a fortune building a model that offers a short lived incremental improvement at best before one can just quickly swap it out for something else someone else paid to train.
Note that they don't compare with deepseek coder 6.7b, which is vastly superior to much bigger coding models. Surpassing codellama 7b is not that big of a deal today. The most impressive thing about these results is how good the 1.3B deepseek coder is.
This is phenomenal. And runs fast! The 33b version might be my MacBook's new coding daily driver.
Note that they don't compare with deepseek coder 6.7b, which is vastly superior to much bigger coding models. Surpassing codellama 7b is not that big of a deal today. The most impressive thing about these results is how good the 1.3B deepseek coder is.
Deepseek Coder Instruct 6.7b has been my local LLM (M1 series MBP) for a while now and that was my first thought… They selectively chose benchmark results to look impressive (which is typical). I tested out StableLM Zephyr 3B when that came out and it was extremely underwhelming/unusable. Based on this, Stable Code 3B doesn’t look to be worth trying out. Guessing if they could put out a 7B model which beat Deepseek C…
> Commercial Applications
> This model is included in our new Stability AI Membership. Visit our Membership page to take advantage of our commercial Core Model offerings, including SDXL Turbo & Stable Video Diffusion.
what exactly is the license lol. can people use this or is this "see dont touch"
Earlier quoted context omitted.
This is phenomenal. And runs fast! The 33b version might be my MacBook's new coding daily driver.
4-bit quantized 33b runs great on a mp pro with m3 max chip