Stable Code 3B: Coding on the Edge
stability.ai
Stable Code 3B: Coding on the Edge
1–10 of 148 posts
Re: Stable Code 3B: Coding on the Edge
#2That is fantastic. I'm building a small macOS SwiftUI client with llama cpp built in, no server-client model, and it's already so useful with models like openhermes chat 7B, and fast.
If this opens it to smaller laptops, wow!
We truly live in crazy time. The rate of improvement in this field is off the walls.
Re: Stable Code 3B: Coding on the Edge
#3That is fantastic. I'm building a small macOS SwiftUI client with llama cpp built in, no server-client model, and it's already so useful with models like openhermes chat 7B, and fast. If this opens it to smaller laptops, wow! We truly live in crazy time. The rate of improvement in this field is off the walls.
That sounds awesome! Can you share any details about how you're working with llama cpp? Is it just via the Swift C bridge? I've toyed with the idea of doing this, and wonder if you have any pointers before I get started.
Re: Stable Code 3B: Coding on the Edge
#4Given the complete failure of the first stable lm, I'm interested to try this one out. Haven't really seen a small language model, except mixtral 7b that's really useful for much.
I also hope stability comes out with a competitor to the new midjourney and dalle models! That's what put them on the map in the first place
Re: Stable Code 3B: Coding on the Edge
#5It's amazing to see more smaller models being released. This creates opportunities for more developers to run it on their local computers, and makes it easier to fine-tune for specific needs.
Re: Stable Code 3B: Coding on the Edge
#6How is this compared to the current GitHub Copilot?
Re: Stable Code 3B: Coding on the Edge
#7It's amazing to see more smaller models being released. This creates opportunities for more developers to run it on their local computers, and makes it easier to fine-tune for specific needs.
Has anyone tried starting with a smaller modeling, then RLing until it improves to the bigger model?
Re: Stable Code 3B: Coding on the Edge
#8How reliable are these benchmarks?
Re: Stable Code 3B: Coding on the Edge
#9I've got a machine with 4 3090s-- Anyone know which model would perform the best for programming? It's great this can run on a machine w/out a graphics card and is only 3B params, but I have the hardware. Might as well use it.
Re: Stable Code 3B: Coding on the Edge
#10Note that they don't compare with deepseek coder 6.7b, which is vastly superior to much bigger coding models. Surpassing codellama 7b is not that big of a deal today.
The most impressive thing about these results is how good the 1.3B deepseek coder is.