Live data from Hacker News

Stable Code 3B: Coding on the Edge

stability.ai

101–110 of 148 posts

Re: Stable Code 3B: Coding on the Edge

#101

Earlier quoted context omitted.

I think the etymology of “edge computing” is derived from “network edge”, ie the outer shell of some network/autonomous system. The closest point within your control that interfaces with devices outside of your control. Seeing the term get used to describe client devices themselves kinda muddies the terminology.

Agreed. (autocorrect style typo above: etymology)

fixed

Re: Stable Code 3B: Coding on the Edge

#102
post #59

> License: Other > Commercial Applications > This model is included in our new Stability AI Membership. Visit our Membership page to take advantage of our commercial Core Model offerings, including SDXL Turbo & Stable Video Diffusion. what exactly is the license lol. can people use this or is this "see dont touch"

It's free for noncommercial use. If you use it in your company, your company should pay the membership fee. afaik most openai competitors also use similar usage restriction (e.g. free for noncommercial or research use, contact us for commercial license).

Re: Stable Code 3B: Coding on the Edge

#103
post #56

Don’t entirely understand Stability’s business model. They’ve been putting out a lot of models recently and Stable Diffusion was novel at the time, but now their models consistently seem to be somewhat second rate compared to other things out there. For example Midjourney now seems to have far surpassed them in the image generation front. After raising a ton of funding Stability seems to just be throwing a bunch of s…

We use SD at work because we need more control over the image generation pipeline (and to a lesser extent don’t want extra latency from web APIs).

Believe it or not, generating a full image from a prompt is a small slice of the image generation pie. Highly tuned in-painting is key to a number of budding startups.

Re: Stable Code 3B: Coding on the Edge

#104
post #50
post #10

Note that they don't compare with deepseek coder 6.7b, which is vastly superior to much bigger coding models. Surpassing codellama 7b is not that big of a deal today. The most impressive thing about these results is how good the 1.3B deepseek coder is.

Deepseek Coder Instruct 6.7b has been my local LLM (M1 series MBP) for a while now and that was my first thought… They selectively chose benchmark results to look impressive (which is typical). I tested out StableLM Zephyr 3B when that came out and it was extremely underwhelming/unusable. Based on this, Stable Code 3B doesn’t look to be worth trying out. Guessing if they could put out a 7B model which beat Deepseek C…

Do you use it inside vscode or how do you integrate an LLM into your IDE?

Re: Stable Code 3B: Coding on the Edge

#105

Earlier quoted context omitted.

Thanks for the tip with ollama

ollama is actually not a great way to run these models as it makes it difficult to change server parameters and doesn't use `mlock` to keep the models in memory.

What do you suggest?

Re: Stable Code 3B: Coding on the Edge

#106

Earlier quoted context omitted.

Do you know how Deepseek 33b compares to 6.7b? I'm trying 33b on my (96GB) MacBook just because I have plenty of spare (V)RAM. But I'll run the smaller model if the benefits are marginal in other peoples' experience.

The smaller model is great at trivial day-to-day tasks. However, when you ask hard things, it struggles; you can ask the same question 10 times, and only get 1 answer that actually answers the question. ...but the larger model is a lot slower. Generally, if you don't want to mess around swapping models, stick with the bigger one. It's better. However, if you are heavily using it, you'll find the speed is a pain in th…

Do you mind sharing your plugin as a gist?

How do you run both models in memory? Two separate processes?

Re: Stable Code 3B: Coding on the Edge

#107
post #56

Don’t entirely understand Stability’s business model. They’ve been putting out a lot of models recently and Stable Diffusion was novel at the time, but now their models consistently seem to be somewhat second rate compared to other things out there. For example Midjourney now seems to have far surpassed them in the image generation front. After raising a ton of funding Stability seems to just be throwing a bunch of s…

Midjourney is decidedly underwhelming if you've spent any time using the expansive tooling and control nets of Stable Diffusion. Yes, it's easy to get impressive first gens with MJ, but all of the coolest work and integration happening is using SD.

It depends. For great looking pics that you need to get out quickly MJ does a great job. Especially with its image + text feature. Dalle is also an interesting choice.

SDXL and controlnet is odd a lot of the time. 1.5 + controlnet still seem to give quicker and better results.

Basically SD atleast seems to be for when you want unique content. MJ/Dalle for everything else.

Re: Stable Code 3B: Coding on the Edge

#108
post #87
post #76

Earlier quoted context omitted.

The 1.3b model is amazing for real time code complete, it's fast enough to be a better intellisense. Another model you should try is magicoder 6.7b ds (based on deepseek coder). After playing with it for a couple weeks, I think it gives slightly better results than the equivalent deepseek model. Repo https://github.com/ise-uiuc/magicoder Models https://huggingface.co/models?search=Magicoder-s-ds

How do you use these models with your editor? (E. vscode or Emacs etc)

I run tabby [0] which uses llama.cpp under the hood and they ship a vscode extension [1]. Going above 1.3b, I find the latency too distracting (but the highest end gpu I have nearby is some 16gb rtx quadro card that's a couple years old, and usually I'm running a consumer 8gb card instead).

[0] https://tabby.tabbyml.com/

[1] https://marketplace.visualstudio.com/items?itemName=TabbyML....

Re: Stable Code 3B: Coding on the Edge

#110
post #77
post #56

Don’t entirely understand Stability’s business model. They’ve been putting out a lot of models recently and Stable Diffusion was novel at the time, but now their models consistently seem to be somewhat second rate compared to other things out there. For example Midjourney now seems to have far surpassed them in the image generation front. After raising a ton of funding Stability seems to just be throwing a bunch of s…

Business model is bundling so you have a one stop shop for good quality models of every modality and cultural variants of them. These go on bedrock, on chip, on prem etc and our consulting partners take them to the end user. On the innovation side stable diffusion turbo does like 100 cats with hats per second and the video model outperforms runway, pika etc on blind tests. Stable audio was one of the time innovation…

(parent commenter is founder/CEO of Stability AI, Emad Mostaque, I assume)
Post reply on HN