Live data from Hacker News

Stable Code 3B: Coding on the Edge

stability.ai

121–130 of 148 posts

Re: Stable Code 3B: Coding on the Edge

#121
post #59

> License: Other > Commercial Applications > This model is included in our new Stability AI Membership. Visit our Membership page to take advantage of our commercial Core Model offerings, including SDXL Turbo & Stable Video Diffusion. what exactly is the license lol. can people use this or is this "see dont touch"

It's free for noncommercial use. If you use it in your company, your company should pay the membership fee. afaik most openai competitors also use similar usage restriction (e.g. free for noncommercial or research use, contact us for commercial license).

This basically means "Get sued."

There is no clear legal, definition of "noncommercial," and courts have gone all sorts of different way on what constitutes commercial use.

This is where CC NC licenses imploded. A lot of places (hello, MIT!) intentionally use CC NC licenses to make things appear more open than they are.

Re: Stable Code 3B: Coding on the Edge

#122
post #56

Don’t entirely understand Stability’s business model. They’ve been putting out a lot of models recently and Stable Diffusion was novel at the time, but now their models consistently seem to be somewhat second rate compared to other things out there. For example Midjourney now seems to have far surpassed them in the image generation front. After raising a ton of funding Stability seems to just be throwing a bunch of s…

>Stable Diffusion was novel at the time, but now their models consistently seem to be somewhat second rate compared to other things out there. For example Midjourney now seems to have far surpassed them in the image generation front. This isn’t entirely true, after the fumble that was SD2 they shipped SDXL and SDXL Turbo that are both excellent. And in real world results Midjourney doesn’t just straight out perform t…

For what I’d call “art” or at least artsy works, or anything I want to iterate on (using inpainting and redraws) I want to make I use stable diffusion, but if I just want to send some dumb silly picture to send to my friend I’ve found myself using DALL-E almost every single day. It’s just so easy and in 4 images it’ll almost always get pretty close to what I’m describing. I’m constantly sending my friends dumb pictures because it’s really funny and gets a laugh out of people.

That said it was super cool the time I trained a model on my friends selfies and made her into her D&D character. She was super excited about it, made me feel like a real life wizard.

Re: Stable Code 3B: Coding on the Edge

#123
post #14

It's quite amazing - I often find that I read quite positive comments towards LLM tools for coding. Yet, an "Ask HN" I posted a while ago (and which admittedly didn't gain much traction) seemed to mirror mostly negative/pessimistic responses. https://news.ycombinator.com/item?id=38803836 Was it just that my submission didn't find enough / more balanced commenters?

If somebody can show me a coding task that LLMs have successfully done that isn't an interview question or a documentation snippet, I might start to value it.

Spending huge amount of resource to be a bit better at autocompleting code doesn't have value to me. I want it to solve significant problems, and it's looking like it can't do it and scaling it to be able to is totally impractical.

> In aggregate, training all 9 Code Llama models required 400K GPU hours of computation on hardware of type A100-80GB (TDP of 350-400W).

That is: * 45⅔ GPU years * 160 MWh or... * 45 average UK homes annual electric consumption * 18 average US homes * 64 average drivers annual milage in an EV.

...and that's just the GPUs. Add on all the rest of the system (s).

Re: Stable Code 3B: Coding on the Edge

#124
post #56

Don’t entirely understand Stability’s business model. They’ve been putting out a lot of models recently and Stable Diffusion was novel at the time, but now their models consistently seem to be somewhat second rate compared to other things out there. For example Midjourney now seems to have far surpassed them in the image generation front. After raising a ton of funding Stability seems to just be throwing a bunch of s…

>Midjourney now seems to have far surpassed them in the image generation front.

What? Have you actually used either? MJ is just a ultra-fine tuned model with a few layers to prevent stuff from looking bad. Stable Diffusion has their own 'single shot' version, maybe someone remembers it, I played with it for 1-2 hours. Everything looks great, but I want hyper specific stuff in my art and I'm never getting that with 1 shots.

Heck, I did a few flyers and used some icons I made with img2img + inpainting + controlnet. The work is completely stunning and scalable. That is never happening even at an individual level with MJ.

Re: Stable Code 3B: Coding on the Edge

#125

Earlier quoted context omitted.

Midjourney is decidedly underwhelming if you've spent any time using the expansive tooling and control nets of Stable Diffusion. Yes, it's easy to get impressive first gens with MJ, but all of the coolest work and integration happening is using SD.

It depends. For great looking pics that you need to get out quickly MJ does a great job. Especially with its image + text feature. Dalle is also an interesting choice. SDXL and controlnet is odd a lot of the time. 1.5 + controlnet still seem to give quicker and better results. Basically SD atleast seems to be for when you want unique content. MJ/Dalle for everything else.

Forgive me for not remembering the name. Stable Diffusion also has an MJ style where you just say what you want and it makes beautiful piutures.

You cant customize basically anything but they look great.

Re: Stable Code 3B: Coding on the Edge

#127
post #77
post #56

Don’t entirely understand Stability’s business model. They’ve been putting out a lot of models recently and Stable Diffusion was novel at the time, but now their models consistently seem to be somewhat second rate compared to other things out there. For example Midjourney now seems to have far surpassed them in the image generation front. After raising a ton of funding Stability seems to just be throwing a bunch of s…

Business model is bundling so you have a one stop shop for good quality models of every modality and cultural variants of them. These go on bedrock, on chip, on prem etc and our consulting partners take them to the end user. On the innovation side stable diffusion turbo does like 100 cats with hats per second and the video model outperforms runway, pika etc on blind tests. Stable audio was one of the time innovation…

> On the innovation side stable diffusion turbo does like 100 cats with hats per second

2028: Energy use on hat-cat generation exceeds energy use on bitcoin.

Re: Stable Code 3B: Coding on the Edge

#128
post #14

It's quite amazing - I often find that I read quite positive comments towards LLM tools for coding. Yet, an "Ask HN" I posted a while ago (and which admittedly didn't gain much traction) seemed to mirror mostly negative/pessimistic responses. https://news.ycombinator.com/item?id=38803836 Was it just that my submission didn't find enough / more balanced commenters?

If somebody can show me a coding task that LLMs have successfully done that isn't an interview question or a documentation snippet, I might start to value it. Spending huge amount of resource to be a bit better at autocompleting code doesn't have value to me. I want it to solve significant problems, and it's looking like it can't do it and scaling it to be able to is totally impractical. > In aggregate, training all…

In the grand scheme of things it's ancient history, but https://code-as-policies.github.io/ works by generating code then executing it. That's worth running at. The code generation in that paper was done on code-davinci-002, which is (or rather was - it's deprecated) a 15B GPT-3 model. I've not done it yet, but I'd expect the open source 7B code completion models to be able to replicate it by now.

Re: Stable Code 3B: Coding on the Edge

#129

Earlier quoted context omitted.

It depends. For great looking pics that you need to get out quickly MJ does a great job. Especially with its image + text feature. Dalle is also an interesting choice. SDXL and controlnet is odd a lot of the time. 1.5 + controlnet still seem to give quicker and better results. Basically SD atleast seems to be for when you want unique content. MJ/Dalle for everything else.

Forgive me for not remembering the name. Stable Diffusion also has an MJ style where you just say what you want and it makes beautiful piutures. You cant customize basically anything but they look great.

You might be thinking of Fooocus: https://github.com/lllyasviel/Fooocus

The Stable Diffusion web interface that got a lot of people's attention originally was Automatic1111: https://github.com/AUTOMATIC1111/stable-diffusion-webui

Fooocus is definitely more beginner friendly. It does a lot of the prompt engineering for you. Automatic1111 has a ton of plugins, most notably ControlNet which gives you fine grained control over the images, but there is a learning curve.

Re: Stable Code 3B: Coding on the Edge

#130

Earlier quoted context omitted.

Not sure if this is where your head is, but I think there's a lot of value in integrating LLMs directly into complex software. Jira, Salesforce, maybe K8s - should all have an integrated LLMs that can walk you through how to perform a nuanced task in the software.

Why would the LLM walk you through and not just do the nuanced task on its own?

IMO, for many real business use cases, the hallucinations are still a big deal. Once we have models that are more reliable, I think it makes sense to go down that path - the AI is the interface to the software.

But until we're there, a system that just provides guidance that the user can validate is a good stepping stone - and one I suspect is immediately feasible!

Post reply on HN