StableLM Zephyr 3B

#1

Post by roborovskis » Thu, Dec 07, 2023, 6:10 PM UTC

StableLM Zephyr 3B
stability.ai

Re: StableLM Zephyr 3B

#2

Post by josh-sematic » Thu, Dec 07, 2023, 6:28 PM UTC

Note that it uses a non-commercial license. Still pretty cool though!

Re: StableLM Zephyr 3B

#3

Post by m3kw9 » Thu, Dec 07, 2023, 7:10 PM UTC

How would one go about making a .llamafile for this?

Re: StableLM Zephyr 3B

#4

Post by adamkochanowicz » Thu, Dec 07, 2023, 7:31 PM UTC

Can't wait for someone smarter than me to make this compatible with MLC on iPhone.

Re: StableLM Zephyr 3B

#5

Post by Reubend » Thu, Dec 07, 2023, 7:33 PM UTC

josh-sematic wrote: post #2

Note that it uses a non-commercial license. Still pretty cool though!

Yeah, I think this is a great release, but I also suspect that most people won't end up using it just because of the license. It's actually a lot more restrictive than what I would personally consider "commercial" usage:

> Non-Commercial Uses does not include any production use of the Software Products or any Derivative Works.

So even if you want to launch a free service using this, that's not allowed.

Re: StableLM Zephyr 3B

#6

Post by simonw » Thu, Dec 07, 2023, 7:36 PM UTC

"This model is being released under a non-commercial license that permits non-commercial use."

I'm very interested in high quality 3B models, but it's hard to get excited about this given the increasing array of commercially usable models.

Re: StableLM Zephyr 3B

#7

Post by [deleted] » Thu, Dec 07, 2023, 7:36 PM UTC

[deleted]

Re: StableLM Zephyr 3B

#8

Post by simonw » Thu, Dec 07, 2023, 7:37 PM UTC

m3kw9 wrote: post #3

How would one go about making a .llamafile for this?

Convert it to GGML and use a zip tool to add that to a llamafile package.

https://huggingface.co/TheBloke?search_models=Zephyr doesn't have a GGML for it yet but I wouldn't be surprised to see one by the end of the day.

Re: StableLM Zephyr 3B

#9

Post by brianjking » Thu, Dec 07, 2023, 7:41 PM UTC

simonw wrote: post #6

"This model is being released under a non-commercial license that permits non-commercial use." I'm very interested in high quality 3B models, but it's hard to get excited about this given the increasing array of commercially usable models.

Yeah, Replit is likely the best option out there for a 3B model size, right?

Re: StableLM Zephyr 3B

#10

Post by anigbrowl » Thu, Dec 07, 2023, 7:46 PM UTC

simonw wrote: post #6

"This model is being released under a non-commercial license that permits non-commercial use." I'm very interested in high quality 3B models, but it's hard to get excited about this given the increasing array of commercially usable models.

They have more fully open stuff in the pipeline. IMHO it's good that they put out stuff for hobbyists to play around with so that they're not immediately overtaken by people ready to deploy things at commercial scale.