Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Snowflake Arctic Instruct (128x3B MoE), largest open source model

replicate.com

Post reply on HN
Print view View original

21–30 of 224 posts

Re: Snowflake Arctic Instruct (128x3B MoE), largest open source model

#21

Post by WhitneyLand »

blackeyeblitzar wrote: post #4

Let’s stop using terms like open source falsely. The model isn’t open source, it is open weights. It’s good that the license for the weights is Apache, but for this model to be “truly open” they must release training data and source code under an OSI approved license. Otherwise it’s just misleading marketing. So far it seems like Snowflake will release some blog posts and “cookbooks”, whatever that means, but not act…

What’s the problem? This is what it says on their repo home page.

—————

Truly Open: Apache 2.0 license provides ungated access to weights and code. In addition, we are also open sourcing all of our data recipes and research insights.

Re: Snowflake Arctic Instruct (128x3B MoE), largest open source model

#22

Post by jerrygenser »

blackeyeblitzar wrote: post #4

Let’s stop using terms like open source falsely. The model isn’t open source, it is open weights. It’s good that the license for the weights is Apache, but for this model to be “truly open” they must release training data and source code under an OSI approved license. Otherwise it’s just misleading marketing. So far it seems like Snowflake will release some blog posts and “cookbooks”, whatever that means, but not act…

> they must release training data and source code under an OSI approved license

The source code is also apache 2.0

Re: Snowflake Arctic Instruct (128x3B MoE), largest open source model

#23

Post by mike_hearn »

ur-whale wrote: post #17

However big it may be, it still hallucinates very, very badly. I just asked it an economics question and asked it to cite its sources. All the links provided as sources were complete BS. Color me unimpressed.

It's intended for SQL generation and similar with cheap fine tuning and inference, not answering general knowledge questions. Their blog post is pretty clear about that. If you just want a chatbot this isn't the model for you. If you want to let non-SQL trained people ask questions of your data, it might be really useful.

Re: Snowflake Arctic Instruct (128x3B MoE), largest open source model

#25

Post by cs702 »

cornholio wrote: post #14
cs702 wrote: post #2

Wow, 128 experts in a single model. That's a lot more than everyone else. The Snowflake team has a blog post explaining why they did that: https://www.snowflake.com/blog/arctic-open-efficient-foundat... But the most interesting aspect about this, for me, is that every tech company seems to be coming out with a free open model claiming to be better than the others at this thing or that thing. The number of choices is…

The model seems to be " build something fast, get users, engagement, and venture capital, hope you can grow fast enough to still be around after the Great AI cull ". > offers over 0.6 million different pretrained open models. One estimate I saw was that training GPT3 released 500 tons of CO2 back in 2020. Out of those 600k models, at least hundreds are of a comparable complexity. I can only hope building large models…

> "build something fast, get users, engagement, and venture capital, hope you can grow fast enough to still be around after the Great AI cull"

Snowflake is a publicly traded company with a market cap of $50B and $4B of cash in hand. It has no need for venture capital money.

It looks like a case of "Look Ma! I can do it too!"

Re: Snowflake Arctic Instruct (128x3B MoE), largest open source model

#26

Post by ReptileMan »

cornholio wrote: post #14
cs702 wrote: post #2

Wow, 128 experts in a single model. That's a lot more than everyone else. The Snowflake team has a blog post explaining why they did that: https://www.snowflake.com/blog/arctic-open-efficient-foundat... But the most interesting aspect about this, for me, is that every tech company seems to be coming out with a free open model claiming to be better than the others at this thing or that thing. The number of choices is…

The model seems to be " build something fast, get users, engagement, and venture capital, hope you can grow fast enough to still be around after the Great AI cull ". > offers over 0.6 million different pretrained open models. One estimate I saw was that training GPT3 released 500 tons of CO2 back in 2020. Out of those 600k models, at least hundreds are of a comparable complexity. I can only hope building large models…

>One estimate I saw was that training GPT3 released 500 tons of CO2 back in 2020

So absolute nothing in the grand scheme of things?

Re: Snowflake Arctic Instruct (128x3B MoE), largest open source model

#27

Post by throwup238 »

ReptileMan wrote: post #26
cornholio wrote: post #14

Earlier quoted context omitted.

The model seems to be " build something fast, get users, engagement, and venture capital, hope you can grow fast enough to still be around after the Great AI cull ". > offers over 0.6 million different pretrained open models. One estimate I saw was that training GPT3 released 500 tons of CO2 back in 2020. Out of those 600k models, at least hundreds are of a comparable complexity. I can only hope building large models…

>One estimate I saw was that training GPT3 released 500 tons of CO2 back in 2020 So absolute nothing in the grand scheme of things?

Yeah that’s the annual emissions for only 100 people at the global average or about 30 Americans.

Re: Snowflake Arctic Instruct (128x3B MoE), largest open source model

#29

Post by ko27 »

blackeyeblitzar wrote: post #4

Let’s stop using terms like open source falsely. The model isn’t open source, it is open weights. It’s good that the license for the weights is Apache, but for this model to be “truly open” they must release training data and source code under an OSI approved license. Otherwise it’s just misleading marketing. So far it seems like Snowflake will release some blog posts and “cookbooks”, whatever that means, but not act…

You have a weird definition of open source. OS software developers don't release the books they have read or the tools they've used to write code.

This is fully 100% OSI compliant source code with an approved license (Apache 2.0). You are not entitled to anything more than this.

Re: Snowflake Arctic Instruct (128x3B MoE), largest open source model

#30

Post by dantheman »

blackeyeblitzar wrote: post #4

Let’s stop using terms like open source falsely. The model isn’t open source, it is open weights. It’s good that the license for the weights is Apache, but for this model to be “truly open” they must release training data and source code under an OSI approved license. Otherwise it’s just misleading marketing. So far it seems like Snowflake will release some blog posts and “cookbooks”, whatever that means, but not act…

Why would they need to release the training data? that's nonsense.
Post reply on HN