Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Snowflake Arctic Instruct (128x3B MoE), largest open source model

replicate.com

Post reply on HN
Print view View original

221–224 of 224 posts

Re: Snowflake Arctic Instruct (128x3B MoE), largest open source model

#221

Post by hnthrowaway9812 »

andy99 wrote: post #192
hnthrowaway9812 wrote: post #186

Earlier quoted context omitted.

You've nerdsniped me so hard that I had to make an account. There are DOZENS of orgs releasing foundational models, not "a handful." Salesforce, EleuthierAI, NVIDIA, Amazon, Stanford, RedPajama, Cohere, Mistral, MosaicML, Yandex, Huawei StabilityLM, ... https://docs.google.com/spreadsheets/d/1kT4or6b0Fedd-W_jMwYp... It's completely bonkers and a huge waste of resources. Most of them will see barely any use at all.

Competition isn't a waste of resources, it's the best mechanism we have to ensure quality. Furthermore, I'm happy to be in a golden age with lots of orgs trying things and many options. It's going to suck once the market eventually consolidates us and we have to take whatever enshittified thing the ologopolists feed us.

It's a wast if they are mostly all trying the SAME things. Which is mostly what is happening.

I want someone to spend a million on a Chess LLM so we can get a sense of how sophisticated they can get at non-linguistic pattern matching.

I want someone to spend a million on an LLM trained on Python program traces so we can try to teach it cause and effect and "debugging". Maybe it will emulate a Python interpreter and get highly reliable at predicting the outcome of Python code.

etc.

Re: Snowflake Arctic Instruct (128x3B MoE), largest open source model

#222

Post by hnthrowaway9812 »

lhl wrote: post #205
hnfong wrote: post #203

Earlier quoted context omitted.

Very nice! This list is super convenient for LLM “connoisseurs”(?) like me. Did you have a script to generate it or was it manually done?

Just spotted this link. Just to clarify, I (not the original poster, although everyone's welcome to share this link, it's a public doc) maintain this list (and the rest of the sheet) manually. While I keep the foundation models that I'm interested in fairly up to date, obviously there are too many fine-tunes/datasets to track now. I started this when LLaMA was first released and I was getting myself up to speed on th…

Thanks for this spreadsheet! It's amazing!

Re: Snowflake Arctic Instruct (128x3B MoE), largest open source model

#223

Post by motoxpro »

vessenes wrote: post #127

Interesting architecture. For these "large" models, I'm interested in synthesis, fluidity, conceptual flexibility. A sample prompt: "Tell me a love story about two otters, rendered in the FORTH language". Or: "Here's a whitepaper, write me a simulator in python that lets me see the state of these variables, step by step". Or: "Here's a tarball of a program. Write a module that does X, in a unified diff." These are su…

What your evaluating is not what you think it is. You're evaluating the models ability to execute multiple complex steps (think about all of the steps it takes for your second example) not so much if it is capable of doing those things. If you broke it down into 2-3 different prompts it could do all of those things easy.

Re: Snowflake Arctic Instruct (128x3B MoE), largest open source model

#224

Post by buttaphingas »

BPA0 wrote: post #217
richardw wrote: post #169

Earlier quoted context omitted.

It diminishes the story that Databricks is the default route to privately trained models on your own data. Databricks jumped on the LLM bandwagon really quickly to good effect. Now every enterprise must at least consider Snowflake, and especially their existing clients who need to defend decisions to board members. It also means they build large scale rails necessary to use Snowflake for training and can market such…

I don't think that you understand Databricks. Databricks gives you the tools to train, tune or build RAG models. Snowflake doesn't. Having said that, I'm a big fan of Llama-3 at the moment.

Snowflake has some examples of that: https://www.snowflake.com/blog/easy-secure-llm-inference-ret... https://quickstarts.snowflake.com/guide/asking_questions_to_... And I assume these new models would be now available for embedding. Is this different to what Databricks offers?
Post reply on HN