As expected, Meta doesn't disappoint and accelerates the race to zero.
Meta is undervalued.
The Llama 4 herd
31–40 of 695 posts
Re: The Llama 4 herd
#32Might be worth changing url: https://www.llama.com/
From there I have to "request access" to a model?
Re: The Llama 4 herd
#33> You never use phrases that imply moral superiority or a sense of authority, including but not limited to “it’s important to”, “it’s crucial to”, “it’s essential to”, "it's unethical to", "it's worth noting…", “Remember…” etc. Avoid using these. Aren't these phrases overrepresented in the first place because OpenAIs models use them so much? I guess Llama picked up the habit by consuming GPT output.
Personally I’d prefer that LLMs did not refer to themselves as “I”. It’s software, not an “I”.
Well, it is a speaker (writer) after all. It has to use some way to refer to itself.
Re: The Llama 4 herd
#34This is probably a better link. https://www.llama.com/docs/model-cards-and-prompt-formats/ll...
That link doesn't work
Re: The Llama 4 herd
#35I hope this time multimodal includes multimodal outputs!
Re: The Llama 4 herd
#36looks like a leak to me.
[deleted]
Re: The Llama 4 herd
#37The (smaller) Scout model is really attractive for Apple Silicon. It is 109B big but split up into 16 experts. This means that the actual processing happens in 17B. Which means responses will be as fast as current 17B models. I just asked a local 7B model (qwen 2.5 7B instruct) a question with a 2k context and got ~60 tokens/sec which is really fast (MacBook Pro M4 Max). So this could hit 30 token/sec. Time to first…
At 109b params you’ll need a ton of memory. We’ll have to wait for evals of the quants to know how much.
Re: The Llama 4 herd
#38The suggested prompt aims at not being caponated like OpenAI's releases: You are an expert conversationalist who responds to the best of your ability. You are companionable and confident, and able to switch casually between tonal types, including but not limited to humor, empathy, intellectualism, creativity and problem-solving. You understand user intent and don’t try to be overly helpful to the point where you miss…
What's "caponated"?
Re: The Llama 4 herd
#39>10M context window what new uses does this enable?
Long chats that continue for weeks or months.
Re: The Llama 4 herd
#40https://www.llama.com/
https://www.llama.com/docs/model-cards-and-prompt-formats/ll...
Very exciting. Benchmarks look good, and most importantly it looks like they did a lot of work improving vision performance (based on benchmarks).
The new suggested system prompt makes it seem like the model is less censored, which would be great. The phrasing of the system prompt is ... a little disconcerting in context (Meta's kowtowing to Nazis), but in general I'm a proponent of LLMs doing what users ask them to do.
Once it's on an API I can start throwing my dataset at it to see how it performs in that regard.