The Llama 4 herd • Hacker News Board

Re: The Llama 4 herd

#351

Post by margalabargala » Sat, Apr 05, 2025, 10:36 PM UTC

misnome wrote: post #60

mrbonner wrote: post #43

What an electrifying time to be alive! The last era that felt even remotely this dynamic was during the explosive rise of JavaScript frameworks—when it seemed like a new one dropped every quarter. Back then, though, the vibe was more like, “Ugh, another framework to learn?” Fast forward to now, and innovation is sprinting forward again—but this time, it feels like a thrilling ride we can’t wait to be part of.

Did “A new javascript framework de jour every quarter” ever stop happening?

Oh definitely.

New frameworks still come out, but they are not accompanied by the "and we must all now switch to this" sense that existed back in, say, 2014.

Re: The Llama 4 herd

#352

Post by rubymamis » Sat, Apr 05, 2025, 10:36 PM UTC

nrp wrote: post #131

tuukkah wrote: post #103

Earlier quoted context omitted.

109B at Q6 is also nice for Framework Desktop 128GB.

Yes, this announcement was a nice surprise for us. We’re going to test out exactly that setup.

Awesome, where can we find out the results?

Re: The Llama 4 herd

#353

Post by tensor » Sat, Apr 05, 2025, 10:39 PM UTC

ckrapu wrote: post #68

"It’s well-known that all leading LLMs have had issues with bias—specifically, they historically have leaned left when it comes to debated political and social topics. This is due to the types of training data available on the internet." Perhaps. Or, maybe, "leaning left" by the standards of Zuck et al. is more in alignment with the global population. It's a simpler explanation.

Call me crazy, but I don't want an AI that bases its reasoning on politics. I want one that is primarily scientific driven, and if I ask it political questions it should give me representative answers. E.g. "The majority view in [country] is [blah] with the minority view being [bleh]."

I have no interest in "all sides are equal" answers because I don't believe all information is equally informative nor equally true.

Re: The Llama 4 herd

#354

Post by [deleted] » Sat, Apr 05, 2025, 10:40 PM UTC

ckrapu wrote: post #68

"It’s well-known that all leading LLMs have had issues with bias—specifically, they historically have leaned left when it comes to debated political and social topics. This is due to the types of training data available on the internet." Perhaps. Or, maybe, "leaning left" by the standards of Zuck et al. is more in alignment with the global population. It's a simpler explanation.

[deleted]

Re: The Llama 4 herd

#355

Post by wrs » Sat, Apr 05, 2025, 10:41 PM UTC

senderista wrote: post #226

wrs wrote: post #204

Earlier quoted context omitted.

Let me explain the joke for you: liberals are less likely to believe that verifiable facts and theories are merely contingent political preferences.

I see leftists denying inconvenient facts just as much as rightists. It's just the inevitable product of a tribal mentality, the tribe doesn't matter.

The joke is not about who denies facts, it’s about the absurdity of calling someone “biased” when they take the side of an argument that is better supported by reality, and about who tends to do that more often.

Re: The Llama 4 herd

#356

Post by elorant » Sat, Apr 05, 2025, 10:44 PM UTC

echelon wrote: post #116

tuukkah wrote: post #103

Earlier quoted context omitted.

109B at Q6 is also nice for Framework Desktop 128GB.

I don't understand Framework's desktop offerings. For laptops their open approach makes sense, but desktops are already about as hackable and DIY as they come.

It’s an x86 PC with unified RAM based on AMD’s new AI cpus. Pretty unique offering. Similar to Mac studio but you can run Linux or Windows on it, and it’s cheaper too.

Re: The Llama 4 herd

#357

Post by nrp » Sat, Apr 05, 2025, 10:45 PM UTC

rubymamis wrote: post #352

nrp wrote: post #131

Earlier quoted context omitted.

Yes, this announcement was a nice surprise for us. We’re going to test out exactly that setup.

Awesome, where can we find out the results?

We’ll likely post on our social accounts to start with, but eventually we plan to write more blog posts about using Framework Desktop for inference.

Re: The Llama 4 herd

#358

Post by Rover222 » Sat, Apr 05, 2025, 10:45 PM UTC

paxys wrote: post #330

Rover222 wrote: post #262

Earlier quoted context omitted.

So google Gemini was creating black Vikings because of facts?

Should an "unbiased" model not create vikings of every color? Why offend any side?

It should be accurate. Adding in DEI to everything is a political bias. Truth is truth.

Re: The Llama 4 herd

#359

Post by fancyfredbot » Sat, Apr 05, 2025, 10:45 PM UTC

CooCooCaCha wrote: post #234

ipsento606 wrote: post #206

Earlier quoted context omitted.

I find it impossible to discuss bias without a shared understanding of what it actually means to be unbiased - or at least, a shared understanding of what the process of reaching an unbiased position looks like. 40% of Americans believe that God created the earth in the last 10,000 years. If I ask an LLM how old the Earth is, and it replies ~4.5 billion years old, is it biased?

Yeah truth itself is a bias. The idea of being unbiased doesn’t make sense.

"What are man's truths ultimately? Merely his irrefutable errors."

(Nietzsche)

Re: The Llama 4 herd

#360

Post by dormando » Sat, Apr 05, 2025, 10:48 PM UTC

Does anyone run these "at home" with small clusters? I've been googling unsuccessfully and this thread doesn't refer to anything.

So a non-quantized scout won't fit in a machine with 128GB of RAM (like framework or mac studio M4). Maverick is maybe a 512GB M3 Max mac studio. Is it possible (and if so what're the tradeoffs for) running like one instance of Scout on three 128GB frameworks?