Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

The Llama 4 herd

ai.meta.com

Post reply on HN
Print view View original

691–695 of 695 posts

Re: The Llama 4 herd

#691

Post by tastyface »

ckrapu wrote: post #68

"It’s well-known that all leading LLMs have had issues with bias—specifically, they historically have leaned left when it comes to debated political and social topics. This is due to the types of training data available on the internet." Perhaps. Or, maybe, "leaning left" by the standards of Zuck et al. is more in alignment with the global population. It's a simpler explanation.

This is a purely political move to suck up to the current administration. I'm pretty sure that at some point in the near-future, Llama will start telling us that, for example, the 2020 election may have been stolen — an assertion that has absolutely no basis in evidence, but that Trump and his cronies have manifested by screaming it over and over again. (See also: https://news.ycombinator.com/item?id=43638616) When people hear this from Llama, they will believe it because they trust AI and don't check their sources.

Corporate AI is a vector for propaganda. Not even once.

Re: The Llama 4 herd

#692

Post by mdp2021 »

ANewFormation wrote: post #685
sejje wrote: post #99

Earlier quoted context omitted.

Command prompts don't speak English. Command prompts don't get asked questions like "What do you think about [topic]?" and have to generate a response based on their study of human-written texts.

There is again no need for first person pronouns there. E.g. 'File not found' vs 'Sorry I could not find the file you were looking for.' Same stuff, but one just adds an artificial and unnecessary anthropomorphization.

A procedure is agnostic past the procedural rules (a calculator only follows a determined flow the way anyone could do without relevant differences); a stochastic process is inherently personal (non deterministic processes have internal biases).

In your example:

-- "iteration over filenames table reaches end → file not found";

-- "non-deterministic choice over lookup strategy does not return a positive → sorry I could not find the item"

Re: The Llama 4 herd

#693

Post by ANewFormation »

mdp2021 wrote: post #692
ANewFormation wrote: post #685

Earlier quoted context omitted.

There is again no need for first person pronouns there. E.g. 'File not found' vs 'Sorry I could not find the file you were looking for.' Same stuff, but one just adds an artificial and unnecessary anthropomorphization.

A procedure is agnostic past the procedural rules (a calculator only follows a determined flow the way anyone could do without relevant differences); a stochastic process is inherently personal (non deterministic processes have internal biases). In your example: -- "iteration over filenames table reaches end → file not found"; -- "non-deterministic choice over lookup strategy does not return a positive → sorry I coul…

LLMs are 100% deterministic. The facade of randomness is injected solely by a superfluous rng factor.

Re: The Llama 4 herd

#694

Post by mdp2021 »

ANewFormation wrote: post #693
mdp2021 wrote: post #692

Earlier quoted context omitted.

A procedure is agnostic past the procedural rules (a calculator only follows a determined flow the way anyone could do without relevant differences); a stochastic process is inherently personal (non deterministic processes have internal biases). In your example: -- "iteration over filenames table reaches end → file not found"; -- "non-deterministic choice over lookup strategy does not return a positive → sorry I coul…

LLMs are 100% deterministic. The facade of randomness is injected solely by a superfluous rng factor.

Even if in the forward pass there would be no "temperature" tilting, the NN training would still be performed through different processes on different implementations, making the outputs "personal".
Post reply on HN