Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Facebook LLAMA is being openly distributed via torrents

github.com

Post reply on HN
Print view View original

611–620 of 719 posts

Re: Facebook LLAMA is being openly distributed via torrents

#611

Post by xg15 »

shadowgovt wrote: post #276
bentcorner wrote: post #224

Earlier quoted context omitted.

I posit to a friend that: a) As these AI constructs become more advanced (especially around memory and personalization), we will eventually be able to treat them as people b) Some business will eventually sell an off-the-shelf product (hardware and/or software) that is an AI you can bring into your home, that you can treat as a friend, confidant and partner c) Someone will eventually lose their AI friend of many mont…

At the end of the day, the Turing Test for establishment of AI personhood is weak for two reasons. 1. We're seeing more and more systems that get very close to passing the Turing Test but fundamentally don't register to people as "People." When I was younger and learned of Searle's Chinese Room argument, I naively assumed it wasn't a thought experiment we would literally build in my lifetime. 2. Humanity has a histor…

I think this has to do more with in/outgroups than with any objective criterion of "humanness". As you said, AI will have an extremely hard time arguing for personhood - because people will consider it extremely dangerous to let machines into our in-group. This doesn't mean they could sense an actual difference when they don't know it's a machine (what the Turing test is all about)

It's the same reason why everyone gets up in arms when an animal behaviour paper uses too much "anthropomorphizing" language - whereas no one has problems with erring on the other side and treating animals as overly simplistic.

Re: Facebook LLAMA is being openly distributed via torrents

#612

Post by [deleted] »

q1w2 wrote: post #304
aent wrote: post #32

For anyone wondering, it includes 4 models: 7/13/30/65 billion parameters, the smallest one is 14Gb, the largest one is 131GB, all four are 235Gb.

I wonder how many people are scrambling to set this up on their startup infra. 6x24GB NVRAM on 6 GPUs linked with NVSwitch is a little pricey, but totally doable.

[deleted]

Re: Facebook LLAMA is being openly distributed via torrents

#613

Post by cvccvroomvroom »

pavlov wrote: post #41

It’s interesting that these models are both massively expensive to produce and self-contained to a degree that you can distribute the end product in a torrent. This has not been the case for most commercial software for the past 20 years, during the cloud era. If you could steal a dump of random Facebook source code, it would be 99% useless because it’s so closely tied to the infrastructure. There’s almost nothing yo…

How are they produced?

There's an ass ton of hardware that might otherwise be idle.

Re: Facebook LLAMA is being openly distributed via torrents

#614

Post by landryraccoon »

skybrian wrote: post #469
shadowgovt wrote: post #276

Earlier quoted context omitted.

At the end of the day, the Turing Test for establishment of AI personhood is weak for two reasons. 1. We're seeing more and more systems that get very close to passing the Turing Test but fundamentally don't register to people as "People." When I was younger and learned of Searle's Chinese Room argument, I naively assumed it wasn't a thought experiment we would literally build in my lifetime. 2. Humanity has a histor…

The way people informally talk about "passing a Turing test" is a weak test, but the original imitation game isn't if the players are skilled. It's not "acting like a human". It's more like playing the Werewolf party game. Alice and Bob want to communicate, but the bot is attempting to impersonate Bob. Can Alice authenticate Bob? This depends on what sort of shared secrets they have. Obviously, if they agreed ahead o…

So I need to ask the obvious question, why does it make sense to play this game “to win”?

Throughout human history, humans have been making up shibboleths to distinguish the in group from the out group. You can use skin color, linguistic accents, favorite sports teams, religious dogma, and a million other criteria.

But why? Why even start there? If we are on the verge of true general artificial intelligence, why would you start from a presumption of prejudice, rather than judging on some set of ethical merits for personhood, such as empathy, intelligence, creativity, self awareness and so forth?

Is it that you assume there will be an “us verses them” battle, and you want the battle lines to be clearly drawn?

We seem to be quite ready for AGI as inferiors, incapable of preparing for AGIs as superiors, and unwilling to consider AGIs as equals.

Re: Facebook LLAMA is being openly distributed via torrents

#615

Post by javajosh »

thaumasiotes wrote: post #607
javajosh wrote: post #562

Earlier quoted context omitted.

My assessment for most of my life has been if most of the world's ~10k 'strategic' megaton-scale warheads exploded in air over Earth's major cities it would kick up enough dust to kill the sun for several years, which would kill off a large fraction of Earth's flora and fauna, akin to a major volcanic eruption or asteroid collision. There would still be life of the smaller sort, and deep in the oceans of course. Only…

That is an ephemeral change. It takes very little time for the biosphere to make a full recovery. You're talking about a small, brief, suppression of the biosphere. And you're calling it "destruction of the biosphere".

Yes, and when a forest burns down I call it the destruction of a forest even though it can grow back because that's how language is used.

Re: Facebook LLAMA is being openly distributed via torrents

#616

Post by dilyevsky »

dragonwriter wrote: post #610
dilyevsky wrote: post #609

Earlier quoted context omitted.

GCP spot price for A100 80g gpu is only $1.25 and they give you $300 of credit when you open a new acc

Unless its for something you want to happen whenever and don't mind be dumped in process, shouldn't we look at on-demand, not spot, prices?

It’s fine for testing it out or serving short queries. Your data can still remain on PV if the vm gets yanked

Re: Facebook LLAMA is being openly distributed via torrents

#617

Post by thaumasiotes »

javajosh wrote: post #615
thaumasiotes wrote: post #607

Earlier quoted context omitted.

That is an ephemeral change. It takes very little time for the biosphere to make a full recovery. You're talking about a small, brief, suppression of the biosphere. And you're calling it "destruction of the biosphere".

Yes, and when a forest burns down I call it the destruction of a forest even though it can grow back because that's how language is used.

Even if you're talking about the fires in Yellowstone in 1988, the only way to call that "destruction of the forest" is if you define the forest as being the trees. That's a defensible choice.

(And temperate forests "burn down" all the time as part of their normal operations.)

But you can't define the biosphere as "the species that go extinct in a particular scenario". You're stuck with the whole thing, which is not going to notice whatever humans do. It would make as much sense to call it "destruction of the biosphere" if I moved a rock thirty feet.

Re: Facebook LLAMA is being openly distributed via torrents

#618

Post by dilyevsky »

int_19h wrote: post #598
dmix wrote: post #230

Earlier quoted context omitted.

Reminds me of Ray Kurizwell's obsession with uploading brains to the cloud to get back his beloved father.

There's a related but very different take on this that was brought up by Wolfram in his recent article on ChatGPT: "As a personal comparison, my total lifetime output of published material has been a bit under 3 million words, and over the past 30 years I’ve written about 15 million words of email, and altogether typed perhaps 50 million words—and in just the past couple of years I’ve spoken more than 10 million word…

The ultimate echo chamber

Re: Facebook LLAMA is being openly distributed via torrents

#619

Post by [deleted] »

markasoftware wrote: post #602
TaylorAlexander wrote: post #529

Earlier quoted context omitted.

Following up. After rebooting in to GUI that was enough to get it to fit, I guess xorg just accumulated some cruft in my last boot. So I can run it alongside gnome. nvidia-smi reports this model is using 15475MiB after changing the max batch size from 32 to 8 (see link in above post) As others have stated someone may have injected unknown code in to the pickled checkpoint, so I recommend running this in docker. I use…

I was able to run 7B on a CPU, inferring several words per second: https://github.com/markasoftware/llama-cpu

[deleted]

Re: Facebook LLAMA is being openly distributed via torrents

#620

Post by Red_Leaves_Flyy »

int_19h wrote: post #597
krisoft wrote: post #517

Earlier quoted context omitted.

> If AI are sentient and we think they aren't… the term “zombie” was created by slaves in the Caribbean who were afraid that even death would not free them from their servitude. This would be the genuine existence of AI which were conscious but which we denied. That doesn't make any sense. In biological creatures you have sentience and self-preservation and yearning to be free all bundled in one big hairy ball. An AI…

You can condition humans to be happy about being enslaved, as well, especially if you raise them from a blank slate. I don't think most people would agree that it is ethical to do so, or to treat such people as slaves.

Citation needed
Post reply on HN