31–40 of 178 posts
It's useless before the model gets instruction and preference tunings. Won't even follow a simple ask, it will just assume it is a list of questions and generate more, or continue with slightly related comments. FB trained a LLaMA-I (instruction tuned) variant for sports, just to show they can, but I don't think it got released.
Wondering how difficult this would be to get running on a m1 max?
Earlier quoted context omitted.
Pretty sure you wouldn’t see anyone using it commercially as IIRC it’s only public due to a leak.
I wasn't looking for a commercial use but its an Interesting point. Would it be possible to prove that someone is using it commercially? 1) Spin it up on a cluster in Belarus 2) ??? 3) Profit?
Earlier quoted context omitted.
Usually you just trivially have the model run on cpu or gpu by simply writing .cpu() at specific places, so he's wondering why this isn't the case here.
that's literally all I did (plus switching the tensor type). I'd imagine people are posting and upvoting this not because it's actually interesting code but rather just because it runs unexpectedly fast on consumer CPUs and it's not something they considered feasible before.
It's useless before the model gets instruction and preference tunings. Won't even follow a simple ask, it will just assume it is a list of questions and generate more, or continue with slightly related comments. FB trained a LLaMA-I (instruction tuned) variant for sports, just to show they can, but I don't think it got released.
Uh-oh, bad start.
Earlier quoted context omitted.
Crazy to me that as soon as one GPU wave is dying (crypto), another one is picking up slack.
[flagged]
Interest rates have far more impact on crypto than Bitcoin events.
Currently, crypto market trades closely with NASDAQ. Hopefully regulation will put an end to this.
The thing I like the most about the current AI wave is the pressure is putting on computing hardware. Yes, mobile phones with long battery lives are cool and all of that, but most cool things I like are locked behind huge computational requirements.
Earlier quoted context omitted.
I wasn't looking for a commercial use but its an Interesting point. Would it be possible to prove that someone is using it commercially? 1) Spin it up on a cluster in Belarus 2) ??? 3) Profit?
4) Lukashenka grabs your profits and kicks you out ;-)