Live data from Hacker News

Fork of Facebook’s LLaMa model to run on CPU

github.com

91–100 of 178 posts

Re: Fork of Facebook’s LLaMa model to run on CPU

#91
post #41

Earlier quoted context omitted.

One day we'll find out that all of the VR, crypto, and maybe now AI bubbles were nothing but conspiracies being driven by big-GPU to keep their share price up.

Speaking for myself, I have already gotten more use out of 2 weeks of chatgpt than I have out of 16 years of Bitcoin

Which is just what I'd expect to read on an influential tech forum if grandparent was in fact right.

Re: Fork of Facebook’s LLaMa model to run on CPU

#92

Earlier quoted context omitted.

Which is a good thing. So glad all that GPU compute is being used on cool stuff rather than running SHA-256 18 quintillion times

They can’t both be cool?

Only if you really like big numbers for the sake of them. Otherwise, one is just straight up snake oil[0], and the other… is kinda hard to tell yet, because while I'm really impressed, I don't know if it's {a toy, a tool, the first sign of a major transformation}.

[0] did you know the original snake oils contains more omega-3 and therefore improves cognitive function when compared to lard? I did not. But you can get omega-3 elsewhere, and the people who made the term synonymous with fraud didn't use those snakes, so…

Re: Fork of Facebook’s LLaMa model to run on CPU

#93

Earlier quoted context omitted.

One is a contest to waste the most resources, one has potential to actually have useful results

Why do you think Bitcoin does not have useful results?

Strictly speaking, the comment you're replying to doesn't say which of the two is a contest to waste resources and which has potential to have useful results.

Re: Fork of Facebook’s LLaMa model to run on CPU

#94
post #9

Unlike Stable Diffusion, I don't stumble upon people who actually use it. Are there examples of the output this can generate? What happens once you manage to run the model?

We just need some better GUIs

Stable Diffusion was in the same place as this in the same time frame of the model getting released. Its only been a few days.

Re: Fork of Facebook’s LLaMa model to run on CPU

#95
post #93

Earlier quoted context omitted.

Why do you think Bitcoin does not have useful results?

Strictly speaking, the comment you're replying to doesn't say which of the two is a contest to waste resources and which has potential to have useful results.

I assumed that this was doubling down on atleastoptimal’s view.

Re: Fork of Facebook’s LLaMa model to run on CPU

#96
post #15

The thing I like the most about the current AI wave is the pressure is putting on computing hardware. Yes, mobile phones with long battery lives are cool and all of that, but most cool things I like are locked behind huge computational requirements.

Agree. I work in robotics and we never have enough compute. I want to see us get to the point where the most advanced robot ever has all the compute it needs onboard, and that means huge growth in compute density and efficiency are needed.

That's genuinely surprising.

What sort of on-board compute do you typically have today?

Re: Fork of Facebook’s LLaMa model to run on CPU

#97

Earlier quoted context omitted.

Conda is gonna work much, much, much better for these kinds of applications, as that's what it's mostly used for, i.e. scientific/numerical computing with C/C++ dependencies.

Conda is an abomination that will download 4Gig of unnecessary shite and carelessly dump it into your system, thereby ruining your existing configuration in the process. Use it in a container or a VM unless you enjoy re-installing your system from scratch. Or better still, don't use it al all and let it wither away: these kind of braindead projects need to be put down with extreme prejudice.

Chill. Use Miniconda3 as a light alternative. Conda is unnecessary. I agree nobody should ever use Conda unless they are extreme noobs. We all have to start somewhere.

Re: Fork of Facebook’s LLaMa model to run on CPU

#98
post #74

Earlier quoted context omitted.

For most part of the 20th, a bulk of the energy humanity was able to extract was used for industrialization. Now it seems that a vast bulk of the energy being extracted will go towards computation.

The singularity and fusion power are probably interlinked because of this. Once one happens the other will and in either order.

Doubt it, unless you include solar as fusion, but then we've already got it.

Re: Fork of Facebook’s LLaMa model to run on CPU

#99
post #15

The thing I like the most about the current AI wave is the pressure is putting on computing hardware. Yes, mobile phones with long battery lives are cool and all of that, but most cool things I like are locked behind huge computational requirements.

John Hopkins are working on organoids that will replace silicon GPUs for AI.

As is one of the YouTubers I follow.

Meatcubator: https://youtu.be/Z_ZGq8Tah0k

Growing human brain cells: https://youtu.be/V2YDApNRK3g

Re: Fork of Facebook’s LLaMa model to run on CPU

#100

Earlier quoted context omitted.

One is a contest to waste the most resources, one has potential to actually have useful results

Why do you think Bitcoin does not have useful results?

Can you cite an useful result? I can't but I don't think that some people getting richer is useful.
Post reply on HN