71–80 of 178 posts
Earlier quoted context omitted.
Crazy to me that as soon as one GPU wave is dying (crypto), another one is picking up slack.
One day we'll find out that all of the VR, crypto, and maybe now AI bubbles were nothing but conspiracies being driven by big-GPU to keep their share price up.
The thing I like the most about the current AI wave is the pressure is putting on computing hardware. Yes, mobile phones with long battery lives are cool and all of that, but most cool things I like are locked behind huge computational requirements.
Crazy to me that as soon as one GPU wave is dying (crypto), another one is picking up slack.
Earlier quoted context omitted.
I tested on a decidedly above average CPU, and got several words per second on the 7B model. I'd guess maybe one word per second on a more average one?
Cool so we're back to the days of 2400 baud modems
Unlike Stable Diffusion, I don't stumble upon people who actually use it. Are there examples of the output this can generate? What happens once you manage to run the model?
Most gaming desktops have a solid gpu but not enough vram. Pity having the gpu idle here
> 1. Create a conda environment Uh-oh, bad start.
Why is it a bad start? It could be venv as well, I suppose, I haven't used conda.