11–20 of 62 posts
The Kremlin and the CCP send their thanks. The implication here is that I support AI safety. These tools will be used against The West.
That's fine with me. I bet your favorite state-scale boogeyman uses all sorts of FOSS software, it's hardly an indictment against open tooling.
LLMs will at least be a very valuable tool for people to use. Having an LLM that is aligned to their values and their desires instead of to either the values of a corporation or state us vitally important.
Meta's model isn't open source (and neither is "Open"AI's, hilariously). It's free to use for most purposes but we don't know what data or algorithms they used to train it. Regardless, I'm excited for these companies to eat each other with the result being free software. It's the very least they can do given all the data that had to be stolen to build these.
Surely there's a better term for it, "open weights" or something?
As the Socrates said, one must commoditize the complement.
In terms of making something that could beat a turing test the 65B/70B llama1/2 already are better than openai's currently offered models like gpt3.5-turbo or even the currently available output from gpt3.5 text-davinci-003. They've been so heavily "aligned" that they're insufferable and "As a large language model," everything even given an extensive pre-prompt in text completion mode. It wasn't always this way. Back…
Anything to compete against the cloud AI models and instead run them locally for $0 for free on your own machine and anyone who is able to build such models has a moat such as Meta and is at the finish line in the AI race to zero. At this point it is unstoppable and $0 free local AI models will only accelerate and OpenAI and Google knows it.
The output will be significantly slower than what you’d get from GPT-3.5, so if your time is worth anything then that will be a huge factor that’s hard to calculate. Just assume everything will take about 3 times longer though.
If you amortize the cost of the 3090 for as long as you’d expect it to be relevant, you can estimate a rough monthly cost of the hardware. I’d give it just over a year at the current pace before you’d probably want a replacement. That’s about $50/mo.
Operation at commodity scale with the still significant lead OAI or Anthropic has on efficient operations has its advantages beyond just SOTA performance.
The Kremlin and the CCP send their thanks. The implication here is that I support AI safety. These tools will be used against The West.
That's fine with me. I bet your favorite state-scale boogeyman uses all sorts of FOSS software, it's hardly an indictment against open tooling.
Earlier quoted context omitted.
North Korea uses linux.
Cool, well then we may as well opensource the Columbia-class submarine design!