Meta wants its open source AI model to be as capable as OpenAI’s best model
1–10 of 62 posts
Re: Meta wants its open source AI model to be as capable as OpenAI’s best model
#2In terms of making something that could beat a turing test the 65B/70B llama1/2 already are better than openai's currently offered models like gpt3.5-turbo or even the currently available output from gpt3.5 text-davinci-003. They've been so heavily "aligned" that they're insufferable and "As a large language model," everything even given an extensive pre-prompt in text completion mode. It wasn't always this way. Back in March text-davinci-003 or even better, code-davinci-002 were shocking capable and human like in their output. If openai released with the models they have today back at original release I'm not sure there'd be any hype.
The 65B/70B llama1/2 are not nearly as smart but their raw output can actually pass for a human. Hopefully Facebook has seen all the talk about training small models far beyond the previously assumed token limits (~20*num parameters training tokens) and will adjust the cosine learning rate back to llama 1 style for llama 3 7B's training run.
Re: Meta wants its open source AI model to be as capable as OpenAI’s best model
#3Meta's model isn't open source (and neither is "Open"AI's, hilariously). It's free to use for most purposes but we don't know what data or algorithms they used to train it. Regardless, I'm excited for these companies to eat each other with the result being free software. It's the very least they can do given all the data that had to be stolen to build these.
Re: Meta wants its open source AI model to be as capable as OpenAI’s best model
#4Anything to compete against the cloud AI models and instead run them locally for $0 for free on your own machine and anyone who is able to build such models has a moat such as Meta and is at the finish line in the AI race to zero.
At this point it is unstoppable and $0 free local AI models will only accelerate and OpenAI and Google knows it.
Re: Meta wants its open source AI model to be as capable as OpenAI’s best model
#5The Kremlin and the CCP send their thanks.
The implication here is that I support AI safety.
These tools will be used against The West.
Re: Meta wants its open source AI model to be as capable as OpenAI’s best model
#6In terms of making something that could beat a turing test the 65B/70B llama1/2 already are better than openai's currently offered models like gpt3.5-turbo or even the currently available output from gpt3.5 text-davinci-003. They've been so heavily "aligned" that they're insufferable and "As a large language model," everything even given an extensive pre-prompt in text completion mode. It wasn't always this way. Back…
Call me when it can compete with GPT-4. It continues to astound me.
Re: Meta wants its open source AI model to be as capable as OpenAI’s best model
#7As the Socrates said, one must commoditize the complement.
Re: Meta wants its open source AI model to be as capable as OpenAI’s best model
#8I'm not sure sure what OpenAIs play could possibly be at this point.
There will soon be models as powerful as GPT4 freely available for anyone to use, available in around 6 months or so. (At least that's what Meta is claiming)
And even better (and worse for open AI) they will be unaligned models, without nearly as many restrictions as openAI puts on theirs.
What's their next play? Hope GPT5 is another order of magnitude better? Seems unlikely to me.
And on the legislation front, openAIs efforts to engage in regulatory capture simply aren't going fast enough.
The government isn't going to ban open source in 6 months. So when LLAMA 3 is released, the cat is out of the bag, and there is no putting it back in..
Re: Meta wants its open source AI model to be as capable as OpenAI’s best model
#9The Kremlin and the CCP send their thanks. The implication here is that I support AI safety. These tools will be used against The West.
That's fine with me. I bet your favorite state-scale boogeyman uses all sorts of FOSS software, it's hardly an indictment against open tooling.
Re: Meta wants its open source AI model to be as capable as OpenAI’s best model
#10I'm not sure sure what OpenAIs play could possibly be at this point. There will soon be models as powerful as GPT4 freely available for anyone to use, available in around 6 months or so. (At least that's what Meta is claiming) And even better (and worse for open AI) they will be unaligned models, without nearly as many restrictions as openAI puts on theirs. What's their next play? Hope GPT5 is another order of magnit…
I'll take bets on GPT4 models being available, free, 6 months from now.
They're not up to ChatGPT yet and GPT4 is worlds beyond
ex. last night I ran ChatGPT and GPT4 on USMLE Step 2, 120 Qs, 60% vs. 85%