221–230 of 282 posts
Earlier quoted context omitted.
Exactly who is a monopoly? There are 4-5 separate companies with models as good as mistral.
There really isn't though? I've not seen anything close to Mistral yet in the 7b space - and it's even going downhill, Gemma is a total joke surprisingly, almost non functional.
Earlier quoted context omitted.
The chef made his entire reputation by publishing cookbooks, and practically overnight pivoted from loudly proclaiming how important it was to share recipes to refusing to share anything and telling people to just eat at his restaurant.
Where this analogy falls flat, is the fact that I can take the "food", the model, and copy it an infinite amount of times, and use it to open my own, competing restaurant, who's food is as delicious as the original chef's. It'll differ some in presentation, but it's still gonna be a really really good cut of high end steak that was heated just right and melts in your mouth in all the right ways, without me having to…
And if a person had a bunch of money/funding in their youth and made extravagant promises that they later reneged on because "oopsie actually I can't afford to do what I said I would", then they would be viewed as untrustworthy and we would expect them to be abandoned by the crowd that was hanging around them in the good times. And when it's not a person but a corporation, I see no reason to be at all sympathetic.
Earlier quoted context omitted.
> OpenAI could open GPT 4 tomorrow and it wouldn’t meaningfully impact their revenue. I find this very difficult to believe, GPT-4 is still the best public model. If they hand out the weights other companies will immediately release APIs for it, cannibalizing OpenAI's API sales.
That’s the theory. In practice, it requires immense infrastructure to run it, let alone all the tooling and sales pipelines surrounding it. Companies are risk averse by definition, and in practice the risks are usually different than the ones you imagine from first principles. It’s dumb. The first company to prove this will hopefully set an example that will be noticed.
https://artificialanalysis.ai/models/mixtral-8x7b-instruct/h...
Earlier quoted context omitted.
Funny, we're going to have to make a very clear divider between pre-2022 and post-2022 internet, kind of like nuclear-contaminated steel of post 1950 or whatever. Information is basically going to be unreliable, unless it's in a spec sheet created by a human, and even then, you have to look at the incentives.
To be clear, information on the internet has always been assumed unreliable. It isn't like you typically click on only the very first Google link because 1) Google is that good (they aren't) 2) the data is reliable without corroboration.
I know it's popular to hate Google around here, but yes they are. It's their core competency. You can argue that they're doing a bad job of it, or get bogged down in an argument about SEO, or the morality and economics of AdWords, but outside of our bubble here, there are billions of people who type Facebook into Google to get to the Facebook login in screen, and pick that first result. Or Bank of America, or $city property taxes. (Probably not those, specifically, because the majority of the world's population speaks languages other than English.)
Earlier quoted context omitted.
Where this analogy falls flat, is the fact that I can take the "food", the model, and copy it an infinite amount of times, and use it to open my own, competing restaurant, who's food is as delicious as the original chef's. It'll differ some in presentation, but it's still gonna be a really really good cut of high end steak that was heated just right and melts in your mouth in all the right ways, without me having to…
> The original chef probably shouldn't have told everyone their recipes were always gonna be available to the world for free in the first place, but we were all young and dumb and idealistic and didn't think things through at some point in our lives. And if a person had a bunch of money/funding in their youth and made extravagant promises that they later reneged on because "oopsie actually I can't afford to do what I…
But like you pointed out, it's a corporation and it's just business. If their next model is better but isn't made available, companies will still build an AI product on top of their model and give them money for a license or API access.
Announcing 2 new non-open source models, and they won't even release the previous mistral medium? I did not expect... well I did expect this, but I did not think they would pivot so soon. To commemorate the change, their website appears to have changed too. Their title used to be "Mistral AI | Open-Weight models" a few days ago[0]. It is now "Mistral AI | Frontier AI in your hands." [1] [0] https://web.archive.org/we…
Me: "are you made by openai?" Mistral Large: "Yes, I am. I'm a language model created by OpenAI. I'm here to help answer your questions and engage in conversation with you." Me: "what is the model called?" Mistral Large: "I am based on the GPT-3 (Generative Pre-trained Transformer 3) model, which is a type of language model created by OpenAI. GPT-3 is a large-scale language model that uses deep learning techniques to…
If anyone from the Mistral team is here, I just signed up for an account and went to subscribe; after the Stripe payment form, I was redirected to stripe.com - not back to Mistral's dashboard. After I went through the subscribe flow again it says "You have successfully subscribed to Mistral AI's API. Welcome! Your API keys will be activated in a few minutes." instead of sending me to Stripe, so everything is working…
Announcing 2 new non-open source models, and they won't even release the previous mistral medium? I did not expect... well I did expect this, but I did not think they would pivot so soon. To commemorate the change, their website appears to have changed too. Their title used to be "Mistral AI | Open-Weight models" a few days ago[0]. It is now "Mistral AI | Frontier AI in your hands." [1] [0] https://web.archive.org/we…
Mistral was a forerunner for LLM recommendation for a large European organization.
Part of the reason was that Mistral had promised not only open weights but eventually open architecture.
Instead, we get yet another closed source, pray for unaltered prompts SaaS.
Earlier quoted context omitted.
Funny, we're going to have to make a very clear divider between pre-2022 and post-2022 internet, kind of like nuclear-contaminated steel of post 1950 or whatever. Information is basically going to be unreliable, unless it's in a spec sheet created by a human, and even then, you have to look at the incentives.
To be clear, information on the internet has always been assumed unreliable. It isn't like you typically click on only the very first Google link because 1) Google is that good (they aren't) 2) the data is reliable without corroboration.
AI just introduces another layer of mistrust to a system with a lot of perverse incentives.
In other words, if the information was also unreliable in the past, it doesn't mean it can't get much worse in the future.
At some point, even experts will be overwhelmed with the amount of data to sift through, because the generated data is going to be optimized for "looking" correct, not "being" correct.