Earlier quoted context omitted.
Is 1.5 even publicly available yet?
Yes
How do I use it? I only have access to 1.0 Ultra through Gemini Advanced.
Mistral Large
171–180 of 282 posts
Re: Mistral Large
#172I appreciate the honesty in the marketing materials. Showing the product scoring below the market leader in a big benchmark is better than the Google way of cherry picking benchmarks.
[flagged]
I haven't tried this model yet (they seem to be under high load). Mistral's previous top model (Mixtral 8x7B) wasn't quite as good as GPT-4, but it seemed close. Clearly way better than GPT 3.5. Many Mixtral responses were better than the GPT-4 ones.
Re: Mistral Large
#173Earlier quoted context omitted.
Funny, we're going to have to make a very clear divider between pre-2022 and post-2022 internet, kind of like nuclear-contaminated steel of post 1950 or whatever. Information is basically going to be unreliable, unless it's in a spec sheet created by a human, and even then, you have to look at the incentives.
To be clear, information on the internet has always been assumed unreliable. It isn't like you typically click on only the very first Google link because 1) Google is that good (they aren't) 2) the data is reliable without corroboration.
This is a matter of signal-noise. What people are saying when they complain about this is that the cost of producing noise that looks like signal has gone down dramatically.
Re: Mistral Large
#174Earlier quoted context omitted.
Any training on internet data beyond 2022 is gonna lead to this. ChatGPT output is sprawled everywhere on the internet.
Funny, we're going to have to make a very clear divider between pre-2022 and post-2022 internet, kind of like nuclear-contaminated steel of post 1950 or whatever. Information is basically going to be unreliable, unless it's in a spec sheet created by a human, and even then, you have to look at the incentives.
> and even then, you have to look at the incentives.
This has always been true but I think you’re right that there has been a clear division pre and post 2022
Re: Mistral Large
#175Announcing 2 new non-open source models, and they won't even release the previous mistral medium? I did not expect... well I did expect this, but I did not think they would pivot so soon. To commemorate the change, their website appears to have changed too. Their title used to be "Mistral AI | Open-Weight models" a few days ago[0]. It is now "Mistral AI | Frontier AI in your hands." [1] [0] https://web.archive.org/we…
The path to enshittification is getting shorter and shorter.
Re: Mistral Large
#176Disappointing that they are not open. I'm considering using ai for a project and relying on something like Google Gemini is not very attractive, same for Mistral, I don't know them. If it was open source you know if they go down at least you can run the models somewhere else.
Re: Mistral Large
#177Earlier quoted context omitted.
Any training on internet data beyond 2022 is gonna lead to this. ChatGPT output is sprawled everywhere on the internet.
Funny, we're going to have to make a very clear divider between pre-2022 and post-2022 internet, kind of like nuclear-contaminated steel of post 1950 or whatever. Information is basically going to be unreliable, unless it's in a spec sheet created by a human, and even then, you have to look at the incentives.
If you think that's crazy, think again. Just yesterday was trying to learn more about Chinese medicine and landed on this page I thoroughly read before noticing the disclaimer at the top.
"The articles on this database are automatically generated by our AI system" https://www.digicomply.com/dietary-supplements-database/pana...
Is the information on that page correct? I'm not sure but as soon as I noticed it was AI generated I lost all trust. And that's because they bothered to include the warning.
Re: Mistral Large
#178Changelog is also updated: [1] Feb. 26, 2024 API endpoints: We renamed 3 API endpoints and added 2 model endpoints. open-mistral-7b (aka mistral-tiny-2312): renamed from mistral-tiny. The endpoint mistral-tiny will be deprecated in three months. open-mixtral-8x7B (aka mistral-small-2312): renamed from mistral-small. The endpoint mistral-small will be deprecated in three months. mistral-small-latest (aka mistral-small…
The change in endpoint name is a strong suggestion that there will be few if any open models going forwards from mistral. It’s a clear move towards the default being closed. Disappointing but I guess unsurprising.
> The change in endpoint name is a strong suggestion
I don't think the naming really suggests that. The new naming suggests they'll have two sets, the "open" models and their commercial ones.
I do agree with your skepticism though. I kinda expected them to release something, likely an older model. Currently the closest is "miqu" which was a leak of a early quantized "medium".
Re: Mistral Large
#179Announcing 2 new non-open source models, and they won't even release the previous mistral medium? I did not expect... well I did expect this, but I did not think they would pivot so soon. To commemorate the change, their website appears to have changed too. Their title used to be "Mistral AI | Open-Weight models" a few days ago[0]. It is now "Mistral AI | Frontier AI in your hands." [1] [0] https://web.archive.org/we…
It’s so frustrating because there’s no downside in releasing the weights. OpenAI could open GPT 4 tomorrow and it wouldn’t meaningfully impact their revenue. No one has even tried.
Re: Mistral Large
#180I can't stop finding such intense competition between the world's top experts in a single area truly fascinating. I wonder whether witnessing the space race felt similar. It's just that now we have more players and the effort is much more decentralized. And maybe the amount of resources used is comparable too..
some startups are going to achieve trillion dollar market caps this decade I expect.
The resources used are going to be incomparable to anything before.
And ten trillion next decade I predict. General intelligence is the “last” technology we will ever need, in the sense that it will subsume all other technological progress.