251–260 of 282 posts
I haven't been able to get a great answer regarding why OpenAI is consistently leading the pack. What could they possibly be doing different? I can't imagine they've invented a technique that nobody else can reach at this point
Earlier quoted context omitted.
The community needs to train its own models, but I don't see any of that happening. Having the source text would be a huge advantage for research and education, but it feels totally out of reach. It's funny how people are happy to donate to OpenAI, that immediately close up at the first sniff of cash, but there doesn't seem to be any donations toward open and public development, which is the only way to guarantee ava…
Those initial OpenAI donations really were for open development. The problem was, there was no formal legal restrictions put in place at the start that stopped them from hatching a private subsidiary or not remaining open. Just that the initial organization was non-profit and for AI safety. Which is the only way that could have been stopped. A failure of initial oversight. A lack of “alignment” one might say.
That is surely true.
> Which is the only way that could have been stopped.
The problem is, no one expects a CEO to do these things, and when the gusher of money erupts there's nothing that can be done, as we saw.
You cover one base, they sneak to another. Legal strictures are unlikely to contain them. Money is all conquering.
I haven't been able to get a great answer regarding why OpenAI is consistently leading the pack. What could they possibly be doing different? I can't imagine they've invented a technique that nobody else can reach at this point
There's a network effect in that they are used more so they've generated more feedback from users, which is then used to improve GPT.
You could say they got data to train RLHF after the training, but that seems unlikely.
Bing was launched in February 7 with GPT4 - that's just 2 months after ChatGPT launch.
Earlier quoted context omitted.
Right. Gemini Pro 1.5 scores 81.9% on MMLU and is also above in a few other benchmarks.
Which - importantly - is better than Mistral at 81.2% ... Gemini Ultra scored 90% which is better than GPT-4. This reads like a paid-for press release from Microsoft to pretend like they're almighty and Google is incompetent.
Earlier quoted context omitted.
I would assume that the advantage (for Mistal) here is Microsoft paying them money to be the exclusive model hosting partner, so that everyone has to go to Azure to get top-tier hosted models.
It's obviously not exclusive (it's available hosted from both Mistral themselves and Azure). I guess it could possibly be exclusive within some smaller scope, but nothing in the article suggests that. Azure is described as the "first distribution partner", not an exclusive one.
Earlier quoted context omitted.
Whoever is lagging will be open source. It's why AMD open sources FSR but Nvidia doesn't do the same for DLSS. There is nothing benevolent about AMD and nothing evil about Nvidia. They are both performing actions that profit maximize given their situation.
> They are both performing actions that profit maximize given their situation. That really rings like moral relativism. Even 15 years ago when we were still talking about "GPGPU" and OpenCL seemed like a serious competitor to Cuda, NVidia was much less open than AMD. Sure you can argue that they are "just" profit maximising, turns out it's quite detrimental to all of us... If what you're saying is that we shouldn't b…
Earlier quoted context omitted.
That’s the theory. In practice, it requires immense infrastructure to run it, let alone all the tooling and sales pipelines surrounding it. Companies are risk averse by definition, and in practice the risks are usually different than the ones you imagine from first principles. It’s dumb. The first company to prove this will hopefully set an example that will be noticed.
It didn't take long for perplexity, anyscale, together.ai, groq, deepinfra, or lepton to all host mistral's 8x7B model, both faster and cheaper then Mistral's own api. https://artificialanalysis.ai/models/mixtral-8x7b-instruct/h...
Just tried Le Chat for some coding issues I had today that ChatGPT (with GPT-4) wasn't able to solve, and Le Chat actually gave way better answers. Not sure if ChatGPT quality has gone down to save costs as some people suggest, but for these few problems the quality of the answers was significantly better for Mistral.
I feel like ChatGPT has a better way of figuring out what I want to know and provides better examples.
I also preferred GPT4's code.
Then Le Chat has some usability issues, like a too thin font and a too high contrast in dark mode.
But overall, I could live with it should ChatGPT go offline.
Very nice! I know they've already done a lot, but I would've liked some language in there re-affirming a commitment to contributing to the open source community. I had thought that was a major part of their brand. I've been staying tuned[0] since the miqu[1] debacle thinking that more open weights were on the horizon. I guess we'll just have to wait and see. [0]: https://twitter.com/arthurmensch/status/17527374626636…