Earlier quoted context omitted.
IMHO, today, Google takes the cake for slowest. Meta is still probably the most agile, and Amazon is super hit or miss (so most variance) Idk where Microsoft would fit in that hierarchy, like Amazon it's kind of hit or miss but with less variance and extrema. From what I've seen and heard, both Gaming and Azure are pretty darn competent these days from an engineering and product perspective. Not perfect of course, bu…
Do you think Microsoft would have a competitive foundational model if not for OpenAI? Cause Google and Meta seem like they’re top of the pack there, with AWS at the very least releasing some.
It was a competitive model for the time, it was made in 2021 if I recall in cooperation with Nvidia. The largest model at the time (and still remains one of the largest models ever made).
https://developer.nvidia.com/blog/using-deepspeed-and-megatr...
The thing here is that OpenAI managed to create GPT4 - that no one matched yet.