Earlier quoted context omitted.
> Seems to me that it's the team + market that won the money. That's pretty much it. Most analysts expect there's an addressable market of $20bn this year, growing to $100bn per year by the end of the decade. The market will be split between four or five companies. The number of people globally with the required expertise to create these models is in the tens (generously one hundred individuals). Three of those peopl…
I don't at all believe the people able to build models are that few. Aren't tons of people doing open source models already? I believe the number of people who have already built models to be low, but the number of people with the capability to build models to be very large. It's not magic.
It remains a major feat with many tweaks and tricks. Case in point: the 114 pages of OPT175B logbook [1]
[1] https://github.com/facebookresearch/metaseq/blob/main/projec...