Ask HN: Why do Sam and Greg need Microsoft?
1–10 of 13 posts
Re: Ask HN: Why do Sam and Greg need Microsoft?
#2Re: Ask HN: Why do Sam and Greg need Microsoft?
#31. Compute (H100s are almost impossible to get ahold of, especially in the quantities they'd need to train a competitive model)
2. Data (OpenAI has a very rich set of user data from ChatGPT that is necessary for creating a model like GPT-4; a new venture would lack this data -- the cold start problem -- but Microsoft may* have similarly usable data from non-enterprise Bing Chat)
* Someone please feel free to prove me wrong on this - I'm not aware of a MS policy saying they won't use Bing Chat prompts for training, but it could very well exist.
Re: Ask HN: Why do Sam and Greg need Microsoft?
#4If they started there own company, they would then need to do a deal with someone like Microsoft anyway, so why not just work at the source and then you get priority on that.
Plus as a secondary, Microsoft's access to OpenAI's models, I believe they have certain rights, so it would mean they are not starting at zero again.
Starting a new company, no matter what the talent they bring, with no compute resources and starting from zero puts them way behind in what is a flat out sprint / race at the big tech companies at this point, not advisable.
Re: Ask HN: Why do Sam and Greg need Microsoft?
#5Re: Ask HN: Why do Sam and Greg need Microsoft?
#6I think it comes down to prioritizing speed of execution in the race for AGI, especially in the context of two constrained resources: 1. Compute (H100s are almost impossible to get ahold of, especially in the quantities they'd need to train a competitive model) 2. Data (OpenAI has a very rich set of user data from ChatGPT that is necessary for creating a model like GPT-4; a new venture would lack this data -- the col…
Re: Ask HN: Why do Sam and Greg need Microsoft?
#7I assume the same reason that even OpenAI needs Microsoft - Compute and GPU access. If they started there own company, they would then need to do a deal with someone like Microsoft anyway, so why not just work at the source and then you get priority on that. Plus as a secondary, Microsoft's access to OpenAI's models, I believe they have certain rights, so it would mean they are not starting at zero again. Starting a…
Re: Ask HN: Why do Sam and Greg need Microsoft?
#8I assume the same reason that even OpenAI needs Microsoft - Compute and GPU access. If they started there own company, they would then need to do a deal with someone like Microsoft anyway, so why not just work at the source and then you get priority on that. Plus as a secondary, Microsoft's access to OpenAI's models, I believe they have certain rights, so it would mean they are not starting at zero again. Starting a…
Re: Ask HN: Why do Sam and Greg need Microsoft?
#9I assume the same reason that even OpenAI needs Microsoft - Compute and GPU access. If they started there own company, they would then need to do a deal with someone like Microsoft anyway, so why not just work at the source and then you get priority on that. Plus as a secondary, Microsoft's access to OpenAI's models, I believe they have certain rights, so it would mean they are not starting at zero again. Starting a…
Microsoft seems the big winner in all this mess. Be with Microsoft seems a win-win for all parts
Re: Ask HN: Why do Sam and Greg need Microsoft?
#10The answer is obvious and resources to make it happen are immense.