Earlier quoted context omitted.
> DeepMind now merged with Google Brain seemingly with a product focus, FAI I don’t really agree that training massive causal LMs is a “product focus”. I agree that there is an increasing product focus in orgs like OAI, but a lot of that is coming from new growth rather than trading off with base research.
> I don’t really agree that training massive causal LMs is a “product focus”. I'd hope that Google DeepMind's mission statement is a bit broader than that, but certainly Gemini seems to be the focus. It seems to me there's a world of difference between DeepMind's original goal of developing AGI (via whatever means - as a research objective), and now being told they have to build LLMs. If we compare Google to Meta, it…
There is a ton of further research to be done in deep models. A lot of it will incorporate LLMs because that is currently the most powerful primitive you have. Research is a lot more closed now but I would not take that to mean research is no longer happening.