Just to add to this whole "It's not solved! Yes it is!" discussion. Note that >According to Professor Moult, a score of around 90 GDT is informally considered to be competitive with results obtained from experimental methods. So if we go by >= 90 as solved: >In the results from the 14th CASP assessment, released today, our latest AlphaFold system achieves a median score of 92.4 GDT overall across all targets. they so…
AlphaFold: a solution to a 50-year-old grand challenge in biology
351–360 of 683 posts
Re: AlphaFold: a solution to a 50-year-old grand challenge in biology
#352Earlier quoted context omitted.
Even if you try to account for the overall R&D cost, DeepMind isn't that large an organization by the standards of biomedical research. It's very big and well funded for a computer science research organization, yes, and most CS departments can't match its resources. But the NIH budget is $40 billion, and private pharmaceutical companies do another $80 billion in annual R&D. It's interesting that this kind of breakth…
DeepMind is taking advantage of NIH's funding. For example, Anfinsen who demonstrated that proteins fold spontaneously and reproducibly ( https://en.wikipedia.org/wiki/Anfinsen%27s_dogma ) ran a lab at NIH. Levinthal (who postulated an early and easily refutable model of protein folding) was funded by NIH for decades. Most of the competitors at CASP are supported by NIH and its investments have contributed to the mod…
Re: AlphaFold: a solution to a 50-year-old grand challenge in biology
#353Not knowing a lot about biotechnology, I read the article and it sounds great, but how big is this as a gamechanger? Can someone comment on how big are the implications of this in, let’s say, 5 years from now, on day to day life? Does this mean that biotech is going to explode? Or just that drugs will come to market faster, perhaps cheaper for rare diseases, but from the same industry structure as always?
Re: AlphaFold: a solution to a 50-year-old grand challenge in biology
#354Curious, what are the sizes of the training and validation/test datasets (number of structures)?
The proteins are shown on the CASP website [1]. Both the number of residues and number of proteins are bigger than I expected.
Re: AlphaFold: a solution to a 50-year-old grand challenge in biology
#355Earlier quoted context omitted.
Progress like this was, in my view, inevitable after the invention of unsupervised transformers. It'll be genetics next. e: although AlphaFold appears to be convolutionally based! I suspect that'll change soon.
FWIW, transformers is to sequences what convnets is to grids, modulo important considerations like kernel size and normalization. Think of transformers as really wide (N) and really short (1) convolutions. Both are instances of graphnets with a suitable neighbor function. Once normalization was cracked by transformers, all sort of interesting graphnets became possible, though it's possible that stacked k-dimensional…
> Think of transformers as really wide (N) and really short (1) convolutions
Modern transformer networks are not "really short" and you're also conflating the difference between intra- and inter- attention.
There is still a pitched battle being waged between convnets and transformers for sequences, although it looks like transformers have the upper hand accuracy wise right now, convnets are competitive speed-wise.
Re: AlphaFold: a solution to a 50-year-old grand challenge in biology
#356Earlier quoted context omitted.
Even without any improvement, the amount of grunt-work the AI can pre-do and get down to a short-list - that in itself will see changes in progress speeding research up.
> and get down to a short-list There's no reason to believe the list will contain all solutions, however.
Re: AlphaFold: a solution to a 50-year-old grand challenge in biology
#357Like this is awesome and a huge advancement but one thing that worries me with an AI solution is that it doesn't really draw us any closer to the why. Why do proteins fold the way they do? We can predict the resulting structure which is extremely significant, we have no clue why. While we get the insight of being able to predict some structures we don't get the insight of why things are happening the way they are. In…
Re: AlphaFold: a solution to a 50-year-old grand challenge in biology
#358Not knowing a lot about biotechnology, I read the article and it sounds great, but how big is this as a gamechanger? Can someone comment on how big are the implications of this in, let’s say, 5 years from now, on day to day life? Does this mean that biotech is going to explode? Or just that drugs will come to market faster, perhaps cheaper for rare diseases, but from the same industry structure as always?
This will allow us to discover much more about the structure of the cell (of "life") at a before this unprecedented speed. We should find many, many more mechanisms and targets for medicine, but it takes 10-20 years to bring a new medicine to market. So in 5 years you'll see exactly zero new medicines pop up.
Re: AlphaFold: a solution to a 50-year-old grand challenge in biology
#359Earlier quoted context omitted.
That's a good point; this system certainly didn't come from nowhere! The protein datasets they used also mostly came out of various NIH-funded projects. What I meant to focus on was that I think DeepMind has less of a pure money/scale advantage in this area than in some others. In something like Go or Atari game-playing, there are many academic groups researching similar things, but their resources are laughably smal…
Personally I think a major part of the secret sauce is Google's internal compute infrastructure. When I was an academic, 50% of my time went to building infra to do my science. At Google, petabytes of storage, millions of cores, algorithms, and brains were all easily tappable within a common software repo and cluster infrastructure. That immediately translates to higher scientific productivity.
Re: AlphaFold: a solution to a 50-year-old grand challenge in biology
#360Pretty interesting that they only used about $15k worth of resources (retail price) to achieve this. It's not a technique that would have been out of reach for other organizations based only on not being able to afford the compute.