Stepping back, the high-order bit here is an ML method is beating physically-based methods for accurately predicting the world. What happens when the best methods for computational fluid dynamics, molecular dynamics, nuclear physics are all uninterpretable ML models? Does this decouple progress from our current understanding of the scientific process - moving to better and better models of the world without human-int…
I would assume that given enough hints from AI and if it is deemed important enough humans will come in to figure out the “first principles” required to arrive at the conclusion.
AlphaFold 3 predicts the structure and interactions of life's molecules
171–180 of 504 posts
Re: AlphaFold 3 predicts the structure and interactions of life's molecules
#172Earlier quoted context omitted.
I don't know Paul Adams, so it's hard for me to know how to interpret your post. Is there anything else I can read that discusses the accuracy of AlphaFold?
Yes, https://predictioncenter.org/casp15/ https://www.sciencedirect.com/science/article/pii/S0959440X2... https://dasher.wustl.edu/bio5357/readings/oxford-alphafold2.... I can't find the link at the moment but from the perspective of the CASP leaders, AF2 was accurate enough that it's hard to even compare to the best structures determined experimentally, due to noise in the data/inadequacy of the metric. A number of…
Re: AlphaFold 3 predicts the structure and interactions of life's molecules
#173I’m inclined to ignore such pr fluff until they actually demonstrate a _practical_ result. Eg. cure some form of cancer or some autoimmune disease. All this “prediction of structure” has been in the news for years, and it seems to have resulted in nothing practically usable IRL as far as I can tell. I could be wrong of course, I do not work in this field
the R&D of all major pharma is currently using AlphaFold predictions when they don't have experimentally determined structures. I cannot share further details but the results suggest that we will see future pharmaceuticals based on AF predictions. The important thing to recognize is that protein structures are primarily hypothesis-generation machines and tools to stimulate ideas, rather that direct targets of computa…
Re: AlphaFold 3 predicts the structure and interactions of life's molecules
#174Earlier quoted context omitted.
If you're a scientist who works in protein folding (or one of those other areas) and strongly believe that science's goal is to produce falsifiable hypotheses, these new approaches will be extremely depressing, especially if you aren't proficient enough with ML to reproduce this work in your own hands. If you're a scientist who accepts that probabilist models beat interpretable ones (articulated well here: https://no…
> ... and strongly believe that science's goal is to produce falsifiable hypotheses, these new approaches will be extremely depressing I don't quite understand this point — could you elaborate? My understanding is that the ML model produces a hypothesis, which can then be tested via normal scientific method (perform experiment, observe results). If we have a magic oracle that says "try this, it will work", and then w…
Whether ML models produce hypotheses is something of an epistemiological argument that I think muddies the waters without bringing any light. I would only use the term "ML models generate predictions". In a sense, the model itself is the hypothesis, not any individual prediction.
Re: AlphaFold 3 predicts the structure and interactions of life's molecules
#175Stepping back, the high-order bit here is an ML method is beating physically-based methods for accurately predicting the world. What happens when the best methods for computational fluid dynamics, molecular dynamics, nuclear physics are all uninterpretable ML models? Does this decouple progress from our current understanding of the scientific process - moving to better and better models of the world without human-int…
Re: AlphaFold 3 predicts the structure and interactions of life's molecules
#176Re: AlphaFold 3 predicts the structure and interactions of life's molecules
#177Stepping back, the high-order bit here is an ML method is beating physically-based methods for accurately predicting the world. What happens when the best methods for computational fluid dynamics, molecular dynamics, nuclear physics are all uninterpretable ML models? Does this decouple progress from our current understanding of the scientific process - moving to better and better models of the world without human-int…
I can only assume that existing methods would still be used for verification. At least we understand the logic used behind these methods. The ML models might become more accurate on average but they could still throw out results that are way off occasionally, so their error rate would have to become equal to the existing methods.
Re: AlphaFold 3 predicts the structure and interactions of life's molecules
#178Stepping back, the high-order bit here is an ML method is beating physically-based methods for accurately predicting the world. What happens when the best methods for computational fluid dynamics, molecular dynamics, nuclear physics are all uninterpretable ML models? Does this decouple progress from our current understanding of the scientific process - moving to better and better models of the world without human-int…
In theoretical physics, you know the equations, you solve equations analytically, but you can only do that when the model is simple.
In numerical physics, you know the equations, you discretize the problem on a grid, and you solve the constraint defined by the equations with various numerical integration schemes like RK4, but you can only do that when the model is small and you know the equations, and you find a single solution.
Then you want the result faster, so you use mesh-free methods and adaptive grids. It works on bigger models but you have to know the equations, finding a single solution to the differential equations.
Then you compress this adaptive grid with a neural network, while still knowing the governing equations, and you have things like Physics Informed Neural Networks ( https://arxiv.org/pdf/1711.10561 and following papers) where you can bound the approximation error. This method allows solve all solutions to the differential equations simultaneously, sharing the computations.
Then when knowing explicitly your governing equations is too complex, so you assume that there are some governing stochastic equations implicitly, which you learn the end-result of the dynamic with a diffusion model, that's what this alpha-fold is doing.
ML is kind of a memoization technique, analog to hashlife in the game of life, that allows you reuse your past computational efforts. You are free to choose on this ladder which memory-compute trade-off you want to use to model the world.
Re: AlphaFold 3 predicts the structure and interactions of life's molecules
#179Stepping back, the high-order bit here is an ML method is beating physically-based methods for accurately predicting the world. What happens when the best methods for computational fluid dynamics, molecular dynamics, nuclear physics are all uninterpretable ML models? Does this decouple progress from our current understanding of the scientific process - moving to better and better models of the world without human-int…
Re: AlphaFold 3 predicts the structure and interactions of life's molecules
#180Important caveat: it's only about 70% accurate. Why doesn't the press release say this explicitly? It seems intentionally misleading to only report accuracy relative to existing methods, which apparently are just not so good (30%, 50% in various settings). https://www.fastcompany.com/91120456/deepmind-alphafold-3-dn...