Live data from Hacker News

Alphafold

github.com

101–110 of 170 posts

Re: Alphafold

#101

The model parameters are only available for non-commercial use. That's a shame, as I presume there might be a lot of medical startups that would benefit from having this kind protein-folding tech available.

Unless I'm mistaken, you could train the model yourself, starting with a random set of values. In time, your error rates would be low enough to have a new set of parameters which you could use however you like.

Re: Alphafold

#102

Earlier quoted context omitted.

why would it put you out of job? Wouldn't it just become one of the tools you use?

The implicit assumption you are making is that the demand increases in lock step with productivity gains. 100x faster drug discovery, 100x more drugs need to be discovered => same number of people employed. These correlations do hold for technical fields, but logically there should be a point beyond which productivity gains outpace, demand growth / demand could even stop growing. One should either retool to solve a n…

However, complexity for the structures is essentially unbounded on a time scale of the universe timeframe.

Re: Alphafold

#103
post #56

Earlier quoted context omitted.

> ... but I don't play that role any more. I was thinking of going into that field. Can you expand a bit on why you left?

Because programming computers is far more lucrative, and I'm better at it. However, if I had an unlimited budget I would return to biology. I spent 15 years trying to be a professor and failed miserably. I was bad at it and didn't like what professors have to do. I then moved to industry to be a random engineer and thrived doing things entirely unrelated to drug discovery. Eventually, I convinced my company to invest…

Most comp-biologists who work directly with programmers are some of the biggest jerks, and the least qualified tech folks.

They hide all of that under "I'm a scientist, you're not".

Re: Alphafold

#104
post #56

Earlier quoted context omitted.

Because programming computers is far more lucrative, and I'm better at it. However, if I had an unlimited budget I would return to biology. I spent 15 years trying to be a professor and failed miserably. I was bad at it and didn't like what professors have to do. I then moved to industry to be a random engineer and thrived doing things entirely unrelated to drug discovery. Eventually, I convinced my company to invest…

Most comp-biologists who work directly with programmers are some of the biggest jerks, and the least qualified tech folks. They hide all of that under "I'm a scientist, you're not".

Maybe a culture clash? Academia is all about status and prestige - more often scientific outcomes seem to be a means to get the former (why journals don't publish negative results, why studies fail to replicate, why stuff isn't open access, why people worry about getting scooped, etc.)

Tech (at its best) hates credentialism (sometimes I think to a point of over-correction).

That said, 80% of the devs in the bay area seem to have gone to Stanford or MIT, so...

Re: Alphafold

#105
post #23

Earlier quoted context omitted.

> A disturbing thing is that the architecture is much less novel than I originally thought it would be, so this shows perhaps one of the major difficulties was having the resources to try different things on a massive set of multiple alignments. This is something an industrial lab like DeepMind excels at. Whereas universities tend to suck at anything that requires a directed effort of more than a handful of people. Y…

> high heat-to-light ratio Sorry for the ignorance but what does this mean?

Heat = Flaming, Light = Illumination (in the metaphorical sense)

Re: Alphafold

#106
post #23

Earlier quoted context omitted.

> A disturbing thing is that the architecture is much less novel than I originally thought it would be, so this shows perhaps one of the major difficulties was having the resources to try different things on a massive set of multiple alignments. This is something an industrial lab like DeepMind excels at. Whereas universities tend to suck at anything that requires a directed effort of more than a handful of people. Y…

> high heat-to-light ratio Sorry for the ignorance but what does this mean?

It means that the conversation isn't producing much of value despite lots of activity, like an inefficient lightbulb that wastes energy by emitting heat instead of light.

Re: Alphafold

#107

Earlier quoted context omitted.

why would it put you out of job? Wouldn't it just become one of the tools you use?

The implicit assumption you are making is that the demand increases in lock step with productivity gains. 100x faster drug discovery, 100x more drugs need to be discovered => same number of people employed. These correlations do hold for technical fields, but logically there should be a point beyond which productivity gains outpace, demand growth / demand could even stop growing. One should either retool to solve a n…

> The implicit assumption you are making is that the demand increases in lock step with productivity gains.

This is basically the theory around modern industrial revolution - https://en.wikipedia.org/wiki/Jevons_paradox

Efficiency increases demand more than the efficiency saves.

You could argue that labour does not follow that, but it is more about the technology improving rather than disrupting.

Re: Alphafold

#108
post #43
post #28

Earlier quoted context omitted.

You can't do intelligent drug design if you don't know what the target protein looks like. We've gotten great at solving protein structures with things like crystallography and cryo-EM microscopy. Unfortunately, many interesting drug targets reside in the membrane of a cell, which means you can't easily work with them in a lab because they aren't soluble in anything but a plasma membrane. For instance, this is an iss…

You should check out Salipro ( https://www.salipro.com/ ) for membrane protein reconstitution.

Very interesting, thank you for the link.

Re: Alphafold

#109
post #24

I am a structural biologist. This is one of the handful of topics that overlaps with my field here. I'm very excited to play with this, although it might eventually put me out of a job.

why would it put you out of job? Wouldn't it just become one of the tools you use?

Right now I make my living cloning, expressing, and purifying proteins, crystallizing them or freezing them onto EM grids, and solving their structure. From start to finish, it's months to years of work for each structure.

Re: Alphafold

#110
post #16

Alphafold 2 is very very cool, but we need a little dose of reality. It's still a bit away from really solving protein folding as it was marketed. For example, multi-complex proteins are not well predicted yet and these are really important in many biological processes and drug design: https://occamstypewriter.org/scurry/2020/12/02/no-deepmind-h... A disturbing thing is that the architecture is much less novel than I…

>A disturbing thing is that the architecture is much less novel than I originally thought it would be, so this shows perhaps one of the major difficulties was having the resources to try different things on a massive set of multiple alignments. A similar concern has sparked some worries about "AI overhang" https://www.lesswrong.com/posts/75dnjiD8kv2khe9eQ/measuring-... Most of the compute in ML research seems to be g…

> Most of the compute in ML research seems to be going into architecture search.

No it's not. Only Google spends significant time with automatic architecture search, and many people think this is really to try to sell cloud capacity.

> Once the architecture is found, training and net finetuning/transfer learning is comparatively cheap

Training isn't cheap for significant problems.

Getting the data is very expensive, and compute is a significant expense for large datasets.

> This implies we could see 10-100x gains in AI algorithms using today's hardware

Actually, most of the time we see 10-100% (percent! not times) gains from architecture improvements, whether they be manual or automatic.

But that is very significant, because a 10% improvement can suddenly make something useful that wasn't before.

Post reply on HN