Earlier quoted context omitted.
Just a note on the radiologist part, the current SOTA radiology AI is still tiny parameter CNN's from the mid-late 2010's running locally. NYT ran an article a few weeks about this, and the entire article uses the phrase "A.I.", which people assume means ChatGPT, but really can refer to anything in the last 60 years of A.I. research. Manually digging revealed it was an old architecture. We don't know yet how a modern…
> We don't know yet how a modern transformer trained on radiology would perform, but it almost certainly would be dramatically better. Why? Is there something about radiology that makes the transformer architecture appropriate? My understanding has been that transformers are great for sequences of tokens, but from what little I know of radiology sequence-of-tokens seems unlikely to be a useful representation of the d…
I can only imagine what people picture when they think about AI and radiology, but I can certainly imagine that it goes beyond that. What if you can feed a transformer with literature on how the body works and diseases, so that it can _analyse_ (not just _classify_) scans, applying some degree of, let's call it, creativity?
That second thing, if technically feasible, confabulations and all, has the potential to replace radiologists, maybe, if you're optimistic. Simple image classification, probably not, but it sounds like a great help to make sure they don't miss anything, can prioritise what to look at, and stuff like that.