An Augmented Reality Microscope for Cancer Detection

#1

Post by kbyatnal » Tue, Apr 17, 2018, 5:18 PM UTC

An Augmented Reality Microscope for Cancer Detection
research.googleblog.com

Re: An Augmented Reality Microscope for Cancer Detection

#2

Post by j32fun » Tue, Apr 17, 2018, 5:52 PM UTC

Much of Radiology and Pathology specimen interpretation is based on reliable and consistent detection. To come and think of it, the application of AI into this area is fantastic because it removes human fatigue and missed diagnoses. AI neural nets seem well equipped for image recognition. At the very least, this can lead to a first level flagging of specimens.

My only concern is that with any system, a major downside would be that human operators would place too much reliance on a system that works great most of the time, resulting in missing something that otherwise would have been caught. This happens every once in a while, such as with EKG machines spitting out a diagnosis based on electrical activity patterns.

Re: An Augmented Reality Microscope for Cancer Detection

#3

Post by dekhn » Tue, Apr 17, 2018, 6:03 PM UTC

There are some neat ideas in here. I really like the cheap "current lens detector" that uses a webcam to see a simple color fiducial.

Re: An Augmented Reality Microscope for Cancer Detection

#4

Post by cstavish » Tue, Apr 17, 2018, 6:13 PM UTC

Those familiar with the field will recognize an augmented reality microscope as an incomplete alternative to, or stepping-stone towards AI applied to whole-slide images, which are multi-resolution images of more or less identical quality quality to that of a microscope.

For some use-cases, deploying AI to microscopic fields of view is a viable, lower-cost alternative to creating whole-slide images and running AI on them in their entirety (whole-slide scanners are a bit expensive). Specifically, if a pathologists identifies a suspicious region, the augmented scope can provide useful support. However, many types of anatomic pathology assessment require laborious review of several slides. Only AI applied to whole-slide images can pre-identify rare events or "hot spots", saving pathologist time while improving diagnostic confidence.

Re: An Augmented Reality Microscope for Cancer Detection

#5

Post by aaavl2821 » Tue, Apr 17, 2018, 7:51 PM UTC

This seems to be very interesting from a technical perspective, but it seems that it would not improve upon the accuracy of current tools and would be additive to cost, if only incrementally so. Thus the real world benefits would be reducing time spent reviewing slides or other workflow improvements?

Re: An Augmented Reality Microscope for Cancer Detection

#6

Post by nickparker » Tue, Apr 17, 2018, 8:10 PM UTC

aaavl2821 wrote: post #5

This seems to be very interesting from a technical perspective, but it seems that it would not improve upon the accuracy of current tools and would be additive to cost, if only incrementally so. Thus the real world benefits would be reducing time spent reviewing slides or other workflow improvements?

Layperson speaking, but I believe skilled labor is most of the cost of these diagnostics. Even if the scope is $100k, the doctor is $200k/yr so it'd make sense for this to be a cost reducing tool if it increases speed.

Re: An Augmented Reality Microscope for Cancer Detection

#7

Post by claar » Tue, Apr 17, 2018, 8:56 PM UTC

This sounds fantastic. It seems to follow that eventually computers will be able to analyze vastly more tissue/cells than humans are capable of.

Re: An Augmented Reality Microscope for Cancer Detection

#8

Post by yread » Tue, Apr 17, 2018, 9:03 PM UTC

cstavish wrote: post #4

Those familiar with the field will recognize an augmented reality microscope as an incomplete alternative to, or stepping-stone towards AI applied to whole-slide images, which are multi-resolution images of more or less identical quality quality to that of a microscope. For some use-cases, deploying AI to microscopic fields of view is a viable, lower-cost alternative to creating whole-slide images and running AI on t…

I work a bit in the field and I think it's a completely impractical but fun hack.

Re: An Augmented Reality Microscope for Cancer Detection

#9

Post by amelius » Tue, Apr 17, 2018, 9:54 PM UTC

It's always nice to read about new applications, but using DL to build image classifiers is not very impressive in 2018.

I would be more impressed if they put the data out in the open, and let everybody compete on building a better classifier.

Re: An Augmented Reality Microscope for Cancer Detection

#10

Post by killjoywashere » Tue, Apr 17, 2018, 10:43 PM UTC

yread wrote: post #8

cstavish wrote: post #4

Those familiar with the field will recognize an augmented reality microscope as an incomplete alternative to, or stepping-stone towards AI applied to whole-slide images, which are multi-resolution images of more or less identical quality quality to that of a microscope. For some use-cases, deploying AI to microscopic fields of view is a viable, lower-cost alternative to creating whole-slide images and running AI on t…

I work a bit in the field and I think it's a completely impractical but fun hack.

I work in the field and am about to be sent to a remote location for 2 years. Literally the only pathologist for 100s of miles. This would be more than a little nice to have.