SYSTEM AND METHOD FOR ATTENTION-BASED CLASSIFICATION OF HIGH-RESOLUTION MICROSCOPY IMAGES

摘要

This invention provides a system and method for analyzing and classifying imaged from whole slides of tissue. A source of image data transmits images of the tissue on the whole slides to a GPU. The GPU performs a feature extraction process that identifies and segments regions of interests in each of the images, and an attention network that, based upon training from an expert, identifies trained characteristics can comprise cancerous and/or pre-cancerous conditions/e.g. those associated with a gastrointestinal tract, such ad Barret's Esophagus. The feature extraction process can include a convolutional neural network (CNN). The attention network can be adapted performs attention/based weighting of features relative to the trained characteristics, and/or the attention network can include 3D convolutional filters. The image data is acquired using an image sensor having approximately 100 Megapixel resolution.