A deep learning based approach to semantic segmentation of lung tumour areas in gross pathology images

Gil, Matthew and Dick, Craig and Harrow, Stephen and Murray, Paul and Reines March, Gabriel and Marshall, Stephen; Waiter, Gordon and Lambrou, Tryphon and Leontidis, Georgios and Oren, Nir and Morris, Teresa and Gordon, Sharon, eds. (2023) A deep learning based approach to semantic segmentation of lung tumour areas in gross pathology images. In: Medical Image Understanding and Analysis. Lecture Notes in Computer Science . Springer, GBR, pp. 18-32. ISBN 9783031485930 (https://doi.org/10.1007/978-3-031-48593-0_2)

[thumbnail of Gil-etal-Springer-2023-A-deep-learning-based-approach-to-semantic-segmentation-of-lung-tumour-areas]
Preview
 Text. Filename: Gil-etal-Springer-2023-A-deep-learning-based-approach-to-semantic-segmentation-of-lung-tumour-areas.pdf
Accepted Author Manuscript
License: Strathprints license 1.0
Download (3MB)| Preview

Abstract

Gross pathology photography of surgically resected specimens is an often overlooked modality for the study of medical images that can provide and document useful information about a tumour before it is distorted by slicing. A method for the automatic segmentation of tumour areas in this modality could provide a useful tool for both pathologists and researchers. We propose the first deep learning based methodology for the automatic segmentation of tumour areas in gross pathological images of lung cancer specimens. The semantic segmentation models applied are Deeplabv3+ with both a MobileNet and Resnet50 backbone as well as UNet, all models were trained and tested with both a DICE and cross entropy loss function. Also included is a pre and post-processing pipeline for the input images and output segmentations respectively. The final model is formed of an ensemble of all the trained networks which produced a tumour pixel-wise accuracy of 69.7% (96.8% global accuracy) and tumour area IoU score of 0.616. This work on this novel application highlights the challenges with implementing a semantic segmentation model in this domain that have not been previously documented.

ORCID iDs

Gil, Matthew, Dick, Craig, Harrow, Stephen, Murray, Paul ORCID logoORCID: https://orcid.org/0000-0002-6980-9276, Reines March, Gabriel ORCID logoORCID: https://orcid.org/0000-0003-0761-0592 and Marshall, Stephen ORCID logoORCID: https://orcid.org/0000-0001-7079-5628; Waiter, Gordon, Lambrou, Tryphon, Leontidis, Georgios, Oren, Nir, Morris, Teresa and Gordon, Sharon
CORE (COnnecting REpositories)