Deep neural network automated segmentation of cellular structures in volume electron microscopy

Gallusser, Benjamin and Maltese, Giorgio and Di Caprio, Giuseppe and Vadakkan, Tegy John and Sanyal, Anwesha and Somerville, Elliott and Sahasrabudhe, Mihir and O’connor, Justin and Weigert, Martin and Kirchhausen, Tom (2023) Deep neural network automated segmentation of cellular structures in volume electron microscopy. Journal of Cell Biology, 222 (2). e202208005. ISSN 0021-9525 (https://doi.org/10.1083/jcb.202208005)

[thumbnail of Gallusser-etal-JCB-2023-Deep-neural-network-automated-segmentation-of-cellular-structures]
Preview
 Text. Filename: Gallusser_etal_JCB_2023_Deep_neural_network_automated_segmentation_of_cellular_structures.pdf
Final Published Version
License: Creative Commons Attribution-NonCommercial-ShareAlike 4.0 logo
Download (8MB)| Preview

Abstract

Volume electron microscopy is an important imaging modality in contemporary cell biology. Identification of intracellular structures is a laborious process limiting the effective use of this potentially powerful tool. We resolved this bottleneck with automated segmentation of intracellular substructures in electron microscopy (ASEM), a new pipeline to train a convolutional neural network to detect structures of a wide range in size and complexity. We obtained dedicated models for each structure based on a small number of sparsely annotated ground truth images from only one or two cells. Model generalization was improved with a rapid, computationally effective strategy to refine a trained model by including a few additional annotations. We identified mitochondria, Golgi apparatus, endoplasmic reticulum, nuclear pore complexes, caveolae, clathrin-coated pits, and vesicles imaged by focused ion beam scanning electron microscopy. We uncovered a wide range of membrane–nuclear pore diameters within a single cell and derived morphological metrics from clathrin-coated pits and vesicles, consistent with the classical constant-growth assembly model.

ORCID iDs

Gallusser, Benjamin, Maltese, Giorgio, Di Caprio, Giuseppe ORCID logoORCID: https://orcid.org/0000-0001-5564-8064, Vadakkan, Tegy John, Sanyal, Anwesha, Somerville, Elliott, Sahasrabudhe, Mihir, O’connor, Justin, Weigert, Martin and Kirchhausen, Tom;
CORE (COnnecting REpositories)