File Download

There are no files associated with this item.

  Links for fulltext
     (May Require Subscription)
Supplementary

Article: 3D multi-scale FCN with random modality voxel dropout learning for Intervertebral Disc Localization and Segmentation from Multi-modality MR Images

Title3D multi-scale FCN with random modality voxel dropout learning for Intervertebral Disc Localization and Segmentation from Multi-modality MR Images
Authors
KeywordsMagnetic resonance imaging
Deep learning
Dropout
Intervertebral discs
Localization
Multi-modality
Segmentation
Issue Date2018
Citation
Medical Image Analysis, 2018, v. 45, p. 41-54 How to Cite?
Abstract© 2018 Elsevier B.V. Intervertebral discs (IVDs) are small joints that lie between adjacent vertebrae. The localization and segmentation of IVDs are important for spine disease diagnosis and measurement quantification. However, manual annotation is time-consuming and error-prone with limited reproducibility, particularly for volumetric data. In this work, our goal is to develop an automatic and accurate method based on fully convolutional networks (FCN) for the localization and segmentation of IVDs from multi-modality 3D MR data. Compared with single modality data, multi-modality MR images provide complementary contextual information, which contributes to better recognition performance. However, how to effectively integrate such multi-modality information to generate accurate segmentation results remains to be further explored. In this paper, we present a novel multi-scale and modality dropout learning framework to locate and segment IVDs from four-modality MR images. First, we design a 3D multi-scale context fully convolutional network, which processes the input data in multiple scales of context and then merges the high-level features to enhance the representation capability of the network for handling the scale variation of anatomical structures. Second, to harness the complementary information from different modalities, we present a random modality voxel dropout strategy which alleviates the co-adaption issue and increases the discriminative capability of the network. Our method achieved the 1st place in the MICCAI challenge on automatic localization and segmentation of IVDs from multi-modality MR images, with a mean segmentation Dice coefficient of 91.2% and a mean localization error of 0.62 mm. We further conduct extensive experiments on the extended dataset to validate our method. We demonstrate that the proposed modality dropout strategy with multi-modality images as contextual information improved the segmentation accuracy significantly. Furthermore, experiments conducted on extended data collected from two different time points demonstrate the efficacy of our method on tracking the morphological changes in a longitudinal study.
Persistent Identifierhttp://hdl.handle.net/10722/281947
ISSN
2022 Impact Factor: 10.9
2020 SCImago Journal Rankings: 2.887
ISI Accession Number ID

 

DC FieldValueLanguage
dc.contributor.authorLi, Xiaomeng-
dc.contributor.authorDou, Qi-
dc.contributor.authorChen, Hao-
dc.contributor.authorFu, Chi Wing-
dc.contributor.authorQi, Xiaojuan-
dc.contributor.authorBelavý, Daniel L.-
dc.contributor.authorArmbrecht, Gabriele-
dc.contributor.authorFelsenberg, Dieter-
dc.contributor.authorZheng, Guoyan-
dc.contributor.authorHeng, Pheng Ann-
dc.date.accessioned2020-04-09T09:19:12Z-
dc.date.available2020-04-09T09:19:12Z-
dc.date.issued2018-
dc.identifier.citationMedical Image Analysis, 2018, v. 45, p. 41-54-
dc.identifier.issn1361-8415-
dc.identifier.urihttp://hdl.handle.net/10722/281947-
dc.description.abstract© 2018 Elsevier B.V. Intervertebral discs (IVDs) are small joints that lie between adjacent vertebrae. The localization and segmentation of IVDs are important for spine disease diagnosis and measurement quantification. However, manual annotation is time-consuming and error-prone with limited reproducibility, particularly for volumetric data. In this work, our goal is to develop an automatic and accurate method based on fully convolutional networks (FCN) for the localization and segmentation of IVDs from multi-modality 3D MR data. Compared with single modality data, multi-modality MR images provide complementary contextual information, which contributes to better recognition performance. However, how to effectively integrate such multi-modality information to generate accurate segmentation results remains to be further explored. In this paper, we present a novel multi-scale and modality dropout learning framework to locate and segment IVDs from four-modality MR images. First, we design a 3D multi-scale context fully convolutional network, which processes the input data in multiple scales of context and then merges the high-level features to enhance the representation capability of the network for handling the scale variation of anatomical structures. Second, to harness the complementary information from different modalities, we present a random modality voxel dropout strategy which alleviates the co-adaption issue and increases the discriminative capability of the network. Our method achieved the 1st place in the MICCAI challenge on automatic localization and segmentation of IVDs from multi-modality MR images, with a mean segmentation Dice coefficient of 91.2% and a mean localization error of 0.62 mm. We further conduct extensive experiments on the extended dataset to validate our method. We demonstrate that the proposed modality dropout strategy with multi-modality images as contextual information improved the segmentation accuracy significantly. Furthermore, experiments conducted on extended data collected from two different time points demonstrate the efficacy of our method on tracking the morphological changes in a longitudinal study.-
dc.languageeng-
dc.relation.ispartofMedical Image Analysis-
dc.subjectMagnetic resonance imaging-
dc.subjectDeep learning-
dc.subjectDropout-
dc.subjectIntervertebral discs-
dc.subjectLocalization-
dc.subjectMulti-modality-
dc.subjectSegmentation-
dc.title3D multi-scale FCN with random modality voxel dropout learning for Intervertebral Disc Localization and Segmentation from Multi-modality MR Images-
dc.typeArticle-
dc.description.naturelink_to_subscribed_fulltext-
dc.identifier.doi10.1016/j.media.2018.01.004-
dc.identifier.pmid29414435-
dc.identifier.scopuseid_2-s2.0-85041439310-
dc.identifier.volume45-
dc.identifier.spage41-
dc.identifier.epage54-
dc.identifier.eissn1361-8423-
dc.identifier.isiWOS:000427664400004-
dc.identifier.issnl1361-8415-

Export via OAI-PMH Interface in XML Formats


OR


Export to Other Non-XML Formats