File Download

There are no files associated with this item.

  Links for fulltext
     (May Require Subscription)
Supplementary

Article: Characterizing functional brain networks via Spatio-Temporal Attention 4D Convolutional Neural Networks (STA-4DCNNs)

TitleCharacterizing functional brain networks via Spatio-Temporal Attention 4D Convolutional Neural Networks (STA-4DCNNs)
Authors
KeywordsFour-Dimensional Convolutional Neural Network
Functional brain network
Functional MRI
Individualized
Spatio-temporal pattern
Issue Date2023
Citation
Neural Networks, 2023, v. 158, p. 99-110 How to Cite?
AbstractCharacterizing individualized spatio-temporal patterns of functional brain networks (FBNs) via functional magnetic resonance imaging (fMRI) provides a foundation for understanding complex brain function. Although previous studies have achieved promising performances based on either shallow or deep learning models, there is still much space to improve the accuracy of spatio-temporal pattern characterization of FBNs by optimally integrating the four-dimensional (4D) features of fMRI. In this study, we introduce a novel Spatio-Temporal Attention 4D Convolutional Neural Network (STA-4DCNN) model to characterize individualized spatio-temporal patterns of FBNs. Particularly, STA-4DCNN is composed of two subnetworks, in which the first Spatial Attention 4D CNN (SA-4DCNN) models the spatio-temporal features of 4D fMRI data and then characterizes the spatial pattern of FBNs, and the second Temporal Guided Attention Network (T-GANet) further characterizes the temporal pattern of FBNs under the guidance of the spatial pattern together with 4D fMRI data. We evaluate the proposed STA-4DCNN on seven different task fMRI and one resting state fMRI datasets from the publicly released Human Connectome Project. The experimental results demonstrate that STA-4DCNN has superior ability and generalizability in characterizing individualized spatio-temporal patterns of FBNs when compared to other state-of-the-art models. We further apply STA-4DCNN on another independent ABIDE I resting state fMRI dataset including both autism spectrum disorder (ASD) and typical developing (TD) subjects, and successfully identify abnormal spatio-temporal patterns of FBNs in ASD compared to TD. In general, STA-4DCNN provides a powerful tool for FBN characterization and for clinical applications on brain disease characterization at the individual level.
Persistent Identifierhttp://hdl.handle.net/10722/330894
ISSN
2023 Impact Factor: 6.0
2023 SCImago Journal Rankings: 2.605
ISI Accession Number ID

 

DC FieldValueLanguage
dc.contributor.authorJiang, Xi-
dc.contributor.authorYan, Jiadong-
dc.contributor.authorZhao, Yu-
dc.contributor.authorJiang, Mingxin-
dc.contributor.authorChen, Yuzhong-
dc.contributor.authorZhou, Jingchao-
dc.contributor.authorXiao, Zhenxiang-
dc.contributor.authorWang, Zifan-
dc.contributor.authorZhang, Rong-
dc.contributor.authorBecker, Benjamin-
dc.contributor.authorZhu, Dajiang-
dc.contributor.authorKendrick, Keith M.-
dc.contributor.authorLiu, Tianming-
dc.date.accessioned2023-09-05T12:15:40Z-
dc.date.available2023-09-05T12:15:40Z-
dc.date.issued2023-
dc.identifier.citationNeural Networks, 2023, v. 158, p. 99-110-
dc.identifier.issn0893-6080-
dc.identifier.urihttp://hdl.handle.net/10722/330894-
dc.description.abstractCharacterizing individualized spatio-temporal patterns of functional brain networks (FBNs) via functional magnetic resonance imaging (fMRI) provides a foundation for understanding complex brain function. Although previous studies have achieved promising performances based on either shallow or deep learning models, there is still much space to improve the accuracy of spatio-temporal pattern characterization of FBNs by optimally integrating the four-dimensional (4D) features of fMRI. In this study, we introduce a novel Spatio-Temporal Attention 4D Convolutional Neural Network (STA-4DCNN) model to characterize individualized spatio-temporal patterns of FBNs. Particularly, STA-4DCNN is composed of two subnetworks, in which the first Spatial Attention 4D CNN (SA-4DCNN) models the spatio-temporal features of 4D fMRI data and then characterizes the spatial pattern of FBNs, and the second Temporal Guided Attention Network (T-GANet) further characterizes the temporal pattern of FBNs under the guidance of the spatial pattern together with 4D fMRI data. We evaluate the proposed STA-4DCNN on seven different task fMRI and one resting state fMRI datasets from the publicly released Human Connectome Project. The experimental results demonstrate that STA-4DCNN has superior ability and generalizability in characterizing individualized spatio-temporal patterns of FBNs when compared to other state-of-the-art models. We further apply STA-4DCNN on another independent ABIDE I resting state fMRI dataset including both autism spectrum disorder (ASD) and typical developing (TD) subjects, and successfully identify abnormal spatio-temporal patterns of FBNs in ASD compared to TD. In general, STA-4DCNN provides a powerful tool for FBN characterization and for clinical applications on brain disease characterization at the individual level.-
dc.languageeng-
dc.relation.ispartofNeural Networks-
dc.subjectFour-Dimensional Convolutional Neural Network-
dc.subjectFunctional brain network-
dc.subjectFunctional MRI-
dc.subjectIndividualized-
dc.subjectSpatio-temporal pattern-
dc.titleCharacterizing functional brain networks via Spatio-Temporal Attention 4D Convolutional Neural Networks (STA-4DCNNs)-
dc.typeArticle-
dc.description.naturelink_to_subscribed_fulltext-
dc.identifier.doi10.1016/j.neunet.2022.11.004-
dc.identifier.pmid36446159-
dc.identifier.scopuseid_2-s2.0-85145610266-
dc.identifier.volume158-
dc.identifier.spage99-
dc.identifier.epage110-
dc.identifier.eissn1879-2782-
dc.identifier.isiWOS:000892217500008-

Export via OAI-PMH Interface in XML Formats


OR


Export to Other Non-XML Formats