Impact of analysis methods on the reproducibility and reliability of resting-state networks

Alexandre R. Franco, Maggie V. Mannell, Vince Daniel Calhoun, Andrew R. Mayer

Research output: Chapter in Book/Report/Conference proceedingChapter

Abstract

Though previous examinations of intrinsic resting-state networks (RSNs) in healthy populations have consistently identified several RSNs that represent connectivity patterns evoked by cognitive and sensory tasks, the effects of different analytic approaches on the reliability and reproducibility of these RSNs have yet to be fully explored. Thus, the primary aim of the current study was to investigate the effect of method (independent component analyses [ICA] vs. seed-based analyses) on RSN reproducibility (independent datasets) for ICA and reliability (independent time points) in both methods using functional magnetic resonance imaging. Good to excellent reproducibility was observed in 9 out of 10 commonly identified RSNs, indicating the robustness of these intrinsic fluctuations at the group level. Reliability analyses showed that results were dependent on three main methodological factors: (1) group versus subject-level analyses (group>subject); (2) whether data from different visits were analyzed separately or jointly with ICA (combined>separate ICA); and (3) whether ICA output was used to directly assess reliability or to inform seed-based analyses (seed-based>ICA). These results suggest that variations in the analytic technique have a significant impact on individual reliability measurements, but do not significantly affect the reproducibility or reliability of RSNs at the group level. Further investigation into the effect of the analytic technique on RSN quantification is warranted to increase the utility of RSN analyses in clinical studies.

Original languageEnglish (US)
Title of host publicationBrain Connectivity
Pages363-374
Number of pages12
Volume3
Edition4
DOIs
StatePublished - Aug 1 2013
Externally publishedYes

Fingerprint

Seeds
Magnetic Resonance Imaging
Population
Clinical Studies
Datasets

ASJC Scopus subject areas

  • Neuroscience(all)

Cite this

Franco, A. R., Mannell, M. V., Calhoun, V. D., & Mayer, A. R. (2013). Impact of analysis methods on the reproducibility and reliability of resting-state networks. In Brain Connectivity (4 ed., Vol. 3, pp. 363-374) https://doi.org/10.1089/brain.2012.0134

Impact of analysis methods on the reproducibility and reliability of resting-state networks. / Franco, Alexandre R.; Mannell, Maggie V.; Calhoun, Vince Daniel; Mayer, Andrew R.

Brain Connectivity. Vol. 3 4. ed. 2013. p. 363-374.

Research output: Chapter in Book/Report/Conference proceedingChapter

Franco, Alexandre R. ; Mannell, Maggie V. ; Calhoun, Vince Daniel ; Mayer, Andrew R. / Impact of analysis methods on the reproducibility and reliability of resting-state networks. Brain Connectivity. Vol. 3 4. ed. 2013. pp. 363-374
@inbook{2a5197bed3684758aa00e9f1e46421b4,
title = "Impact of analysis methods on the reproducibility and reliability of resting-state networks",
abstract = "Though previous examinations of intrinsic resting-state networks (RSNs) in healthy populations have consistently identified several RSNs that represent connectivity patterns evoked by cognitive and sensory tasks, the effects of different analytic approaches on the reliability and reproducibility of these RSNs have yet to be fully explored. Thus, the primary aim of the current study was to investigate the effect of method (independent component analyses [ICA] vs. seed-based analyses) on RSN reproducibility (independent datasets) for ICA and reliability (independent time points) in both methods using functional magnetic resonance imaging. Good to excellent reproducibility was observed in 9 out of 10 commonly identified RSNs, indicating the robustness of these intrinsic fluctuations at the group level. Reliability analyses showed that results were dependent on three main methodological factors: (1) group versus subject-level analyses (group>subject); (2) whether data from different visits were analyzed separately or jointly with ICA (combined>separate ICA); and (3) whether ICA output was used to directly assess reliability or to inform seed-based analyses (seed-based>ICA). These results suggest that variations in the analytic technique have a significant impact on individual reliability measurements, but do not significantly affect the reproducibility or reliability of RSNs at the group level. Further investigation into the effect of the analytic technique on RSN quantification is warranted to increase the utility of RSN analyses in clinical studies.",
author = "Franco, {Alexandre R.} and Mannell, {Maggie V.} and Calhoun, {Vince Daniel} and Mayer, {Andrew R.}",
year = "2013",
month = "8",
day = "1",
doi = "10.1089/brain.2012.0134",
language = "English (US)",
volume = "3",
pages = "363--374",
booktitle = "Brain Connectivity",
edition = "4",

}

TY - CHAP

T1 - Impact of analysis methods on the reproducibility and reliability of resting-state networks

AU - Franco, Alexandre R.

AU - Mannell, Maggie V.

AU - Calhoun, Vince Daniel

AU - Mayer, Andrew R.

PY - 2013/8/1

Y1 - 2013/8/1

N2 - Though previous examinations of intrinsic resting-state networks (RSNs) in healthy populations have consistently identified several RSNs that represent connectivity patterns evoked by cognitive and sensory tasks, the effects of different analytic approaches on the reliability and reproducibility of these RSNs have yet to be fully explored. Thus, the primary aim of the current study was to investigate the effect of method (independent component analyses [ICA] vs. seed-based analyses) on RSN reproducibility (independent datasets) for ICA and reliability (independent time points) in both methods using functional magnetic resonance imaging. Good to excellent reproducibility was observed in 9 out of 10 commonly identified RSNs, indicating the robustness of these intrinsic fluctuations at the group level. Reliability analyses showed that results were dependent on three main methodological factors: (1) group versus subject-level analyses (group>subject); (2) whether data from different visits were analyzed separately or jointly with ICA (combined>separate ICA); and (3) whether ICA output was used to directly assess reliability or to inform seed-based analyses (seed-based>ICA). These results suggest that variations in the analytic technique have a significant impact on individual reliability measurements, but do not significantly affect the reproducibility or reliability of RSNs at the group level. Further investigation into the effect of the analytic technique on RSN quantification is warranted to increase the utility of RSN analyses in clinical studies.

AB - Though previous examinations of intrinsic resting-state networks (RSNs) in healthy populations have consistently identified several RSNs that represent connectivity patterns evoked by cognitive and sensory tasks, the effects of different analytic approaches on the reliability and reproducibility of these RSNs have yet to be fully explored. Thus, the primary aim of the current study was to investigate the effect of method (independent component analyses [ICA] vs. seed-based analyses) on RSN reproducibility (independent datasets) for ICA and reliability (independent time points) in both methods using functional magnetic resonance imaging. Good to excellent reproducibility was observed in 9 out of 10 commonly identified RSNs, indicating the robustness of these intrinsic fluctuations at the group level. Reliability analyses showed that results were dependent on three main methodological factors: (1) group versus subject-level analyses (group>subject); (2) whether data from different visits were analyzed separately or jointly with ICA (combined>separate ICA); and (3) whether ICA output was used to directly assess reliability or to inform seed-based analyses (seed-based>ICA). These results suggest that variations in the analytic technique have a significant impact on individual reliability measurements, but do not significantly affect the reproducibility or reliability of RSNs at the group level. Further investigation into the effect of the analytic technique on RSN quantification is warranted to increase the utility of RSN analyses in clinical studies.

UR - http://www.scopus.com/inward/record.url?scp=84888834680&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84888834680&partnerID=8YFLogxK

U2 - 10.1089/brain.2012.0134

DO - 10.1089/brain.2012.0134

M3 - Chapter

C2 - 23705789

AN - SCOPUS:84888834680

VL - 3

SP - 363

EP - 374

BT - Brain Connectivity

ER -