An open science resource for establishing reliability and reproducibility in functional connectomics

Xi Nian Zuo, Jeffrey S. Anderson, Pierre Bellec, Rasmus M. Birn, Bharat B. Biswal, Janusch Blautzik, John C.S. Breitner, Randy L. Buckner, Vince Daniel Calhoun, F. Xavier Castellanos, Antao Chen, Bing Chen, Jiangtao Chen, Xu Chen, Stanley J. Colcombe, William Courtney, R. Cameron Craddock, Adriana Di Martino, Hao Ming Dong, Xiaolan FuQiyong Gong, Krzysztof J. Gorgolewski, Ying Han, Ye He, Yong He, Erica Ho, Avram Holmes, Xiao Hui Hou, Jeremy Huckins, Tianzi Jiang, Yi Jiang, William Kelley, Clare Kelly, Margaret King, Stephen M. LaConte, Janet E. Lainhart, Xu Lei, Hui Jie Li, Kaiming Li, Kuncheng Li, Qixiang Lin, Dongqiang Liu, Jia Liu, Xun Liu, Yijun Liu, Guangming Lu, Jie Lu, Beatriz Luna, Jing Luo, Daniel Lurie, Ying Mao, Daniel S. Margulies, Andrew R. Mayer, Thomas Meindl, Mary E. Meyerand, Weizhi Nan, Jared A. Nielsen, David O'Connor, David Paulsen, Vivek Prabhakaran, Zhigang Qi, Jiang Qiu, Chunhong Shao, Zarrar Shehzad, Weijun Tang, Arno Villringer, Huiling Wang, Kai Wang, Dongtao Wei, Gao Xia Wei, Xu Chu Weng, Xuehai Wu, Ting Xu, Ning Yang, Zhi Yang, Yu Feng Zang, Lei Zhang, Qinglin Zhang, Zhe Zhang, Zhiqiang Zhang, Ke Zhao, Zonglei Zhen, Yuan Zhou, Xing Ting Zhu, Michael P. Milham

Research output: Contribution to journalArticle

Abstract

Efforts to identify meaningful functional imaging-based biomarkers are limited by the ability to reliably characterize inter-individual differences in human brain function. Although a growing number of connectomics-based measures are reported to have moderate to high test-retest reliability, the variability in data acquisition, experimental designs, and analytic methods precludes the ability to generalize results. The Consortium for Reliability and Reproducibility (CoRR) is working to address this challenge and establish test-retest reliability as a minimum standard for methods development in functional connectomics. Specifically, CoRR has aggregated 1,629 typical individuals' resting state fMRI (rfMRI) data (5,093 rfMRI scans) from 18 international sites, and is openly sharing them via the International Data-sharing Neuroimaging Initiative (INDI). To allow researchers to generate various estimates of reliability and reproducibility, a variety of data acquisition procedures and experimental designs are included. Similarly, to enable users to assess the impact of commonly encountered artifacts (for example, motion) on characterizations of inter-individual variation, datasets of varying quality are included.

Original languageEnglish (US)
Article number140049
JournalScientific data
Volume1
DOIs
StatePublished - Dec 9 2014
Externally publishedYes

Fingerprint

Reproducibility
Resources
science
resources
Functional Magnetic Resonance Imaging
data acquisition
Experimental design
Data Acquisition
Design of experiments
Data acquisition
Neuroimaging
Individual Differences
Data Sharing
Biomarkers
ability
Brain
artifact
brain
Sharing
Imaging

ASJC Scopus subject areas

  • Education
  • Library and Information Sciences
  • Computer Science Applications
  • Information Systems
  • Statistics, Probability and Uncertainty
  • Statistics and Probability

Cite this

Zuo, X. N., Anderson, J. S., Bellec, P., Birn, R. M., Biswal, B. B., Blautzik, J., ... Milham, M. P. (2014). An open science resource for establishing reliability and reproducibility in functional connectomics. Scientific data, 1, [140049]. https://doi.org/10.1038/sdata.2014.49

An open science resource for establishing reliability and reproducibility in functional connectomics. / Zuo, Xi Nian; Anderson, Jeffrey S.; Bellec, Pierre; Birn, Rasmus M.; Biswal, Bharat B.; Blautzik, Janusch; Breitner, John C.S.; Buckner, Randy L.; Calhoun, Vince Daniel; Castellanos, F. Xavier; Chen, Antao; Chen, Bing; Chen, Jiangtao; Chen, Xu; Colcombe, Stanley J.; Courtney, William; Craddock, R. Cameron; Di Martino, Adriana; Dong, Hao Ming; Fu, Xiaolan; Gong, Qiyong; Gorgolewski, Krzysztof J.; Han, Ying; He, Ye; He, Yong; Ho, Erica; Holmes, Avram; Hou, Xiao Hui; Huckins, Jeremy; Jiang, Tianzi; Jiang, Yi; Kelley, William; Kelly, Clare; King, Margaret; LaConte, Stephen M.; Lainhart, Janet E.; Lei, Xu; Li, Hui Jie; Li, Kaiming; Li, Kuncheng; Lin, Qixiang; Liu, Dongqiang; Liu, Jia; Liu, Xun; Liu, Yijun; Lu, Guangming; Lu, Jie; Luna, Beatriz; Luo, Jing; Lurie, Daniel; Mao, Ying; Margulies, Daniel S.; Mayer, Andrew R.; Meindl, Thomas; Meyerand, Mary E.; Nan, Weizhi; Nielsen, Jared A.; O'Connor, David; Paulsen, David; Prabhakaran, Vivek; Qi, Zhigang; Qiu, Jiang; Shao, Chunhong; Shehzad, Zarrar; Tang, Weijun; Villringer, Arno; Wang, Huiling; Wang, Kai; Wei, Dongtao; Wei, Gao Xia; Weng, Xu Chu; Wu, Xuehai; Xu, Ting; Yang, Ning; Yang, Zhi; Zang, Yu Feng; Zhang, Lei; Zhang, Qinglin; Zhang, Zhe; Zhang, Zhiqiang; Zhao, Ke; Zhen, Zonglei; Zhou, Yuan; Zhu, Xing Ting; Milham, Michael P.

In: Scientific data, Vol. 1, 140049, 09.12.2014.

Research output: Contribution to journalArticle

Zuo, XN, Anderson, JS, Bellec, P, Birn, RM, Biswal, BB, Blautzik, J, Breitner, JCS, Buckner, RL, Calhoun, VD, Castellanos, FX, Chen, A, Chen, B, Chen, J, Chen, X, Colcombe, SJ, Courtney, W, Craddock, RC, Di Martino, A, Dong, HM, Fu, X, Gong, Q, Gorgolewski, KJ, Han, Y, He, Y, He, Y, Ho, E, Holmes, A, Hou, XH, Huckins, J, Jiang, T, Jiang, Y, Kelley, W, Kelly, C, King, M, LaConte, SM, Lainhart, JE, Lei, X, Li, HJ, Li, K, Li, K, Lin, Q, Liu, D, Liu, J, Liu, X, Liu, Y, Lu, G, Lu, J, Luna, B, Luo, J, Lurie, D, Mao, Y, Margulies, DS, Mayer, AR, Meindl, T, Meyerand, ME, Nan, W, Nielsen, JA, O'Connor, D, Paulsen, D, Prabhakaran, V, Qi, Z, Qiu, J, Shao, C, Shehzad, Z, Tang, W, Villringer, A, Wang, H, Wang, K, Wei, D, Wei, GX, Weng, XC, Wu, X, Xu, T, Yang, N, Yang, Z, Zang, YF, Zhang, L, Zhang, Q, Zhang, Z, Zhang, Z, Zhao, K, Zhen, Z, Zhou, Y, Zhu, XT & Milham, MP 2014, 'An open science resource for establishing reliability and reproducibility in functional connectomics', Scientific data, vol. 1, 140049. https://doi.org/10.1038/sdata.2014.49
Zuo, Xi Nian ; Anderson, Jeffrey S. ; Bellec, Pierre ; Birn, Rasmus M. ; Biswal, Bharat B. ; Blautzik, Janusch ; Breitner, John C.S. ; Buckner, Randy L. ; Calhoun, Vince Daniel ; Castellanos, F. Xavier ; Chen, Antao ; Chen, Bing ; Chen, Jiangtao ; Chen, Xu ; Colcombe, Stanley J. ; Courtney, William ; Craddock, R. Cameron ; Di Martino, Adriana ; Dong, Hao Ming ; Fu, Xiaolan ; Gong, Qiyong ; Gorgolewski, Krzysztof J. ; Han, Ying ; He, Ye ; He, Yong ; Ho, Erica ; Holmes, Avram ; Hou, Xiao Hui ; Huckins, Jeremy ; Jiang, Tianzi ; Jiang, Yi ; Kelley, William ; Kelly, Clare ; King, Margaret ; LaConte, Stephen M. ; Lainhart, Janet E. ; Lei, Xu ; Li, Hui Jie ; Li, Kaiming ; Li, Kuncheng ; Lin, Qixiang ; Liu, Dongqiang ; Liu, Jia ; Liu, Xun ; Liu, Yijun ; Lu, Guangming ; Lu, Jie ; Luna, Beatriz ; Luo, Jing ; Lurie, Daniel ; Mao, Ying ; Margulies, Daniel S. ; Mayer, Andrew R. ; Meindl, Thomas ; Meyerand, Mary E. ; Nan, Weizhi ; Nielsen, Jared A. ; O'Connor, David ; Paulsen, David ; Prabhakaran, Vivek ; Qi, Zhigang ; Qiu, Jiang ; Shao, Chunhong ; Shehzad, Zarrar ; Tang, Weijun ; Villringer, Arno ; Wang, Huiling ; Wang, Kai ; Wei, Dongtao ; Wei, Gao Xia ; Weng, Xu Chu ; Wu, Xuehai ; Xu, Ting ; Yang, Ning ; Yang, Zhi ; Zang, Yu Feng ; Zhang, Lei ; Zhang, Qinglin ; Zhang, Zhe ; Zhang, Zhiqiang ; Zhao, Ke ; Zhen, Zonglei ; Zhou, Yuan ; Zhu, Xing Ting ; Milham, Michael P. / An open science resource for establishing reliability and reproducibility in functional connectomics. In: Scientific data. 2014 ; Vol. 1.
@article{0692671fefa140ef90b745376f09fd89,
title = "An open science resource for establishing reliability and reproducibility in functional connectomics",
abstract = "Efforts to identify meaningful functional imaging-based biomarkers are limited by the ability to reliably characterize inter-individual differences in human brain function. Although a growing number of connectomics-based measures are reported to have moderate to high test-retest reliability, the variability in data acquisition, experimental designs, and analytic methods precludes the ability to generalize results. The Consortium for Reliability and Reproducibility (CoRR) is working to address this challenge and establish test-retest reliability as a minimum standard for methods development in functional connectomics. Specifically, CoRR has aggregated 1,629 typical individuals' resting state fMRI (rfMRI) data (5,093 rfMRI scans) from 18 international sites, and is openly sharing them via the International Data-sharing Neuroimaging Initiative (INDI). To allow researchers to generate various estimates of reliability and reproducibility, a variety of data acquisition procedures and experimental designs are included. Similarly, to enable users to assess the impact of commonly encountered artifacts (for example, motion) on characterizations of inter-individual variation, datasets of varying quality are included.",
author = "Zuo, {Xi Nian} and Anderson, {Jeffrey S.} and Pierre Bellec and Birn, {Rasmus M.} and Biswal, {Bharat B.} and Janusch Blautzik and Breitner, {John C.S.} and Buckner, {Randy L.} and Calhoun, {Vince Daniel} and Castellanos, {F. Xavier} and Antao Chen and Bing Chen and Jiangtao Chen and Xu Chen and Colcombe, {Stanley J.} and William Courtney and Craddock, {R. Cameron} and {Di Martino}, Adriana and Dong, {Hao Ming} and Xiaolan Fu and Qiyong Gong and Gorgolewski, {Krzysztof J.} and Ying Han and Ye He and Yong He and Erica Ho and Avram Holmes and Hou, {Xiao Hui} and Jeremy Huckins and Tianzi Jiang and Yi Jiang and William Kelley and Clare Kelly and Margaret King and LaConte, {Stephen M.} and Lainhart, {Janet E.} and Xu Lei and Li, {Hui Jie} and Kaiming Li and Kuncheng Li and Qixiang Lin and Dongqiang Liu and Jia Liu and Xun Liu and Yijun Liu and Guangming Lu and Jie Lu and Beatriz Luna and Jing Luo and Daniel Lurie and Ying Mao and Margulies, {Daniel S.} and Mayer, {Andrew R.} and Thomas Meindl and Meyerand, {Mary E.} and Weizhi Nan and Nielsen, {Jared A.} and David O'Connor and David Paulsen and Vivek Prabhakaran and Zhigang Qi and Jiang Qiu and Chunhong Shao and Zarrar Shehzad and Weijun Tang and Arno Villringer and Huiling Wang and Kai Wang and Dongtao Wei and Wei, {Gao Xia} and Weng, {Xu Chu} and Xuehai Wu and Ting Xu and Ning Yang and Zhi Yang and Zang, {Yu Feng} and Lei Zhang and Qinglin Zhang and Zhe Zhang and Zhiqiang Zhang and Ke Zhao and Zonglei Zhen and Yuan Zhou and Zhu, {Xing Ting} and Milham, {Michael P.}",
year = "2014",
month = "12",
day = "9",
doi = "10.1038/sdata.2014.49",
language = "English (US)",
volume = "1",
journal = "Scientific data",
issn = "2052-4463",
publisher = "Nature Publishing Group",

}

TY - JOUR

T1 - An open science resource for establishing reliability and reproducibility in functional connectomics

AU - Zuo, Xi Nian

AU - Anderson, Jeffrey S.

AU - Bellec, Pierre

AU - Birn, Rasmus M.

AU - Biswal, Bharat B.

AU - Blautzik, Janusch

AU - Breitner, John C.S.

AU - Buckner, Randy L.

AU - Calhoun, Vince Daniel

AU - Castellanos, F. Xavier

AU - Chen, Antao

AU - Chen, Bing

AU - Chen, Jiangtao

AU - Chen, Xu

AU - Colcombe, Stanley J.

AU - Courtney, William

AU - Craddock, R. Cameron

AU - Di Martino, Adriana

AU - Dong, Hao Ming

AU - Fu, Xiaolan

AU - Gong, Qiyong

AU - Gorgolewski, Krzysztof J.

AU - Han, Ying

AU - He, Ye

AU - He, Yong

AU - Ho, Erica

AU - Holmes, Avram

AU - Hou, Xiao Hui

AU - Huckins, Jeremy

AU - Jiang, Tianzi

AU - Jiang, Yi

AU - Kelley, William

AU - Kelly, Clare

AU - King, Margaret

AU - LaConte, Stephen M.

AU - Lainhart, Janet E.

AU - Lei, Xu

AU - Li, Hui Jie

AU - Li, Kaiming

AU - Li, Kuncheng

AU - Lin, Qixiang

AU - Liu, Dongqiang

AU - Liu, Jia

AU - Liu, Xun

AU - Liu, Yijun

AU - Lu, Guangming

AU - Lu, Jie

AU - Luna, Beatriz

AU - Luo, Jing

AU - Lurie, Daniel

AU - Mao, Ying

AU - Margulies, Daniel S.

AU - Mayer, Andrew R.

AU - Meindl, Thomas

AU - Meyerand, Mary E.

AU - Nan, Weizhi

AU - Nielsen, Jared A.

AU - O'Connor, David

AU - Paulsen, David

AU - Prabhakaran, Vivek

AU - Qi, Zhigang

AU - Qiu, Jiang

AU - Shao, Chunhong

AU - Shehzad, Zarrar

AU - Tang, Weijun

AU - Villringer, Arno

AU - Wang, Huiling

AU - Wang, Kai

AU - Wei, Dongtao

AU - Wei, Gao Xia

AU - Weng, Xu Chu

AU - Wu, Xuehai

AU - Xu, Ting

AU - Yang, Ning

AU - Yang, Zhi

AU - Zang, Yu Feng

AU - Zhang, Lei

AU - Zhang, Qinglin

AU - Zhang, Zhe

AU - Zhang, Zhiqiang

AU - Zhao, Ke

AU - Zhen, Zonglei

AU - Zhou, Yuan

AU - Zhu, Xing Ting

AU - Milham, Michael P.

PY - 2014/12/9

Y1 - 2014/12/9

N2 - Efforts to identify meaningful functional imaging-based biomarkers are limited by the ability to reliably characterize inter-individual differences in human brain function. Although a growing number of connectomics-based measures are reported to have moderate to high test-retest reliability, the variability in data acquisition, experimental designs, and analytic methods precludes the ability to generalize results. The Consortium for Reliability and Reproducibility (CoRR) is working to address this challenge and establish test-retest reliability as a minimum standard for methods development in functional connectomics. Specifically, CoRR has aggregated 1,629 typical individuals' resting state fMRI (rfMRI) data (5,093 rfMRI scans) from 18 international sites, and is openly sharing them via the International Data-sharing Neuroimaging Initiative (INDI). To allow researchers to generate various estimates of reliability and reproducibility, a variety of data acquisition procedures and experimental designs are included. Similarly, to enable users to assess the impact of commonly encountered artifacts (for example, motion) on characterizations of inter-individual variation, datasets of varying quality are included.

AB - Efforts to identify meaningful functional imaging-based biomarkers are limited by the ability to reliably characterize inter-individual differences in human brain function. Although a growing number of connectomics-based measures are reported to have moderate to high test-retest reliability, the variability in data acquisition, experimental designs, and analytic methods precludes the ability to generalize results. The Consortium for Reliability and Reproducibility (CoRR) is working to address this challenge and establish test-retest reliability as a minimum standard for methods development in functional connectomics. Specifically, CoRR has aggregated 1,629 typical individuals' resting state fMRI (rfMRI) data (5,093 rfMRI scans) from 18 international sites, and is openly sharing them via the International Data-sharing Neuroimaging Initiative (INDI). To allow researchers to generate various estimates of reliability and reproducibility, a variety of data acquisition procedures and experimental designs are included. Similarly, to enable users to assess the impact of commonly encountered artifacts (for example, motion) on characterizations of inter-individual variation, datasets of varying quality are included.

UR - http://www.scopus.com/inward/record.url?scp=84928119439&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84928119439&partnerID=8YFLogxK

U2 - 10.1038/sdata.2014.49

DO - 10.1038/sdata.2014.49

M3 - Article

C2 - 25977800

AN - SCOPUS:84928119439

VL - 1

JO - Scientific data

JF - Scientific data

SN - 2052-4463

M1 - 140049

ER -