TY - JOUR
T1 - Need for quality improvement in renal systematic reviews
AU - Mrkobrada, Marko
AU - Thiessen-Philbrook, Heather
AU - Haynes, R. Brian
AU - Iansavichus, Arthur V.
AU - Rehman, Faisal
AU - Garg, Amit X.
PY - 2008/7
Y1 - 2008/7
N2 - Background and objectives: Systematic reviews of clinical studies aim to compile best available evidence for various diagnosis and treatment options. This study assessed the methodologic quality of all systematic reviews relevant to the practice of nephrology published in 2005. Design, setting, participants, & measurements: We searched electronic databases (Medline, Embase, American College of Physicians Journal Club, Cochrane) and hand searched Cochrane renal group records. Clinical practice guidelines, case reports, narrative reviews, and pooled individual patient data meta-analyses were excluded. Methodologic quality was measured using a validated questionnaire (Overview Quality Assessment Questionnaire). For reviews of randomized trials, we also evaluated adherence to recommended reporting guidelines (Quality of Reporting of Meta-Analyses). Results: Ninety renal systematic reviews were published in year 2005, 60 of which focused on therapy. Many systematic reviews (54%) had major methodologic flaws. The most common review flaws were failure to assess the methodologic quality of included primary studies and failure to minimize bias in study inclusion. Only 2% of reviews of randomized trials fully adhered to reporting guidelines. A minority of journals (four of 48) endorsed adherence to consensus guidelines for review reporting, and these journals published systematic reviews of higher methodologic quality (P < 0.001). Conclusions: The majority of systematic reviews had major methodologic flaws. The majority of journals do not endorse consensus guidelines for review reporting in their instructions to authors; however, journals that recommended such adherence published systemic reviews of higher methodologic quality.
AB - Background and objectives: Systematic reviews of clinical studies aim to compile best available evidence for various diagnosis and treatment options. This study assessed the methodologic quality of all systematic reviews relevant to the practice of nephrology published in 2005. Design, setting, participants, & measurements: We searched electronic databases (Medline, Embase, American College of Physicians Journal Club, Cochrane) and hand searched Cochrane renal group records. Clinical practice guidelines, case reports, narrative reviews, and pooled individual patient data meta-analyses were excluded. Methodologic quality was measured using a validated questionnaire (Overview Quality Assessment Questionnaire). For reviews of randomized trials, we also evaluated adherence to recommended reporting guidelines (Quality of Reporting of Meta-Analyses). Results: Ninety renal systematic reviews were published in year 2005, 60 of which focused on therapy. Many systematic reviews (54%) had major methodologic flaws. The most common review flaws were failure to assess the methodologic quality of included primary studies and failure to minimize bias in study inclusion. Only 2% of reviews of randomized trials fully adhered to reporting guidelines. A minority of journals (four of 48) endorsed adherence to consensus guidelines for review reporting, and these journals published systematic reviews of higher methodologic quality (P < 0.001). Conclusions: The majority of systematic reviews had major methodologic flaws. The majority of journals do not endorse consensus guidelines for review reporting in their instructions to authors; however, journals that recommended such adherence published systemic reviews of higher methodologic quality.
UR - http://www.scopus.com/inward/record.url?scp=49149102890&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=49149102890&partnerID=8YFLogxK
U2 - 10.2215/CJN.04401007
DO - 10.2215/CJN.04401007
M3 - Review article
C2 - 18400967
AN - SCOPUS:49149102890
VL - 3
SP - 1102
EP - 1114
JO - Clinical journal of the American Society of Nephrology : CJASN
JF - Clinical journal of the American Society of Nephrology : CJASN
SN - 1555-9041
IS - 4
ER -