An assessment of the reliability of the enneking and weinstein-boriani- biagini classifications for staging of primary spinal tumors by the spine oncology study group

Patrick Chan, Stefano Boriani, Daryl R. Fourney, Roberto Biagini, Mark B. Dekutoski, Michael G. Fehlings, Timothy C. Ryken, Ziya L. Gokaslan, Frank D. Vrionis, James S. Harrop, Meic H. Schmidt, Luis R. Vialle, Peter C. Gerszten, Laurence D. Rhines, Stephen L. Ondra, Stuart R. Pratt, Charles G. Fisher

Research output: Contribution to journalArticle

Abstract

STUDY DESIGN.: Reliability analysis based on expert panel case series review and grading per the Enneking and Weinstein-Boriani-Biagini classification systems. OBJECTIVE.: To assess the reliability of the Enneking and Weinstein-Boriani-Biagini classification systems. SUMMARY OF BACKGROUND DATA.: The Enneking and Weinstein-Boriani-Biagini (WBB) classifications were developed to stage and facilitate treatment planning in patients with primary spine tumors. To date, their interobserver and intraobserver reliability has not been assessed-a fundamental step in facilitating broader clinical and research use. METHODS.: Clinical information, imaging studies, and biopsy results were compiled from 15 selected patients with primary spinal tumors. Eighteen spine surgeons independently estimated and scored the cases for Enneking grade, tumor and metastasis categories, Enneking stage, Enneking-recommended surgical margin, WBB zones and layers, and WBB-recommended surgical procedures, with a second assessment performed after random resorting of cases. Interobserver and intraobserver reliability of each category were assessed by percent agreement or proportional overlap. The Fleiss, Cohen, and Mezzich κ statistics (κ) were then applied, determined by the type of variable analyzed. RESULTS.: The κ statistics for interobserver reliability were 0.82, 0.22, 0.00, 0.57, 0.47, 0.31, 0.58, and 0.54 for the fields of Enneking grade, tumor and metastasis categories, Enneking stage, Enneking-recommended surgical margin, WBB zones and layers, and WBB-recommended surgical procedures, respectively. The κ statistics for intraobserver reliability were 0.97, 0.53, 0.47, 0.82, 0.67, 0.63, 0.79, and 0.79 for the same respective fields. According to Landis and Koch, the ranges of κ values of 0.00 to 0.20, 0.21 to 0.40, 0.41 to 0.60, 0.61 to 0.80, and >0.80 imply slight, fair, moderate, substantial, and near-perfect agreement, respectively. CONCLUSION.: Results indicate moderate interobserver reliability and substantial and near-perfect intraobserver reliability for both the Enneking and WBB classification in terms of staging and guidance for treatment, despite a less than moderate interobserver reliability in interpreting the Enneking local tumor extension and WBB sector. Before incorporating the classifications in the clinical practice and research studies, further work is required to investigate the validity of the classifications.

Original languageEnglish (US)
Pages (from-to)384-391
Number of pages8
JournalSpine
Volume34
Issue number4
DOIs
StatePublished - Feb 15 2009

Fingerprint

Spine
Neoplasms
Neoplasm Metastasis
Research
Biopsy
Therapeutics
Margins of Excision

Keywords

  • Classification system
  • Intraobserver reliability
  • Oncological staging
  • Primary tumors of spine

ASJC Scopus subject areas

  • Clinical Neurology
  • Orthopedics and Sports Medicine

Cite this

An assessment of the reliability of the enneking and weinstein-boriani- biagini classifications for staging of primary spinal tumors by the spine oncology study group. / Chan, Patrick; Boriani, Stefano; Fourney, Daryl R.; Biagini, Roberto; Dekutoski, Mark B.; Fehlings, Michael G.; Ryken, Timothy C.; Gokaslan, Ziya L.; Vrionis, Frank D.; Harrop, James S.; Schmidt, Meic H.; Vialle, Luis R.; Gerszten, Peter C.; Rhines, Laurence D.; Ondra, Stephen L.; Pratt, Stuart R.; Fisher, Charles G.

In: Spine, Vol. 34, No. 4, 15.02.2009, p. 384-391.

Research output: Contribution to journalArticle

Chan, P, Boriani, S, Fourney, DR, Biagini, R, Dekutoski, MB, Fehlings, MG, Ryken, TC, Gokaslan, ZL, Vrionis, FD, Harrop, JS, Schmidt, MH, Vialle, LR, Gerszten, PC, Rhines, LD, Ondra, SL, Pratt, SR & Fisher, CG 2009, 'An assessment of the reliability of the enneking and weinstein-boriani- biagini classifications for staging of primary spinal tumors by the spine oncology study group', Spine, vol. 34, no. 4, pp. 384-391. https://doi.org/10.1097/BRS.0b013e3181971283
Chan, Patrick ; Boriani, Stefano ; Fourney, Daryl R. ; Biagini, Roberto ; Dekutoski, Mark B. ; Fehlings, Michael G. ; Ryken, Timothy C. ; Gokaslan, Ziya L. ; Vrionis, Frank D. ; Harrop, James S. ; Schmidt, Meic H. ; Vialle, Luis R. ; Gerszten, Peter C. ; Rhines, Laurence D. ; Ondra, Stephen L. ; Pratt, Stuart R. ; Fisher, Charles G. / An assessment of the reliability of the enneking and weinstein-boriani- biagini classifications for staging of primary spinal tumors by the spine oncology study group. In: Spine. 2009 ; Vol. 34, No. 4. pp. 384-391.
@article{df684bb8c9844b73b40a921de20bf872,
title = "An assessment of the reliability of the enneking and weinstein-boriani- biagini classifications for staging of primary spinal tumors by the spine oncology study group",
abstract = "STUDY DESIGN.: Reliability analysis based on expert panel case series review and grading per the Enneking and Weinstein-Boriani-Biagini classification systems. OBJECTIVE.: To assess the reliability of the Enneking and Weinstein-Boriani-Biagini classification systems. SUMMARY OF BACKGROUND DATA.: The Enneking and Weinstein-Boriani-Biagini (WBB) classifications were developed to stage and facilitate treatment planning in patients with primary spine tumors. To date, their interobserver and intraobserver reliability has not been assessed-a fundamental step in facilitating broader clinical and research use. METHODS.: Clinical information, imaging studies, and biopsy results were compiled from 15 selected patients with primary spinal tumors. Eighteen spine surgeons independently estimated and scored the cases for Enneking grade, tumor and metastasis categories, Enneking stage, Enneking-recommended surgical margin, WBB zones and layers, and WBB-recommended surgical procedures, with a second assessment performed after random resorting of cases. Interobserver and intraobserver reliability of each category were assessed by percent agreement or proportional overlap. The Fleiss, Cohen, and Mezzich κ statistics (κ) were then applied, determined by the type of variable analyzed. RESULTS.: The κ statistics for interobserver reliability were 0.82, 0.22, 0.00, 0.57, 0.47, 0.31, 0.58, and 0.54 for the fields of Enneking grade, tumor and metastasis categories, Enneking stage, Enneking-recommended surgical margin, WBB zones and layers, and WBB-recommended surgical procedures, respectively. The κ statistics for intraobserver reliability were 0.97, 0.53, 0.47, 0.82, 0.67, 0.63, 0.79, and 0.79 for the same respective fields. According to Landis and Koch, the ranges of κ values of 0.00 to 0.20, 0.21 to 0.40, 0.41 to 0.60, 0.61 to 0.80, and >0.80 imply slight, fair, moderate, substantial, and near-perfect agreement, respectively. CONCLUSION.: Results indicate moderate interobserver reliability and substantial and near-perfect intraobserver reliability for both the Enneking and WBB classification in terms of staging and guidance for treatment, despite a less than moderate interobserver reliability in interpreting the Enneking local tumor extension and WBB sector. Before incorporating the classifications in the clinical practice and research studies, further work is required to investigate the validity of the classifications.",
keywords = "Classification system, Intraobserver reliability, Oncological staging, Primary tumors of spine",
author = "Patrick Chan and Stefano Boriani and Fourney, {Daryl R.} and Roberto Biagini and Dekutoski, {Mark B.} and Fehlings, {Michael G.} and Ryken, {Timothy C.} and Gokaslan, {Ziya L.} and Vrionis, {Frank D.} and Harrop, {James S.} and Schmidt, {Meic H.} and Vialle, {Luis R.} and Gerszten, {Peter C.} and Rhines, {Laurence D.} and Ondra, {Stephen L.} and Pratt, {Stuart R.} and Fisher, {Charles G.}",
year = "2009",
month = "2",
day = "15",
doi = "10.1097/BRS.0b013e3181971283",
language = "English (US)",
volume = "34",
pages = "384--391",
journal = "Spine",
issn = "0362-2436",
publisher = "Lippincott Williams and Wilkins",
number = "4",

}

TY - JOUR

T1 - An assessment of the reliability of the enneking and weinstein-boriani- biagini classifications for staging of primary spinal tumors by the spine oncology study group

AU - Chan, Patrick

AU - Boriani, Stefano

AU - Fourney, Daryl R.

AU - Biagini, Roberto

AU - Dekutoski, Mark B.

AU - Fehlings, Michael G.

AU - Ryken, Timothy C.

AU - Gokaslan, Ziya L.

AU - Vrionis, Frank D.

AU - Harrop, James S.

AU - Schmidt, Meic H.

AU - Vialle, Luis R.

AU - Gerszten, Peter C.

AU - Rhines, Laurence D.

AU - Ondra, Stephen L.

AU - Pratt, Stuart R.

AU - Fisher, Charles G.

PY - 2009/2/15

Y1 - 2009/2/15

N2 - STUDY DESIGN.: Reliability analysis based on expert panel case series review and grading per the Enneking and Weinstein-Boriani-Biagini classification systems. OBJECTIVE.: To assess the reliability of the Enneking and Weinstein-Boriani-Biagini classification systems. SUMMARY OF BACKGROUND DATA.: The Enneking and Weinstein-Boriani-Biagini (WBB) classifications were developed to stage and facilitate treatment planning in patients with primary spine tumors. To date, their interobserver and intraobserver reliability has not been assessed-a fundamental step in facilitating broader clinical and research use. METHODS.: Clinical information, imaging studies, and biopsy results were compiled from 15 selected patients with primary spinal tumors. Eighteen spine surgeons independently estimated and scored the cases for Enneking grade, tumor and metastasis categories, Enneking stage, Enneking-recommended surgical margin, WBB zones and layers, and WBB-recommended surgical procedures, with a second assessment performed after random resorting of cases. Interobserver and intraobserver reliability of each category were assessed by percent agreement or proportional overlap. The Fleiss, Cohen, and Mezzich κ statistics (κ) were then applied, determined by the type of variable analyzed. RESULTS.: The κ statistics for interobserver reliability were 0.82, 0.22, 0.00, 0.57, 0.47, 0.31, 0.58, and 0.54 for the fields of Enneking grade, tumor and metastasis categories, Enneking stage, Enneking-recommended surgical margin, WBB zones and layers, and WBB-recommended surgical procedures, respectively. The κ statistics for intraobserver reliability were 0.97, 0.53, 0.47, 0.82, 0.67, 0.63, 0.79, and 0.79 for the same respective fields. According to Landis and Koch, the ranges of κ values of 0.00 to 0.20, 0.21 to 0.40, 0.41 to 0.60, 0.61 to 0.80, and >0.80 imply slight, fair, moderate, substantial, and near-perfect agreement, respectively. CONCLUSION.: Results indicate moderate interobserver reliability and substantial and near-perfect intraobserver reliability for both the Enneking and WBB classification in terms of staging and guidance for treatment, despite a less than moderate interobserver reliability in interpreting the Enneking local tumor extension and WBB sector. Before incorporating the classifications in the clinical practice and research studies, further work is required to investigate the validity of the classifications.

AB - STUDY DESIGN.: Reliability analysis based on expert panel case series review and grading per the Enneking and Weinstein-Boriani-Biagini classification systems. OBJECTIVE.: To assess the reliability of the Enneking and Weinstein-Boriani-Biagini classification systems. SUMMARY OF BACKGROUND DATA.: The Enneking and Weinstein-Boriani-Biagini (WBB) classifications were developed to stage and facilitate treatment planning in patients with primary spine tumors. To date, their interobserver and intraobserver reliability has not been assessed-a fundamental step in facilitating broader clinical and research use. METHODS.: Clinical information, imaging studies, and biopsy results were compiled from 15 selected patients with primary spinal tumors. Eighteen spine surgeons independently estimated and scored the cases for Enneking grade, tumor and metastasis categories, Enneking stage, Enneking-recommended surgical margin, WBB zones and layers, and WBB-recommended surgical procedures, with a second assessment performed after random resorting of cases. Interobserver and intraobserver reliability of each category were assessed by percent agreement or proportional overlap. The Fleiss, Cohen, and Mezzich κ statistics (κ) were then applied, determined by the type of variable analyzed. RESULTS.: The κ statistics for interobserver reliability were 0.82, 0.22, 0.00, 0.57, 0.47, 0.31, 0.58, and 0.54 for the fields of Enneking grade, tumor and metastasis categories, Enneking stage, Enneking-recommended surgical margin, WBB zones and layers, and WBB-recommended surgical procedures, respectively. The κ statistics for intraobserver reliability were 0.97, 0.53, 0.47, 0.82, 0.67, 0.63, 0.79, and 0.79 for the same respective fields. According to Landis and Koch, the ranges of κ values of 0.00 to 0.20, 0.21 to 0.40, 0.41 to 0.60, 0.61 to 0.80, and >0.80 imply slight, fair, moderate, substantial, and near-perfect agreement, respectively. CONCLUSION.: Results indicate moderate interobserver reliability and substantial and near-perfect intraobserver reliability for both the Enneking and WBB classification in terms of staging and guidance for treatment, despite a less than moderate interobserver reliability in interpreting the Enneking local tumor extension and WBB sector. Before incorporating the classifications in the clinical practice and research studies, further work is required to investigate the validity of the classifications.

KW - Classification system

KW - Intraobserver reliability

KW - Oncological staging

KW - Primary tumors of spine

UR - http://www.scopus.com/inward/record.url?scp=64749091537&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=64749091537&partnerID=8YFLogxK

U2 - 10.1097/BRS.0b013e3181971283

DO - 10.1097/BRS.0b013e3181971283

M3 - Article

C2 - 19214098

AN - SCOPUS:64749091537

VL - 34

SP - 384

EP - 391

JO - Spine

JF - Spine

SN - 0362-2436

IS - 4

ER -