MRI pyschophysics: An experimental framework relating image quality to diagnostic performance metrics

Purpose: To determine the minimal image quality needed to preserve diagnostic performance relative to arthroscopy in the knee. Materials and Methods: Synthetic noise was added to images from clinical MRI scans (three-dimensional SPACE pulse sequence; Siemens) from five patients who had undergone knee MRI with arthroscopic follow-up, resulting in 25 simulated sets of images with standardized signal-to-noise ratios (SNRs) of 1, 2, 5, 10, or 20. All cases were scored by four musculoskeletal radiologists progressing from low to high SNR and grading all cartilage surfaces, major ligaments and menisci on a 5-point scale. Receiver operator characteristic (ROC) curves were constructed for the detection of meniscal tears and cartilage abnormalities. The area under the ROC curve (AUC) was determined for each structure at each SNR level. In addition, reader confidence was measured and pairwise comparisons across SNR levels were performed. Results were compared with arthroscopy as the reference standard. Results: ROC AUC was maximized for meniscal tears at SNR = 5 (structure specific CNR = 3.2) and for cartilage abnormalities at SNR = 10 (CNR = 4.2). Observer confidence was maximized for menisci at SNR = 5 (CNR = 8.0), for ligaments at SNR = 10 (CNR = 13.6) and cartilage at SNR = 10 (CNR = 8.2). Conclusion: For 3D isotropic imaging in the knee, images with SNR < 10 or CNR < 10 should be rejected as nondiagnostic.