Comparison of Biomarker Modalities for Predicting Response to PD-1/PD-L1 Checkpoint Blockade: A Systematic Review and Meta-analysis

Steve Lu, Julie E. Stein, David L. Rimm, Daphne W. Wang, J. Michael Bell, Douglas B. Johnson, Jeffrey A. Sosman, Kurt A. Schalper, Robert A. Anders, Hao Wang, Clifford Hoyt, Drew M. Pardoll, Ludmila Danilova, Janis M. Taube

Research output: Contribution to journalReview article

Abstract

Importance: PD-L1 (programmed cell death ligand 1) immunohistochemistry (IHC), tumor mutational burden (TMB), gene expression profiling (GEP), and multiplex immunohistochemistry/immunofluorescence (mIHC/IF) assays have been used to assess pretreatment tumor tissue to predict response to anti-PD-1/PD-L1 therapies. However, the relative diagnostic performance of these modalities has yet to be established. Objective: To compare studies that assessed the diagnostic accuracy of PD-L1 IHC, TMB, GEP, and mIHC/IF in predicting response to anti-PD-1/PD-L1 therapy. Evidence Review: A search of PubMed (from inception to June 2018) and 2013 to 2018 annual meeting abstracts from the American Association for Cancer Research, American Society of Clinical Oncology, European Society for Medical Oncology, and Society for Immunotherapy of Cancer was conducted to identify studies that examined the use of PD-L1 IHC, TMB, GEP, and mIHC/IF assays to determine objective response to anti-PD-1/PD-L1 therapy. For PD-L1 IHC, only clinical trials that resulted in US Food and Drug Administration approval of indications for anti-PD-1/PD-L1 were included. Studies combining more than 1 modality were also included. Preferred Reporting Items for Systematic Reviews and Meta-analysis guidelines were followed. Two reviewers independently extracted the clinical outcomes and test results for each individual study. Main Outcomes and Measures: Summary receiver operating characteristic (sROC) curves; their associated area under the curve (AUC); and pooled sensitivity, specificity, positive and negative predictive values (PPV, NPV), and positive and negative likelihood ratios (LR+ and LR-) for each assay modality. Results: Tumor specimens representing over 10 different solid tumor types in 8135 patients were assayed, and the results were correlated with anti-PD-1/PD-L1 response. When each modality was evaluated with sROC curves, mIHC/IF had a significantly higher AUC (0.79) compared with PD-L1 IHC (AUC, 0.65, P <.001), GEP (AUC, 0.65, P =.003), and TMB (AUC, 0.69, P =.049). When multiple different modalities were combined such as PD-L1 IHC and/or GEP + TMB, the AUC drew nearer to that of mIHC/IF (0.74). All modalities demonstrated comparable NPV and LR-, whereas mIHC/IF demonstrated higher PPV (0.63) and LR+ (2.86) than the other approaches. Conclusions and Relevance: In this meta-analysis, tumor mutational burden, PD-L1 IHC, and GEP demonstrated comparable AUCs in predicting response to anti-PD-1/PD-L1 treatment. Multiplex immunohistochemistry/IF and multimodality biomarker strategies appear to be associated with improved performance over PD-L1 IHC, TMB, or GEP alone. Further studies with mIHC/IF and composite approaches with a larger number of patients will be required to confirm these findings. Additional study is also required to determine the most predictive analyte combinations and to determine whether biomarker modality performance varies by tumor type.

Original languageEnglish (US)
JournalJAMA Oncology
DOIs
StatePublished - Jan 1 2019

Fingerprint

CD274 Antigen
Meta-Analysis
Biomarkers
Immunohistochemistry
Gene Expression Profiling
Tumor Burden
Cell Death
Area Under Curve
Fluorescent Antibody Technique
Ligands
Neoplasms
ROC Curve

ASJC Scopus subject areas

  • Oncology
  • Cancer Research

Cite this

Comparison of Biomarker Modalities for Predicting Response to PD-1/PD-L1 Checkpoint Blockade : A Systematic Review and Meta-analysis. / Lu, Steve; Stein, Julie E.; Rimm, David L.; Wang, Daphne W.; Bell, J. Michael; Johnson, Douglas B.; Sosman, Jeffrey A.; Schalper, Kurt A.; Anders, Robert A.; Wang, Hao; Hoyt, Clifford; Pardoll, Drew M.; Danilova, Ludmila; Taube, Janis M.

In: JAMA Oncology, 01.01.2019.

Research output: Contribution to journalReview article

Lu, Steve ; Stein, Julie E. ; Rimm, David L. ; Wang, Daphne W. ; Bell, J. Michael ; Johnson, Douglas B. ; Sosman, Jeffrey A. ; Schalper, Kurt A. ; Anders, Robert A. ; Wang, Hao ; Hoyt, Clifford ; Pardoll, Drew M. ; Danilova, Ludmila ; Taube, Janis M. / Comparison of Biomarker Modalities for Predicting Response to PD-1/PD-L1 Checkpoint Blockade : A Systematic Review and Meta-analysis. In: JAMA Oncology. 2019.
@article{f46b2f4023bb4c31997ef48f682c3781,
title = "Comparison of Biomarker Modalities for Predicting Response to PD-1/PD-L1 Checkpoint Blockade: A Systematic Review and Meta-analysis",
abstract = "Importance: PD-L1 (programmed cell death ligand 1) immunohistochemistry (IHC), tumor mutational burden (TMB), gene expression profiling (GEP), and multiplex immunohistochemistry/immunofluorescence (mIHC/IF) assays have been used to assess pretreatment tumor tissue to predict response to anti-PD-1/PD-L1 therapies. However, the relative diagnostic performance of these modalities has yet to be established. Objective: To compare studies that assessed the diagnostic accuracy of PD-L1 IHC, TMB, GEP, and mIHC/IF in predicting response to anti-PD-1/PD-L1 therapy. Evidence Review: A search of PubMed (from inception to June 2018) and 2013 to 2018 annual meeting abstracts from the American Association for Cancer Research, American Society of Clinical Oncology, European Society for Medical Oncology, and Society for Immunotherapy of Cancer was conducted to identify studies that examined the use of PD-L1 IHC, TMB, GEP, and mIHC/IF assays to determine objective response to anti-PD-1/PD-L1 therapy. For PD-L1 IHC, only clinical trials that resulted in US Food and Drug Administration approval of indications for anti-PD-1/PD-L1 were included. Studies combining more than 1 modality were also included. Preferred Reporting Items for Systematic Reviews and Meta-analysis guidelines were followed. Two reviewers independently extracted the clinical outcomes and test results for each individual study. Main Outcomes and Measures: Summary receiver operating characteristic (sROC) curves; their associated area under the curve (AUC); and pooled sensitivity, specificity, positive and negative predictive values (PPV, NPV), and positive and negative likelihood ratios (LR+ and LR-) for each assay modality. Results: Tumor specimens representing over 10 different solid tumor types in 8135 patients were assayed, and the results were correlated with anti-PD-1/PD-L1 response. When each modality was evaluated with sROC curves, mIHC/IF had a significantly higher AUC (0.79) compared with PD-L1 IHC (AUC, 0.65, P <.001), GEP (AUC, 0.65, P =.003), and TMB (AUC, 0.69, P =.049). When multiple different modalities were combined such as PD-L1 IHC and/or GEP + TMB, the AUC drew nearer to that of mIHC/IF (0.74). All modalities demonstrated comparable NPV and LR-, whereas mIHC/IF demonstrated higher PPV (0.63) and LR+ (2.86) than the other approaches. Conclusions and Relevance: In this meta-analysis, tumor mutational burden, PD-L1 IHC, and GEP demonstrated comparable AUCs in predicting response to anti-PD-1/PD-L1 treatment. Multiplex immunohistochemistry/IF and multimodality biomarker strategies appear to be associated with improved performance over PD-L1 IHC, TMB, or GEP alone. Further studies with mIHC/IF and composite approaches with a larger number of patients will be required to confirm these findings. Additional study is also required to determine the most predictive analyte combinations and to determine whether biomarker modality performance varies by tumor type.",
author = "Steve Lu and Stein, {Julie E.} and Rimm, {David L.} and Wang, {Daphne W.} and Bell, {J. Michael} and Johnson, {Douglas B.} and Sosman, {Jeffrey A.} and Schalper, {Kurt A.} and Anders, {Robert A.} and Hao Wang and Clifford Hoyt and Pardoll, {Drew M.} and Ludmila Danilova and Taube, {Janis M.}",
year = "2019",
month = "1",
day = "1",
doi = "10.1001/jamaoncol.2019.1549",
language = "English (US)",
journal = "JAMA oncology",
issn = "2374-2437",
publisher = "American Medical Association",

}

TY - JOUR

T1 - Comparison of Biomarker Modalities for Predicting Response to PD-1/PD-L1 Checkpoint Blockade

T2 - A Systematic Review and Meta-analysis

AU - Lu, Steve

AU - Stein, Julie E.

AU - Rimm, David L.

AU - Wang, Daphne W.

AU - Bell, J. Michael

AU - Johnson, Douglas B.

AU - Sosman, Jeffrey A.

AU - Schalper, Kurt A.

AU - Anders, Robert A.

AU - Wang, Hao

AU - Hoyt, Clifford

AU - Pardoll, Drew M.

AU - Danilova, Ludmila

AU - Taube, Janis M.

PY - 2019/1/1

Y1 - 2019/1/1

N2 - Importance: PD-L1 (programmed cell death ligand 1) immunohistochemistry (IHC), tumor mutational burden (TMB), gene expression profiling (GEP), and multiplex immunohistochemistry/immunofluorescence (mIHC/IF) assays have been used to assess pretreatment tumor tissue to predict response to anti-PD-1/PD-L1 therapies. However, the relative diagnostic performance of these modalities has yet to be established. Objective: To compare studies that assessed the diagnostic accuracy of PD-L1 IHC, TMB, GEP, and mIHC/IF in predicting response to anti-PD-1/PD-L1 therapy. Evidence Review: A search of PubMed (from inception to June 2018) and 2013 to 2018 annual meeting abstracts from the American Association for Cancer Research, American Society of Clinical Oncology, European Society for Medical Oncology, and Society for Immunotherapy of Cancer was conducted to identify studies that examined the use of PD-L1 IHC, TMB, GEP, and mIHC/IF assays to determine objective response to anti-PD-1/PD-L1 therapy. For PD-L1 IHC, only clinical trials that resulted in US Food and Drug Administration approval of indications for anti-PD-1/PD-L1 were included. Studies combining more than 1 modality were also included. Preferred Reporting Items for Systematic Reviews and Meta-analysis guidelines were followed. Two reviewers independently extracted the clinical outcomes and test results for each individual study. Main Outcomes and Measures: Summary receiver operating characteristic (sROC) curves; their associated area under the curve (AUC); and pooled sensitivity, specificity, positive and negative predictive values (PPV, NPV), and positive and negative likelihood ratios (LR+ and LR-) for each assay modality. Results: Tumor specimens representing over 10 different solid tumor types in 8135 patients were assayed, and the results were correlated with anti-PD-1/PD-L1 response. When each modality was evaluated with sROC curves, mIHC/IF had a significantly higher AUC (0.79) compared with PD-L1 IHC (AUC, 0.65, P <.001), GEP (AUC, 0.65, P =.003), and TMB (AUC, 0.69, P =.049). When multiple different modalities were combined such as PD-L1 IHC and/or GEP + TMB, the AUC drew nearer to that of mIHC/IF (0.74). All modalities demonstrated comparable NPV and LR-, whereas mIHC/IF demonstrated higher PPV (0.63) and LR+ (2.86) than the other approaches. Conclusions and Relevance: In this meta-analysis, tumor mutational burden, PD-L1 IHC, and GEP demonstrated comparable AUCs in predicting response to anti-PD-1/PD-L1 treatment. Multiplex immunohistochemistry/IF and multimodality biomarker strategies appear to be associated with improved performance over PD-L1 IHC, TMB, or GEP alone. Further studies with mIHC/IF and composite approaches with a larger number of patients will be required to confirm these findings. Additional study is also required to determine the most predictive analyte combinations and to determine whether biomarker modality performance varies by tumor type.

AB - Importance: PD-L1 (programmed cell death ligand 1) immunohistochemistry (IHC), tumor mutational burden (TMB), gene expression profiling (GEP), and multiplex immunohistochemistry/immunofluorescence (mIHC/IF) assays have been used to assess pretreatment tumor tissue to predict response to anti-PD-1/PD-L1 therapies. However, the relative diagnostic performance of these modalities has yet to be established. Objective: To compare studies that assessed the diagnostic accuracy of PD-L1 IHC, TMB, GEP, and mIHC/IF in predicting response to anti-PD-1/PD-L1 therapy. Evidence Review: A search of PubMed (from inception to June 2018) and 2013 to 2018 annual meeting abstracts from the American Association for Cancer Research, American Society of Clinical Oncology, European Society for Medical Oncology, and Society for Immunotherapy of Cancer was conducted to identify studies that examined the use of PD-L1 IHC, TMB, GEP, and mIHC/IF assays to determine objective response to anti-PD-1/PD-L1 therapy. For PD-L1 IHC, only clinical trials that resulted in US Food and Drug Administration approval of indications for anti-PD-1/PD-L1 were included. Studies combining more than 1 modality were also included. Preferred Reporting Items for Systematic Reviews and Meta-analysis guidelines were followed. Two reviewers independently extracted the clinical outcomes and test results for each individual study. Main Outcomes and Measures: Summary receiver operating characteristic (sROC) curves; their associated area under the curve (AUC); and pooled sensitivity, specificity, positive and negative predictive values (PPV, NPV), and positive and negative likelihood ratios (LR+ and LR-) for each assay modality. Results: Tumor specimens representing over 10 different solid tumor types in 8135 patients were assayed, and the results were correlated with anti-PD-1/PD-L1 response. When each modality was evaluated with sROC curves, mIHC/IF had a significantly higher AUC (0.79) compared with PD-L1 IHC (AUC, 0.65, P <.001), GEP (AUC, 0.65, P =.003), and TMB (AUC, 0.69, P =.049). When multiple different modalities were combined such as PD-L1 IHC and/or GEP + TMB, the AUC drew nearer to that of mIHC/IF (0.74). All modalities demonstrated comparable NPV and LR-, whereas mIHC/IF demonstrated higher PPV (0.63) and LR+ (2.86) than the other approaches. Conclusions and Relevance: In this meta-analysis, tumor mutational burden, PD-L1 IHC, and GEP demonstrated comparable AUCs in predicting response to anti-PD-1/PD-L1 treatment. Multiplex immunohistochemistry/IF and multimodality biomarker strategies appear to be associated with improved performance over PD-L1 IHC, TMB, or GEP alone. Further studies with mIHC/IF and composite approaches with a larger number of patients will be required to confirm these findings. Additional study is also required to determine the most predictive analyte combinations and to determine whether biomarker modality performance varies by tumor type.

UR - http://www.scopus.com/inward/record.url?scp=85069467444&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85069467444&partnerID=8YFLogxK

U2 - 10.1001/jamaoncol.2019.1549

DO - 10.1001/jamaoncol.2019.1549

M3 - Review article

C2 - 31318407

AN - SCOPUS:85069467444

JO - JAMA oncology

JF - JAMA oncology

SN - 2374-2437

ER -