An interobserver reproducibility study on invasiveness of bladder cancer using virtual microscopy and heatmaps

Eva Compérat, Lars Egevad, Antonio Lopez-Beltran, Philippe Camparo, Ferran Algaba, Mahul Amin, Jonathan I. Epstein, Hans Hamberg, Christina Hulsbergen-van de Kaa, Glen Kristiansen, Rodolfo Montironi, Chin Chen Pan, Fabrice Heloir, Kilian Treurniet, Jenna Sykes, Theo H. Van der Kwast

Research output: Contribution to journalArticlepeer-review


Aims: The distinction between non-invasive (pTa) and invasive (pT1) non-muscle invasive bladder cancer (NMIBC) is subject to considerable interobserver variation. We aimed to generate a teaching set of images based on the diagnostic opinions of a panel of expert genitourinary pathologists. Methods and results: Twenty-five transurethral resection specimens initially reported as pT1 NMIBC from two university hospitals were selected on the basis of potential uncertainty of stromal invasion. Digitized slides were reviewed independently by a panel of eight genitourinary pathologists, who annotated any invasive area if present. Annotations were reviewed by the lead panel, and heatmaps of annotated areas were constructed. Reasons for discrepancies were analysed, and kappa scores were calculated to determine agreement among the eight panellists. Full agreement by the eight panellists was obtained in 11 of 25 cases (44%), with a multi-rater (Fleiss) kappa of 0.47 (P < 0.0001). After joint review of the seven discordant (agreement <75% of panellists) cases, consensus was obtained for six cases, and a teaching set of images was generated. Conclusions: Interobserver agreement among the panellists in the selected cases was moderate, but consensus could be reached in almost all cases. Heatmaps proved to be instrumental in generating a teaching set of images for standardization of histological criteria for NMIBC invasion.

Original languageEnglish (US)
Pages (from-to)756-766
Number of pages11
Issue number6
StatePublished - Dec 2013


  • Bladder cancer
  • Interobserver variation
  • Pathological stage
  • Virtual microscopy
  • pT1 bladder cancer

ASJC Scopus subject areas

  • Pathology and Forensic Medicine
  • Histology


Dive into the research topics of 'An interobserver reproducibility study on invasiveness of bladder cancer using virtual microscopy and heatmaps'. Together they form a unique fingerprint.

Cite this