An optimal three-class linear observer derived from decision theory

Xin He, Eric Frey

Research output: Contribution to journalArticle

Abstract

Many attempts have been made to develop an optimal linear observer for classifying multiclass data. Most approaches either do not have a definite description of optimality or have regions of ambiguity in decision making. In this paper, we derive a three-class Retelling observer (3-HO), inspired by the ideal observer that results from a decision theoretic solution to the three-class classification problem. Assuming the data vectors follow multivariate Gaussian distributions with equal covariance matrices for the three classes, it is shown that two two-class Retelling templates construct a 3-HO which has the same performance as the three-class ideal observer (3-IO). We show that, without the Gaussian and equal Covariance assumptions, the 3-HO is still applicable when the two-class Hotelling templates of each pair of the classes satisfy a certain linear relationship. In this case, the 3-HO simultaneously maximizes the signal-to-noise (SNR) of the test statistics between each pair of the classes. In conclusion, we developed a three-class linear mathematical observer that uses first- and second-order ensemble data statistics. This mathematical observer, which has clearly defined optimality for several data statistics conditions and has decision rules that have no ambiguous decision regions, is potentially useful in the optimization and evaluation of imaging techniques for performing three-class diagnostic tasks.

Original languageEnglish (US)
Pages (from-to)77-83
Number of pages7
JournalIEEE Transactions on Medical Imaging
Volume26
Issue number1
DOIs
StatePublished - Jan 2007

Fingerprint

Decision Theory
Decision theory
Statistics
Normal Distribution
Gaussian distribution
Covariance matrix
Noise
Decision Making
Decision making
Imaging techniques

Keywords

  • Three-class classification
  • Three-class hotelling observer (HO)
  • Three-class receiver operating characteristic (ROC) analysis

ASJC Scopus subject areas

  • Biomedical Engineering
  • Radiology Nuclear Medicine and imaging
  • Radiological and Ultrasound Technology
  • Electrical and Electronic Engineering
  • Computer Science Applications
  • Computational Theory and Mathematics

Cite this

An optimal three-class linear observer derived from decision theory. / He, Xin; Frey, Eric.

In: IEEE Transactions on Medical Imaging, Vol. 26, No. 1, 01.2007, p. 77-83.

Research output: Contribution to journalArticle

@article{d62349838a8b40e9896841e81852e327,
title = "An optimal three-class linear observer derived from decision theory",
abstract = "Many attempts have been made to develop an optimal linear observer for classifying multiclass data. Most approaches either do not have a definite description of optimality or have regions of ambiguity in decision making. In this paper, we derive a three-class Retelling observer (3-HO), inspired by the ideal observer that results from a decision theoretic solution to the three-class classification problem. Assuming the data vectors follow multivariate Gaussian distributions with equal covariance matrices for the three classes, it is shown that two two-class Retelling templates construct a 3-HO which has the same performance as the three-class ideal observer (3-IO). We show that, without the Gaussian and equal Covariance assumptions, the 3-HO is still applicable when the two-class Hotelling templates of each pair of the classes satisfy a certain linear relationship. In this case, the 3-HO simultaneously maximizes the signal-to-noise (SNR) of the test statistics between each pair of the classes. In conclusion, we developed a three-class linear mathematical observer that uses first- and second-order ensemble data statistics. This mathematical observer, which has clearly defined optimality for several data statistics conditions and has decision rules that have no ambiguous decision regions, is potentially useful in the optimization and evaluation of imaging techniques for performing three-class diagnostic tasks.",
keywords = "Three-class classification, Three-class hotelling observer (HO), Three-class receiver operating characteristic (ROC) analysis",
author = "Xin He and Eric Frey",
year = "2007",
month = "1",
doi = "10.1109/TMI.2006.885335",
language = "English (US)",
volume = "26",
pages = "77--83",
journal = "IEEE Transactions on Medical Imaging",
issn = "0278-0062",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
number = "1",

}

TY - JOUR

T1 - An optimal three-class linear observer derived from decision theory

AU - He, Xin

AU - Frey, Eric

PY - 2007/1

Y1 - 2007/1

N2 - Many attempts have been made to develop an optimal linear observer for classifying multiclass data. Most approaches either do not have a definite description of optimality or have regions of ambiguity in decision making. In this paper, we derive a three-class Retelling observer (3-HO), inspired by the ideal observer that results from a decision theoretic solution to the three-class classification problem. Assuming the data vectors follow multivariate Gaussian distributions with equal covariance matrices for the three classes, it is shown that two two-class Retelling templates construct a 3-HO which has the same performance as the three-class ideal observer (3-IO). We show that, without the Gaussian and equal Covariance assumptions, the 3-HO is still applicable when the two-class Hotelling templates of each pair of the classes satisfy a certain linear relationship. In this case, the 3-HO simultaneously maximizes the signal-to-noise (SNR) of the test statistics between each pair of the classes. In conclusion, we developed a three-class linear mathematical observer that uses first- and second-order ensemble data statistics. This mathematical observer, which has clearly defined optimality for several data statistics conditions and has decision rules that have no ambiguous decision regions, is potentially useful in the optimization and evaluation of imaging techniques for performing three-class diagnostic tasks.

AB - Many attempts have been made to develop an optimal linear observer for classifying multiclass data. Most approaches either do not have a definite description of optimality or have regions of ambiguity in decision making. In this paper, we derive a three-class Retelling observer (3-HO), inspired by the ideal observer that results from a decision theoretic solution to the three-class classification problem. Assuming the data vectors follow multivariate Gaussian distributions with equal covariance matrices for the three classes, it is shown that two two-class Retelling templates construct a 3-HO which has the same performance as the three-class ideal observer (3-IO). We show that, without the Gaussian and equal Covariance assumptions, the 3-HO is still applicable when the two-class Hotelling templates of each pair of the classes satisfy a certain linear relationship. In this case, the 3-HO simultaneously maximizes the signal-to-noise (SNR) of the test statistics between each pair of the classes. In conclusion, we developed a three-class linear mathematical observer that uses first- and second-order ensemble data statistics. This mathematical observer, which has clearly defined optimality for several data statistics conditions and has decision rules that have no ambiguous decision regions, is potentially useful in the optimization and evaluation of imaging techniques for performing three-class diagnostic tasks.

KW - Three-class classification

KW - Three-class hotelling observer (HO)

KW - Three-class receiver operating characteristic (ROC) analysis

UR - http://www.scopus.com/inward/record.url?scp=33846259294&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=33846259294&partnerID=8YFLogxK

U2 - 10.1109/TMI.2006.885335

DO - 10.1109/TMI.2006.885335

M3 - Article

VL - 26

SP - 77

EP - 83

JO - IEEE Transactions on Medical Imaging

JF - IEEE Transactions on Medical Imaging

SN - 0278-0062

IS - 1

ER -