A content validity analysis of neoplastic items of the national board of medical examiners part II examination

As part of its evaluation of the Clinical Cancer Education Program (CCEP) at the Albert Einstein College of Medicine, the Office of Educational Research and Evaluation analyzed student performance on neoplastic items of the National Board of Medical Examiners (NBME) Examination Part II. The evaluation provided a successful application of the American Association for Cancer Education (AACE) coding schema for analysis of neoplastic items. Two examinations were analyzed in order to determine the frequency with which specific disease sites, treatment modalities, and question emphasis items appeared. With reference to disease site, the greatest number of questions on both examinations dealt with gynecological issues while the fewest dealt with lung and hematologic‐related disease. A breakdown of questions into various treatment modalities indicated that of items that could be categorized, most dealt with surgical treatment, while other therapeutic modalities were given little or no emphasis. Looking at question emphases, the most frequently asked questions referred to diagnostic tests and stratagems, whereas the least amount of emphasis was placed on rehabilitative and psychosocial aspects of the disease. These findings corroborate those reported by Ruckdeschel and his associates and point out several limitations to the content validity of the neoplastic items on NBME Part II.