Quantitative and Qualitative Analysis of the Impact of Adoption of a Mobile Application for the Assessment of Professionalism in Medical Trainees

Juan C. Cendán, Analia Castiglioni, Teresa R. Johnson, Mike Eakins, Marcia L. Verduin, Abdo Asmar, David Metcalf, Caridad Hernandez

Research output: Contribution to journalArticle

Abstract

PURPOSE: Capturing either lapses or excellence in behaviors related to medical professionalism is difficult. The authors report a mixed-methods analysis of a novel mobile platform for assessing medical professionalism in a training environment.

METHOD: A mobile Web-based platform to facilitate professionalism assessment in a situated clinical setting (Professional Mobile Monitoring of Behaviors [PROMOBES]) was developed. A professionalism framework consisting of six domains (reliability, adaptability, peer relationships, upholding principles, team relationships, and scholarship) encompassing 25 subelements underpins the reporting structure. This pilot study involved 26 faculty supervising 93 medical trainees at two sites from January 12 to August 8, 2016. Notable professionalism behaviors were linked to the framework domains and elements; narrative details about incidences were captured on mobile devices. Surveys gauged the technological functionality and impact of PROMOBES on faculty assessment of professionalism. Qualitative focus groups were employed to elucidate user experience.

RESULTS: Although users anticipated PROMOBES's utility would be for reporting lapses in professionalism, 94.7% of reports were for commendation. Comfort assessing professionalism (P = .04) and recognition of the reporting procedures for professionalism-related concerns (P = .01) improved. PROMOBES attained high acceptance ratings. Focus group analysis revealed that the explicit connection to the professionalism framework was powerful; similarly, the near real-time reporting capability, multiple observer inputs, and positive feedback facilitation were strengths.

CONCLUSIONS: Making the professionalism framework visible and accessible via a mobile platform significantly strengthens faculty knowledge and behaviors regarding assessment. The strong desire to capture positive behaviors was an unexpected finding.

Original languageEnglish (US)
Pages (from-to)S33-S42
JournalAcademic medicine : journal of the Association of American Medical Colleges
Volume92
Issue number11
DOIs
StatePublished - Nov 1 2017

Fingerprint

trainee
monitoring
professionalism
functionality
incidence
Group
acceptance
rating
narrative

ASJC Scopus subject areas

  • Education

Cite this

Quantitative and Qualitative Analysis of the Impact of Adoption of a Mobile Application for the Assessment of Professionalism in Medical Trainees. / Cendán, Juan C.; Castiglioni, Analia; Johnson, Teresa R.; Eakins, Mike; Verduin, Marcia L.; Asmar, Abdo; Metcalf, David; Hernandez, Caridad.

In: Academic medicine : journal of the Association of American Medical Colleges, Vol. 92, No. 11, 01.11.2017, p. S33-S42.

Research output: Contribution to journalArticle

Cendán, Juan C. ; Castiglioni, Analia ; Johnson, Teresa R. ; Eakins, Mike ; Verduin, Marcia L. ; Asmar, Abdo ; Metcalf, David ; Hernandez, Caridad. / Quantitative and Qualitative Analysis of the Impact of Adoption of a Mobile Application for the Assessment of Professionalism in Medical Trainees. In: Academic medicine : journal of the Association of American Medical Colleges. 2017 ; Vol. 92, No. 11. pp. S33-S42.
@article{de12d6ca8f4743a486919e8285997c1c,
title = "Quantitative and Qualitative Analysis of the Impact of Adoption of a Mobile Application for the Assessment of Professionalism in Medical Trainees",
abstract = "PURPOSE: Capturing either lapses or excellence in behaviors related to medical professionalism is difficult. The authors report a mixed-methods analysis of a novel mobile platform for assessing medical professionalism in a training environment.METHOD: A mobile Web-based platform to facilitate professionalism assessment in a situated clinical setting (Professional Mobile Monitoring of Behaviors [PROMOBES]) was developed. A professionalism framework consisting of six domains (reliability, adaptability, peer relationships, upholding principles, team relationships, and scholarship) encompassing 25 subelements underpins the reporting structure. This pilot study involved 26 faculty supervising 93 medical trainees at two sites from January 12 to August 8, 2016. Notable professionalism behaviors were linked to the framework domains and elements; narrative details about incidences were captured on mobile devices. Surveys gauged the technological functionality and impact of PROMOBES on faculty assessment of professionalism. Qualitative focus groups were employed to elucidate user experience.RESULTS: Although users anticipated PROMOBES's utility would be for reporting lapses in professionalism, 94.7{\%} of reports were for commendation. Comfort assessing professionalism (P = .04) and recognition of the reporting procedures for professionalism-related concerns (P = .01) improved. PROMOBES attained high acceptance ratings. Focus group analysis revealed that the explicit connection to the professionalism framework was powerful; similarly, the near real-time reporting capability, multiple observer inputs, and positive feedback facilitation were strengths.CONCLUSIONS: Making the professionalism framework visible and accessible via a mobile platform significantly strengthens faculty knowledge and behaviors regarding assessment. The strong desire to capture positive behaviors was an unexpected finding.",
author = "Cend{\'a}n, {Juan C.} and Analia Castiglioni and Johnson, {Teresa R.} and Mike Eakins and Verduin, {Marcia L.} and Abdo Asmar and David Metcalf and Caridad Hernandez",
year = "2017",
month = "11",
day = "1",
doi = "10.1097/ACM.0000000000001922",
language = "English (US)",
volume = "92",
pages = "S33--S42",
journal = "Academic Medicine",
issn = "1040-2446",
publisher = "Lippincott Williams and Wilkins",
number = "11",

}

TY - JOUR

T1 - Quantitative and Qualitative Analysis of the Impact of Adoption of a Mobile Application for the Assessment of Professionalism in Medical Trainees

AU - Cendán, Juan C.

AU - Castiglioni, Analia

AU - Johnson, Teresa R.

AU - Eakins, Mike

AU - Verduin, Marcia L.

AU - Asmar, Abdo

AU - Metcalf, David

AU - Hernandez, Caridad

PY - 2017/11/1

Y1 - 2017/11/1

N2 - PURPOSE: Capturing either lapses or excellence in behaviors related to medical professionalism is difficult. The authors report a mixed-methods analysis of a novel mobile platform for assessing medical professionalism in a training environment.METHOD: A mobile Web-based platform to facilitate professionalism assessment in a situated clinical setting (Professional Mobile Monitoring of Behaviors [PROMOBES]) was developed. A professionalism framework consisting of six domains (reliability, adaptability, peer relationships, upholding principles, team relationships, and scholarship) encompassing 25 subelements underpins the reporting structure. This pilot study involved 26 faculty supervising 93 medical trainees at two sites from January 12 to August 8, 2016. Notable professionalism behaviors were linked to the framework domains and elements; narrative details about incidences were captured on mobile devices. Surveys gauged the technological functionality and impact of PROMOBES on faculty assessment of professionalism. Qualitative focus groups were employed to elucidate user experience.RESULTS: Although users anticipated PROMOBES's utility would be for reporting lapses in professionalism, 94.7% of reports were for commendation. Comfort assessing professionalism (P = .04) and recognition of the reporting procedures for professionalism-related concerns (P = .01) improved. PROMOBES attained high acceptance ratings. Focus group analysis revealed that the explicit connection to the professionalism framework was powerful; similarly, the near real-time reporting capability, multiple observer inputs, and positive feedback facilitation were strengths.CONCLUSIONS: Making the professionalism framework visible and accessible via a mobile platform significantly strengthens faculty knowledge and behaviors regarding assessment. The strong desire to capture positive behaviors was an unexpected finding.

AB - PURPOSE: Capturing either lapses or excellence in behaviors related to medical professionalism is difficult. The authors report a mixed-methods analysis of a novel mobile platform for assessing medical professionalism in a training environment.METHOD: A mobile Web-based platform to facilitate professionalism assessment in a situated clinical setting (Professional Mobile Monitoring of Behaviors [PROMOBES]) was developed. A professionalism framework consisting of six domains (reliability, adaptability, peer relationships, upholding principles, team relationships, and scholarship) encompassing 25 subelements underpins the reporting structure. This pilot study involved 26 faculty supervising 93 medical trainees at two sites from January 12 to August 8, 2016. Notable professionalism behaviors were linked to the framework domains and elements; narrative details about incidences were captured on mobile devices. Surveys gauged the technological functionality and impact of PROMOBES on faculty assessment of professionalism. Qualitative focus groups were employed to elucidate user experience.RESULTS: Although users anticipated PROMOBES's utility would be for reporting lapses in professionalism, 94.7% of reports were for commendation. Comfort assessing professionalism (P = .04) and recognition of the reporting procedures for professionalism-related concerns (P = .01) improved. PROMOBES attained high acceptance ratings. Focus group analysis revealed that the explicit connection to the professionalism framework was powerful; similarly, the near real-time reporting capability, multiple observer inputs, and positive feedback facilitation were strengths.CONCLUSIONS: Making the professionalism framework visible and accessible via a mobile platform significantly strengthens faculty knowledge and behaviors regarding assessment. The strong desire to capture positive behaviors was an unexpected finding.

UR - http://www.scopus.com/inward/record.url?scp=85032438631&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85032438631&partnerID=8YFLogxK

U2 - 10.1097/ACM.0000000000001922

DO - 10.1097/ACM.0000000000001922

M3 - Article

C2 - 29065021

AN - SCOPUS:85032438631

VL - 92

SP - S33-S42

JO - Academic Medicine

JF - Academic Medicine

SN - 1040-2446

IS - 11

ER -