TY - JOUR
T1 - Improving Interpretability of Subjective Assessments About Psychological Phenomena
T2 - A Review and Cross-Cultural Meta-Analysis
AU - De Los Reyes, Andres
AU - Lerner, Matthew D.
AU - Keeley, Lauren M.
AU - Weber, Rebecca J.
AU - Drabick, Deborah A.G.
AU - Rabinowitz, Jill
AU - Goodman, Kimberly L.
N1 - Publisher Copyright:
© American Psychological Association 2019.
PY - 2019/9/1
Y1 - 2019/9/1
N2 - Attempts to understand subjectivity have historically involved distinguishing the strengths of subjective methods (e.g., survey ratings from informants) from those of alternative methods (e.g., observational/performance-based tasks). Yet a movement is underway in Psychology that considers the merits of intersubjectivity: Understanding the space between two or more informant’s subjective impressions of a common person or phenomenon. In mental health research, understanding differences between subjective impressions have less to do with informants’ characteristics and more to do with the social environments or contexts germane to the people or phenomena examined. Our article focuses on one relatively understudied social environment: the cultural context. We draw from seminal work on psychological universals, as well as emerging work on cultural norms (i.e., cultural tightness) to understand intersubjectivity effects through a cross-cultural lens. We report a meta-analysis of 314 studies of intersubjectivity effects in mental health, revealing that (a) this work involves independent research teams in more than 30 countries, (b) informants rating a target person’s mental health (e.g., parent and teacher ratings of a child’s behavior) commonly provide diverging estimates of that person’s mental health, and (c) greater convergence between subjective reports relates to a “tighter” or more norms-bound culture. Our article illustrates strategies for understanding divergence between subjective reports. In particular, we highlight theoretical and methodological frameworks for examining patterns of divergence between subjective reports in relation to data from nonsubjective methods. We also describe how research on intersubjectivity informs efforts to improve the interpretability of subjective assessments in multiple subdisciplines in Psychology.
AB - Attempts to understand subjectivity have historically involved distinguishing the strengths of subjective methods (e.g., survey ratings from informants) from those of alternative methods (e.g., observational/performance-based tasks). Yet a movement is underway in Psychology that considers the merits of intersubjectivity: Understanding the space between two or more informant’s subjective impressions of a common person or phenomenon. In mental health research, understanding differences between subjective impressions have less to do with informants’ characteristics and more to do with the social environments or contexts germane to the people or phenomena examined. Our article focuses on one relatively understudied social environment: the cultural context. We draw from seminal work on psychological universals, as well as emerging work on cultural norms (i.e., cultural tightness) to understand intersubjectivity effects through a cross-cultural lens. We report a meta-analysis of 314 studies of intersubjectivity effects in mental health, revealing that (a) this work involves independent research teams in more than 30 countries, (b) informants rating a target person’s mental health (e.g., parent and teacher ratings of a child’s behavior) commonly provide diverging estimates of that person’s mental health, and (c) greater convergence between subjective reports relates to a “tighter” or more norms-bound culture. Our article illustrates strategies for understanding divergence between subjective reports. In particular, we highlight theoretical and methodological frameworks for examining patterns of divergence between subjective reports in relation to data from nonsubjective methods. We also describe how research on intersubjectivity informs efforts to improve the interpretability of subjective assessments in multiple subdisciplines in Psychology.
KW - Operations Triad Model
KW - converging operations
KW - informant discrepancies
KW - intersubjectivity
KW - multiple informants
UR - http://www.scopus.com/inward/record.url?scp=85067926218&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85067926218&partnerID=8YFLogxK
U2 - 10.1177/1089268019837645
DO - 10.1177/1089268019837645
M3 - Article
AN - SCOPUS:85067926218
SN - 1089-2680
VL - 23
SP - 293
EP - 319
JO - Review of General Psychology
JF - Review of General Psychology
IS - 3
ER -