TY - JOUR
T1 - Evaluating a Situational Judgment Test for Use in Medical School Admissions
T2 - Two Years of AAMC PREview Exam Administration Data
AU - Ellison, Halle B.
AU - Grabowski, Christina J.
AU - Schmude, Michelle
AU - Costa, Joseph B.
AU - Naemi, Bobby
AU - Schmidt, Martin
AU - Patel, Dimple
AU - Westervelt, Marjorie
N1 - Publisher Copyright:
© Lippincott Williams & Wilkins.
PY - 2024/2/1
Y1 - 2024/2/1
N2 - Purpose To examine the relationship between the Association of American Medical Colleges (AAMC) Professional Readiness Exam (PREview) scores and other admissions data, group differences in mean PREview scores, and whether adding a new assessment tool affected the volume and composition of applicant pools. Method Data from the 2020 and 2021 PREview exam administrations were analyzed. Two U.S. schools participated in the PREview pilot in 2020 and 6 U.S. schools participated in 2021. PREview scores were paired with data from the American Medical College Application Service (undergraduate grade point averages [GPAs], Medical College Admission Test [MCAT] scores, race, and ethnicity) and participating schools (interview ratings). Results Data included 19,525 PREview scores from 18,549 unique PREview examinees. Correlations between PREview scores and undergraduate GPAs (r =.16) and MCAT scores (r =.29) were small and positive. Correlations between PREview scores and interview ratings were also small and positive, ranging between.09 and.14 after correcting for range restriction. Small group differences in mean PREview scores were observed between White and Black or African American and White and Hispanic, Latino, or of Spanish origin examinees. The addition of the PREview exam did not substantially change the volume or composition of participating schools' applicant pools. Conclusions Results suggest the PREview exam measures knowledge of competencies that are distinct from those measured by other measures used in medical school admissions. Observed group differences were smaller than group differences observed with traditional academic assessments and evaluations. The addition of the PREview exam did not substantially change the overall volume of applications or the proportions of out-of-state, underrepresented in medicine, or lower socioeconomic status applicants. While more research is needed, these results suggest the PREview exam may provide unique information to the admissions process without adversely affecting applicant pools.
AB - Purpose To examine the relationship between the Association of American Medical Colleges (AAMC) Professional Readiness Exam (PREview) scores and other admissions data, group differences in mean PREview scores, and whether adding a new assessment tool affected the volume and composition of applicant pools. Method Data from the 2020 and 2021 PREview exam administrations were analyzed. Two U.S. schools participated in the PREview pilot in 2020 and 6 U.S. schools participated in 2021. PREview scores were paired with data from the American Medical College Application Service (undergraduate grade point averages [GPAs], Medical College Admission Test [MCAT] scores, race, and ethnicity) and participating schools (interview ratings). Results Data included 19,525 PREview scores from 18,549 unique PREview examinees. Correlations between PREview scores and undergraduate GPAs (r =.16) and MCAT scores (r =.29) were small and positive. Correlations between PREview scores and interview ratings were also small and positive, ranging between.09 and.14 after correcting for range restriction. Small group differences in mean PREview scores were observed between White and Black or African American and White and Hispanic, Latino, or of Spanish origin examinees. The addition of the PREview exam did not substantially change the volume or composition of participating schools' applicant pools. Conclusions Results suggest the PREview exam measures knowledge of competencies that are distinct from those measured by other measures used in medical school admissions. Observed group differences were smaller than group differences observed with traditional academic assessments and evaluations. The addition of the PREview exam did not substantially change the overall volume of applications or the proportions of out-of-state, underrepresented in medicine, or lower socioeconomic status applicants. While more research is needed, these results suggest the PREview exam may provide unique information to the admissions process without adversely affecting applicant pools.
UR - http://www.scopus.com/inward/record.url?scp=85184146800&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85184146800&partnerID=8YFLogxK
U2 - 10.1097/ACM.0000000000005548
DO - 10.1097/ACM.0000000000005548
M3 - Article
C2 - 37976531
AN - SCOPUS:85184146800
SN - 1040-2446
VL - 99
SP - 183
EP - 191
JO - Academic Medicine
JF - Academic Medicine
IS - 2
ER -