How Well Does the Standardized Video Interview Score Correlate with Traditional Interview Performance?

Introduction: In 2017, all medical students applying for residency in emergency medicine (EM) were required to participate in the Standardized Video Interview (SVI). The SVI is a video-recorded, uni-directional interview consisting of six questions designed to assess interpersonal and communication skills and professionalism. It is unclear whether this simulated interview is an accurate representation of an applicant's competencies that are often evaluated during the in-person interview.

Objective: The goal of this study was to determine whether the SVI score correlates with a traditional in-person interview score.

Methods: Six geographically and demographically diverse EM residency programs accredited by the Accreditation Council for Graduate Medical Education participated in this prospective observational study. Common demographic data for each applicant were obtained through an Electronic Residency Application Service export function prior to the start of any scheduled traditional interviews (TI). On each TI day, one interviewer blinded to all applicant data, including SVI score, rated the applicant on a five-point scale. A convenience sample of applicants was enrolled based on random assignment to the blinded interviewer. We studied the correlation between SVI score and TI score.

Results: We included 321 unique applicants in the final analysis. Linear regression analysis of the SVI score against the TI score demonstrated a small positive linear correlation with an r coefficient of +0.13 (p=0.02). This correlation remained across all SVI score subgroups (p = 0.03).

Conclusion: Our study suggests that there is a small positive linear correlation between the SVI score and performance during the TI.