(A1002) Do Medical Student Applications Contain Predictors of Otolaryngology Resident Success?

Introduction: Predictors of resident success in otolaryngology training have traditionally focused on metrics such as USMLE scores, clinical grades, and Alpha Omega Alpha (AOA) status. Recent changes in Step 1 score reporting and movement towards pass/fail grading have shifted focus to other application variables. This study examines which applicant criteria best predict resident performance.

Methods: A retrospective cohort study was conducted using data of residents who trained at our institution between 2010-2022. Variables include USMLE scores, clinical grades, research experiences, and extracurricular activities. Outcomes of resident success include faculty ratings (1-5 scale), in-training board exam scores, and resident research. Data was analyzed via Spearman rank correlation and Mann-Whitney U test.

Results: 29 residents consented to the study. Honoring surgery clerkship (Mdn: 5.56 v 4.81, p = 0.005), higher Step 1 scores (ρ=-0.71, p=0.003), and a greater number of national or oral presentations (ρ=-0.71, p=0.003) were associated with lower average faculty ratings. In-training exam scores were positively associated with USMLE Step 1 scores (ρ=0.39, p=0.038), USMLE Step 2 scores (ρ=0.53, p=0.020), and AOA status (Mdn: 47.60% v 51.90%, p=0.024). No other significant relationships were observed between application variables and performance outcomes.

Conclusions: Our data reveals that traditional metrics used to assess residency applications surprisingly correlated with lower faculty ratings. These findings challenge traditional assumptions, highlighting the need for a more nuanced approach. This may include more weight on subjective measures such as letters of recommendation and an interview.