TY - JOUR
T1 - United States Medical Licensing Examination and American Board of Pediatrics Certification Examination Results
T2 - Does the Residency Program Contribute to Trainee Achievement
AU - Welch, Thomas R.
AU - Olson, Brad G.
AU - Nelsen, Elizabeth
AU - Beck Dallaghan, Gary L.
AU - Kennedy, Gloria A.
AU - Botash, Ann
N1 - Publisher Copyright:
© 2017 Elsevier Inc.
PY - 2017/9
Y1 - 2017/9
N2 - Objective To determine whether training site or prior examinee performance on the US Medical Licensing Examination (USMLE) step 1 and step 2 might predict pass rates on the American Board of Pediatrics (ABP) certifying examination. Study design Data from graduates of pediatric residency programs completing the ABP certifying examination between 2009 and 2013 were obtained. For each, results of the initial ABP certifying examination were obtained, as well as results on National Board of Medical Examiners (NBME) step 1 and step 2 examinations. Hierarchical linear modeling was used to nest first-time ABP results within training programs to isolate program contribution to ABP results while controlling for USMLE step 1 and step 2 scores. Stepwise linear regression was then used to determine which of these examinations was a better predictor of ABP results. Results A total of 1110 graduates of 15 programs had complete testing results and were subject to analysis. Mean ABP scores for these programs ranged from 186.13 to 214.32. The hierarchical linear model suggested that the interaction of step 1 and 2 scores predicted ABP performance (F[1,1007.70] = 6.44, P =.011). By conducting a multilevel model by training program, both USMLE step examinations predicted first-time ABP results (b =.002, t = 2.54, P =.011). Linear regression analyses indicated that step 2 results were a better predictor of ABP performance than step 1 or a combination of the two USMLE scores. Conclusions Performance on the USMLE examinations, especially step 2, predicts performance on the ABP certifying examination. The contribution of training site to ABP performance was statistically significant, though contributed modestly to the effect compared with prior USMLE scores.
AB - Objective To determine whether training site or prior examinee performance on the US Medical Licensing Examination (USMLE) step 1 and step 2 might predict pass rates on the American Board of Pediatrics (ABP) certifying examination. Study design Data from graduates of pediatric residency programs completing the ABP certifying examination between 2009 and 2013 were obtained. For each, results of the initial ABP certifying examination were obtained, as well as results on National Board of Medical Examiners (NBME) step 1 and step 2 examinations. Hierarchical linear modeling was used to nest first-time ABP results within training programs to isolate program contribution to ABP results while controlling for USMLE step 1 and step 2 scores. Stepwise linear regression was then used to determine which of these examinations was a better predictor of ABP results. Results A total of 1110 graduates of 15 programs had complete testing results and were subject to analysis. Mean ABP scores for these programs ranged from 186.13 to 214.32. The hierarchical linear model suggested that the interaction of step 1 and 2 scores predicted ABP performance (F[1,1007.70] = 6.44, P =.011). By conducting a multilevel model by training program, both USMLE step examinations predicted first-time ABP results (b =.002, t = 2.54, P =.011). Linear regression analyses indicated that step 2 results were a better predictor of ABP performance than step 1 or a combination of the two USMLE scores. Conclusions Performance on the USMLE examinations, especially step 2, predicts performance on the ABP certifying examination. The contribution of training site to ABP performance was statistically significant, though contributed modestly to the effect compared with prior USMLE scores.
KW - certification
KW - medical education
KW - pediatrics
KW - testing
UR - http://www.scopus.com/inward/record.url?scp=85020792756&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85020792756&partnerID=8YFLogxK
U2 - 10.1016/j.jpeds.2017.05.057
DO - 10.1016/j.jpeds.2017.05.057
M3 - Article
C2 - 28629684
AN - SCOPUS:85020792756
SN - 0022-3476
VL - 188
SP - 270-274.e3
JO - Journal of Pediatrics
JF - Journal of Pediatrics
ER -