Skip to main content

Main menu

  • HOME
  • ARTICLES
    • Current Issue
    • Ahead of Print
    • Archives
    • Abstracts In Press
    • Special Issue Archive
    • Subject Collections
  • INFO FOR
    • Authors
    • Reviewers
    • Call For Papers
    • Subscribers
    • Advertisers
  • SUBMIT
    • Manuscript
    • Peer Review
  • ABOUT
    • The JABFM
    • The Editing Fellowship
    • Editorial Board
    • Indexing
    • Editors' Blog
  • CLASSIFIEDS
  • Other Publications
    • abfm

User menu

Search

  • Advanced search
American Board of Family Medicine
  • Other Publications
    • abfm
American Board of Family Medicine

American Board of Family Medicine

Advanced Search

  • HOME
  • ARTICLES
    • Current Issue
    • Ahead of Print
    • Archives
    • Abstracts In Press
    • Special Issue Archive
    • Subject Collections
  • INFO FOR
    • Authors
    • Reviewers
    • Call For Papers
    • Subscribers
    • Advertisers
  • SUBMIT
    • Manuscript
    • Peer Review
  • ABOUT
    • The JABFM
    • The Editing Fellowship
    • Editorial Board
    • Indexing
    • Editors' Blog
  • CLASSIFIEDS
  • JABFM on Bluesky
  • JABFM On Facebook
  • JABFM On Twitter
  • JABFM On YouTube
Brief ReportPolicy Brief

Performance of Graduating Residents on the American Board of Family Medicine Certification Examination 2009–2016

James C. Puffer, Michael R. Peabody and Thomas R. O'Neill
The Journal of the American Board of Family Medicine September 2017, 30 (5) 570-571; DOI: https://doi.org/10.3122/jabfm.2017.05.170065
James C. Puffer
From the American Board of Family Medicine, Lexington, KY (JCP, MRP, TRO)
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Michael R. Peabody
From the American Board of Family Medicine, Lexington, KY (JCP, MRP, TRO)
PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Thomas R. O'Neill
From the American Board of Family Medicine, Lexington, KY (JCP, MRP, TRO)
PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Article
  • Figures & Data
  • References
  • Info & Metrics
  • PDF
Loading

Abstract

In response to growing concern about the declining performance on the American Board of Family Medicine Certification Examination, several strategies were employed to assist program directors with preparing their residents to take the examination. The effect of these efforts seems to have resulted in significant improvement in performance.

  • Certification
  • Graduate Medical Education

Previous reports expressed concern about the declining pass rate of graduating residents on the American Board of Family Medicine (ABFM) Certification Examination (CE) from 2007 to 2011.1,2 In analyzing program pass rates, Falcone and Middleton2 demonstrated that 47.8% of family medicine residency training programs violated Accreditation Council of Graduate Medical Education program requirements with greater than 10% of their residents failing the examination on a 3- to 5-year rolling average.

To assist program directors better prepare their residents to take the examination, the ABFM undertook several strategic initiatives beginning in 2009. This included creating a common scoring scale in 2009 across the administrations of both the CE and In-Training Examination (ITE); moving up the first administration of the CE in each year from July to April in 2012; introducing Family Medicine Certification entry requirements, including mandatory completion of at least 1 Self-Assessment Module (SAM), in 2012; and providing better predictive feedback from the ITE using the Bayesian Score Predictor in 2013. Given these changes, we wished to determine what effect, if any, they may have had on subsequent resident performance on the CE.

Using ABFM examination data, we calculated the pass rate for both United States medical graduate (USMG) and international medical graduate (IMG) initial certifiers who had not failed a previous attempt on the CE for years 2009 to 2016. Given that the minimum passing standard (MPS) for the CE was lowered by the ABFM Board of Directors in 2014 from a scaled score of 390 to 380, we calculated 2014 to 2016 pass rates using both the 380 and 390 passing standards to adjust for the effects of the change in MPS.

The results are shown in Figure 1 below. USMG performance reached a low of 91.3% in 2010 and increased steadily thereafter to reach a high of 98.3% in 2016. IMG performance reached a nadir of 81.2% in 2011 and for the most part increased steadily thereafter to reach a high of 96.8% in 2016. The change in the MPS for the 2014 to 2016 cohorts did increase the pass rate for both USMGs and IMGs, but the increase in pass rate from the 2013 baseline to the 390-adjusted pass rate was always larger than the increase from the 390-adjusted pass rate to the 380-actual pass rate.

Figure 1.
  • Download figure
  • Open in new tab
Figure 1.

Pass rates for graduating residents on the ABFM CE 2009 to 2016. Includes only first-time takers and not those residents retaking the examination due to a prior failure.

Although it is difficult to attribute the variance in these trends to each of the individual strategies employed, we have previously demonstrated the predictive value of the ITE on subsequent CE performance as well as greater likelihood of passing the CE after completion of a SAM.3,4 Given the timing of when these initiatives were implemented and when the pass rate increases occurred, it seems plausible that a time lag related to the adoption of the tools/policies and how educators and residents learned to make the best use of them may have been operant. However, we cannot discount that some or all the improvement might be explained by the improving quality of family medicine trainees recruited into training programs during this time period. Further investigation should explore the impact of each of these factors on examination performance.

Notes

  • This article was externally peer reviewed.

  • Funding: none.

  • Conflict of interest: JCP, MRP, and TRO are employees of the ABFM.

  • To see this article online, please go to: http://jabfm.org/content/30/5/570.full.

  • Received for publication February 20, 2017.
  • Revision received May 8, 2017.
  • Accepted for publication May 8, 2017.

References

  1. 1.↵
    1. Falcone JL,
    2. Middleton DB
    . Performance on the American Board of Family Medicine certification examination by country of medical training. J Am Board Fam Med 2013;26:78–81.
    OpenUrlAbstract/FREE Full Text
  2. 2.↵
    1. Falcone JL,
    2. Middleton DB
    . Pass rates on the American Board of Family Medicine certification exam by residency location and size. J Am Board Fam Med 2013;26:453–9.
    OpenUrlAbstract/FREE Full Text
  3. 3.↵
    1. O'Neill TR,
    2. Li Z,
    3. Peabody MR,
    4. et al
    . The predictive validity of ABFM's in-training examination. Fam Med 2015;47:349–56.
    OpenUrl
  4. 4.↵
    1. Peterson LE,
    2. Blackburn B,
    3. King MR
    . Completing self-assessment modules during residency is associated with better certification exam results. Fam Med 2014;46:597–602.
    OpenUrl
PreviousNext
Back to top

In this issue

The Journal of the American Board of Family     Medicine: 30 (5)
The Journal of the American Board of Family Medicine
Vol. 30, Issue 5
September-October 2017
  • Table of Contents
  • Table of Contents (PDF)
  • Cover (PDF)
  • Index by author
Print
Download PDF
Article Alerts
Sign In to Email Alerts with your Email Address
Email Article

Thank you for your interest in spreading the word on American Board of Family Medicine.

NOTE: We only request your email address so that the person you are recommending the page to knows that you wanted them to see it, and that it is not junk mail. We do not capture any email address.

Enter multiple addresses on separate lines or separate them with commas.
Performance of Graduating Residents on the American Board of Family Medicine Certification Examination 2009–2016
(Your Name) has sent you a message from American Board of Family Medicine
(Your Name) thought you would like to see the American Board of Family Medicine web site.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
2 + 7 =
Solve this simple math problem and enter the result. E.g. for 1+3, enter 4.
Citation Tools
Performance of Graduating Residents on the American Board of Family Medicine Certification Examination 2009–2016
James C. Puffer, Michael R. Peabody, Thomas R. O'Neill
The Journal of the American Board of Family Medicine Sep 2017, 30 (5) 570-571; DOI: 10.3122/jabfm.2017.05.170065

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
Share
Performance of Graduating Residents on the American Board of Family Medicine Certification Examination 2009–2016
James C. Puffer, Michael R. Peabody, Thomas R. O'Neill
The Journal of the American Board of Family Medicine Sep 2017, 30 (5) 570-571; DOI: 10.3122/jabfm.2017.05.170065
Twitter logo Facebook logo Mendeley logo
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Jump to section

  • Article
    • Abstract
    • Notes
    • References
  • Figures & Data
  • References
  • Info & Metrics
  • PDF

Related Articles

  • No related articles found.
  • PubMed
  • Google Scholar

Cited By...

  • Re-Envisioning Family Medicine Residencies: The End in Mind
  • The Impact of the ACGMEs June 2019 Changes in Residency Requirements
  • HOW THE ABFM WILL ADDRESS HEALTH EQUITY
  • The American Board of Family Medicine: New Tools to Assist Program Directors and Graduates Achieve Success
  • Google Scholar

More in this TOC Section

  • Rural Family Physicians Are More Likely to Collaborate with Multisector Community Organizations
  • Family Medicine Residents Intentions to Provide Gender Affirming Care
  • Only One Quarter of Family Physicians Are Very Satisfied with Their Electronic Health Records Platform
Show more Policy Brief

Similar Articles

Keywords

  • Certification
  • Graduate Medical Education

Navigate

  • Home
  • Current Issue
  • Past Issues

Authors & Reviewers

  • Info For Authors
  • Info For Reviewers
  • Submit A Manuscript/Review

Other Services

  • Get Email Alerts
  • Classifieds
  • Reprints and Permissions

Other Resources

  • Forms
  • Contact Us
  • ABFM News

© 2025 American Board of Family Medicine

Powered by HighWire