Skip to main content

Main menu

  • HOME
  • ARTICLES
    • Current Issue
    • Ahead of Print
    • Archives
    • Abstracts In Press
    • Special Issue Archive
    • Subject Collections
  • INFO FOR
    • Authors
    • Reviewers
    • Call For Papers
    • Subscribers
    • Advertisers
  • SUBMIT
    • Manuscript
    • Peer Review
  • ABOUT
    • The JABFM
    • The Editing Fellowship
    • Editorial Board
    • Indexing
    • Editors' Blog
  • CLASSIFIEDS
  • Other Publications
    • abfm

User menu

Search

  • Advanced search
American Board of Family Medicine
  • Other Publications
    • abfm
American Board of Family Medicine

American Board of Family Medicine

Advanced Search

  • HOME
  • ARTICLES
    • Current Issue
    • Ahead of Print
    • Archives
    • Abstracts In Press
    • Special Issue Archive
    • Subject Collections
  • INFO FOR
    • Authors
    • Reviewers
    • Call For Papers
    • Subscribers
    • Advertisers
  • SUBMIT
    • Manuscript
    • Peer Review
  • ABOUT
    • The JABFM
    • The Editing Fellowship
    • Editorial Board
    • Indexing
    • Editors' Blog
  • CLASSIFIEDS
  • JABFM on Bluesky
  • JABFM On Facebook
  • JABFM On Twitter
  • JABFM On YouTube
Article CommentaryCommentary

The American Board of Family Medicine: New Tools to Assist Program Directors and Graduates Achieve Success

Stanley M. Kozakowski and Perry A. Pugno
The Journal of the American Board of Family Medicine September 2017, 30 (5) 567-569; DOI: https://doi.org/10.3122/jabfm.2017.05.170250
Stanley M. Kozakowski
From the Medical Education Division, American Academy of Family Physicians, Leawood, KS (SMK); and retired from the American Academy of Family Physicians, Delaware, OH (PAP).
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Perry A. Pugno
From the Medical Education Division, American Academy of Family Physicians, Leawood, KS (SMK); and retired from the American Academy of Family Physicians, Delaware, OH (PAP).
MD, MPH, CPE
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Article
  • References
  • Info & Metrics
  • PDF
Loading

Abstract

In this commentary we review the improvements in the pass rates for first-time American Board of Family Medicine (ABFM) Certification Examination test takers in the context of new tools and resources for program directors against the backdrop of a changing accreditation system and increased competition for a relatively fixed number of graduate medical education positions in family medicine. While causality cannot be established between the strategic initiatives of the ABFM and higher pass rates, we can all celebrate the new tools and resources provided to residents and program directors, and the improved performance of family medicine graduates on the certification examination.

In this issue, Puffer et al1 demonstrate a steady increase in pass rates among graduating family medicine residents taking the American Board of Family Medicine (ABFM) Certification Examination since 2012, after a steady decline in the preceding years. This improvement follows the ABFM's implementation of several strategies to assist program directors. As former residency directors, and as directors of the Medical Education Division of the American Academy of Family Physicians (AAFP), we have a long-term perspective on family medicine residency education and the changing environment of graduate medical education over the past several decades.

The changes instituted by the ABFM represent significant aid to program directors as they work to ensure that their graduates are prepared to safely and effectively enter independent practice. Board certification is an important metric of clinical knowledge. Other important training domains include application of clinical knowledge, communication and interpersonal skills, professionalism, intellectual curiosity and learning to improve the process and quality of care, and understanding systems of care and the role of the team and practice within the broader medical neighborhood. While these domains are all important, most are challenging to measure, and board certification as a measure of medical knowledge has been correlated with quality of care, overall ratings of a resident's clinical competence, and career satisfaction.2⇓⇓–5 For all these reasons, improvement in board scores is good for residency programs, their graduates, and the public.

Tools for Program Directors

Program directors have been challenged with identifying those residents who lack sufficient medical knowledge, because residents with deficits in that domain can manifest the deficit in many ways, including what may seem to be a lack of judgment or even slowness in clinic or hospital rounds. The In-Training Examination (ITE) has been characterized as a “low-stakes” examination, and program directors have varied in their perspectives regarding how much stock that they should place on the ITE for residents with poor or marginal performance on the examination, despite evidence of the predictive validity of the ITE.6 The Bayesian Score Predictor is a wonderful resource that allows program directors to reliably identify residents' future performance on the certification examination and to provide resources to and motivate residents who may be at risk of not passing the certification examination. We believe that moving the certification examination from July to April, coupled with the Family Medicine Certification entry requirements, is particularly useful to ensure that all residents participate in a minimal level of practice improvement and knowledge self-assessment. The new knowledge self-assessment requirement during residency may be an important reason why performance has improved. The fact that many physicians do poorly on their first pass through the knowledge self-assessment questions indicates that, based on objective testing, we often do not know as much as we think we do.

Causality

Puffer et al. are rightly cautious to attribute the variance in the pass rate on the certification examination to individual strategies. Much has changed in the graduate medical education environment over the past decade. As the authors speculate, the “quality of family medicine trainees recruited into training programs” may have been improving during the time frame of their study. Increased numbers of graduates from both US allopathic (MD degrees) and osteopathic (DO degrees) medical schools over the past 15 years create more competition for graduate medical education positions and disproportionately disadvantage international medical graduates (IMGs).7 The composition of matriculating family medicine residents has changed over the past decade. While the proportion of US graduates with an MD degree has remained stable at approximately 46% of entering first-year residents, over the past decade the percentage of graduates with a DO degree has increased approximately 1% per year, while the percentage of IMGs has experienced a reciprocal decline.8 Scores on the US Medical Licensing Examination Step I and Step II Knowledge have increased over the past decade for US seniors, US IMGs, and non–US IMGs that have matched in family medicine, suggesting that the test-taking ability of family medicine residents may be improving.

Significant changes in the residency accreditation system have also occurred over the same time frame.9 Although introduced before the Accreditation Council for Graduate Medical Education Next Accreditation System that was launched in 2013, the Accreditation Council for Graduate Medical Education General Competencies, faculties' growing familiarity with them, and now the early use of Entrustable Professional Activities have standardized the process of resident evaluation and better harmonized that process with the curriculum. Residents have better information with which they can self-evaluate. The more longitudinal process of evaluation reduces opportunities for residents to say, “I did not know I was not doing well.” The formalization of the Clinical Competency Committee evaluation of residents (and related documentation) allows programs to more effectively monitor resident progress, intervene sooner, and be more specific in identifying areas of improvement. Increased attention has been placed on several core requirements within the family medicine accreditation process, including having adequate educational resources (such as family medicine faculty modeling patient care, and resident and faculty scholarship) and outcome measures like patient volumes and demographics and board certification scores. This has drawn the attention of program directors more toward board certification scores. This increased attention may change the behavior of program directors in selecting medical school graduates who perform better on standardized examinations and in making more resources available to their residents when they prepare for the examination.

We believe that more programs are using “board preparation” resources based on monitoring the discussions that take place on the program directors' listserv, where many opine the most effective resources for resident remediation and overall ABFM board certification preparation. The AAFP has a large number of retired board examination questions available for use when practicing, and increased familiarity with the question format/strategy improves performance on the examination in a way similar to board-preparation courses. The AAFP has expanded its portfolio of board review resources and positioned them within the affordable price range of more residencies. The board review courses are updated annually based on changes in the ABFM examination “blueprint,” and that harmonization process makes them very effective.

Conclusion

We commend Puffer et al1 and the ABFM for their commitment to improving the quality of medical care available to the public, establishing and maintaining standards of excellence in the specialty of Family Medicine, improving the standards for medical education in Family Medicine, and determining through evaluation the fitness of specialists in Family Medicine who apply for and hold certificates.10 The strategies they have developed for program directors are laudable. While these strategies cannot be firmly established as the sole cause of the increasing pass rates for graduating residents on the ABFM Certification Examination, we believe that they have made a large contribution to the increase.

Notes

  • Funding: none.

  • Conflict of interest: none declared.

  • To see this article online, please go to: http://jabfm.org/content/30/5/567.full.

References

  1. 1.↵
    1. Puffer JC,
    2. Peabody MR,
    3. O'Neill TR
    . Performance of graduating residents on the American Board of Family Medicine Certification Examination 2009–2016. J Am Board Fam Med 2017;30:570–571.
    OpenUrlAbstract/FREE Full Text
  2. 2.↵
    1. Holmboe ES,
    2. Wang Y,
    3. Meehan TP,
    4. et al
    . Association between maintenance of certification examination scores and quality of care for medicare beneficiaries. Arch Intern Med 2008;168:1396–403.
    OpenUrlCrossRefPubMed
  3. 3.↵
    1. Holmboe ES,
    2. Weng W,
    3. Arnold GK,
    4. et al
    . The comprehensive care project: measuring physician performance in ambulatory practice. Health Serv Res 2010;45(6 Pt 2):1912–33.
    OpenUrlCrossRefPubMed
  4. 4.↵
    1. Norcini JJ,
    2. Webster GD,
    3. Grosso LJ,
    4. Blank LL,
    5. Benson JA Jr.
    . Ratings of residents' clinical competence and performance on certification examination. J Med Educ 1987;62:457–62.
    OpenUrlPubMed
  5. 5.↵
    1. Gray B,
    2. Reschovsky J,
    3. Holmboe E,
    4. Lipner R
    . Do early career indicators of clinical skill predict subsequent career outcomes and practice characteristics for general internists? Health Serv Res 2013;48:1096–115.
    OpenUrl
  6. 6.↵
    1. O'Neill TR,
    2. Li Z,
    3. Peabody MR,
    4. Lybarger M,
    5. Royal K,
    6. Puffer JC
    . The predictive validity of the ABFM's In-Training Examination. Fam Med 2015;47:349–56.
    OpenUrl
  7. 7.↵
    1. Mullan F,
    2. Salsberg E,
    3. Weider K
    . Why a GME squeeze is unlikely. N Engl J Med 2015;373:2397–9.
    OpenUrlPubMed
  8. 8.↵
    1. Kozakowski SM,
    2. Travis A,
    3. Bentley A,
    4. Fetter G Jr.
    . Entry of US medical school graduates into family medicine residencies: 2015–2016. Fam Med 2016;48:688–95.
    OpenUrl
  9. 9.↵
    1. Nasca TJ,
    2. Philibert I,
    3. Brigham T,
    4. Flynn TC
    . The next GME accreditation system–rationale and benefits. N Engl J Med 2012;366:1051–6.
    OpenUrlCrossRefPubMed
  10. 10.↵
    1. About ABFM
    . Lextington, KY: American Board of Family Medicine. Available from: https://www.theabfm.org/about/index.aspx. Accessed June 20, 2017.
PreviousNext
Back to top

In this issue

The Journal of the American Board of Family     Medicine: 30 (5)
The Journal of the American Board of Family Medicine
Vol. 30, Issue 5
September-October 2017
  • Table of Contents
  • Table of Contents (PDF)
  • Cover (PDF)
  • Index by author
Print
Download PDF
Article Alerts
Sign In to Email Alerts with your Email Address
Email Article

Thank you for your interest in spreading the word on American Board of Family Medicine.

NOTE: We only request your email address so that the person you are recommending the page to knows that you wanted them to see it, and that it is not junk mail. We do not capture any email address.

Enter multiple addresses on separate lines or separate them with commas.
The American Board of Family Medicine: New Tools to Assist Program Directors and Graduates Achieve Success
(Your Name) has sent you a message from American Board of Family Medicine
(Your Name) thought you would like to see the American Board of Family Medicine web site.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
5 + 8 =
Solve this simple math problem and enter the result. E.g. for 1+3, enter 4.
Citation Tools
The American Board of Family Medicine: New Tools to Assist Program Directors and Graduates Achieve Success
Stanley M. Kozakowski, Perry A. Pugno
The Journal of the American Board of Family Medicine Sep 2017, 30 (5) 567-569; DOI: 10.3122/jabfm.2017.05.170250

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
Share
The American Board of Family Medicine: New Tools to Assist Program Directors and Graduates Achieve Success
Stanley M. Kozakowski, Perry A. Pugno
The Journal of the American Board of Family Medicine Sep 2017, 30 (5) 567-569; DOI: 10.3122/jabfm.2017.05.170250
Twitter logo Facebook logo Mendeley logo
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Jump to section

  • Article
    • Abstract
    • Tools for Program Directors
    • Causality
    • Conclusion
    • Notes
    • References
  • References
  • Info & Metrics
  • PDF

Related Articles

  • No related articles found.
  • PubMed
  • Google Scholar

Cited By...

  • Content Usage and the Most Frequently Read Articles of 2017
  • Google Scholar

More in this TOC Section

  • Empowering Family Physicians in Medical Staff Leadership to Foster Physician Well-Being
  • Maternity Care Deserts: Key Drivers of the National Maternal Health Crisis
  • The One Taboo Question
Show more Commentary

Similar Articles

Navigate

  • Home
  • Current Issue
  • Past Issues

Authors & Reviewers

  • Info For Authors
  • Info For Reviewers
  • Submit A Manuscript/Review

Other Services

  • Get Email Alerts
  • Classifieds
  • Reprints and Permissions

Other Resources

  • Forms
  • Contact Us
  • ABFM News

© 2025 American Board of Family Medicine

Powered by HighWire