Skip to main content

Main menu

  • HOME
  • ARTICLES
    • Current Issue
    • Ahead of Print
    • Archives
    • Abstracts In Press
    • Special Issue Archive
    • Subject Collections
  • INFO FOR
    • Authors
    • Reviewers
    • Call For Papers
    • Subscribers
    • Advertisers
  • SUBMIT
    • Manuscript
    • Peer Review
  • ABOUT
    • The JABFM
    • The Editing Fellowship
    • Editorial Board
    • Indexing
    • Editors' Blog
  • CLASSIFIEDS
  • Other Publications
    • abfm

User menu

Search

  • Advanced search
American Board of Family Medicine
  • Other Publications
    • abfm
American Board of Family Medicine

American Board of Family Medicine

Advanced Search

  • HOME
  • ARTICLES
    • Current Issue
    • Ahead of Print
    • Archives
    • Abstracts In Press
    • Special Issue Archive
    • Subject Collections
  • INFO FOR
    • Authors
    • Reviewers
    • Call For Papers
    • Subscribers
    • Advertisers
  • SUBMIT
    • Manuscript
    • Peer Review
  • ABOUT
    • The JABFM
    • The Editing Fellowship
    • Editorial Board
    • Indexing
    • Editors' Blog
  • CLASSIFIEDS
  • JABFM on Bluesky
  • JABFM On Facebook
  • JABFM On Twitter
  • JABFM On YouTube
Research ArticleOriginal Research

Machine Learning to Identify Clusters in Family Medicine Diplomate Motivations and Their Relationship to Continuing Certification Exam Outcomes: Findings and Potential Future Implications

David W. Price, Peter Wingrove and Andrew Bazemore
The Journal of the American Board of Family Medicine March 2024, 37 (2) 279-289; DOI: https://doi.org/10.3122/jabfm.2023.230369R1
David W. Price
From the American Board of Family Medicine, Lexington, KY (DWP, PW, AB); Department of Family Medicine, University of Colorado Anschutz School of Medicine, Aurora, CO (DWP); Department of Biomedical Informatics, University of Pittsburgh, Pittsburgh PA (AB).
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Peter Wingrove
From the American Board of Family Medicine, Lexington, KY (DWP, PW, AB); Department of Family Medicine, University of Colorado Anschutz School of Medicine, Aurora, CO (DWP); Department of Biomedical Informatics, University of Pittsburgh, Pittsburgh PA (AB).
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Andrew Bazemore
From the American Board of Family Medicine, Lexington, KY (DWP, PW, AB); Department of Family Medicine, University of Colorado Anschutz School of Medicine, Aurora, CO (DWP); Department of Biomedical Informatics, University of Pittsburgh, Pittsburgh PA (AB).
MD, MPH
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Article
  • Figures & Data
  • References
  • Info & Metrics
  • PDF
Loading

Article Figures & Data

Figures

  • Tables
  • Figure 1.
    • Download figure
    • Open in new tab
    Figure 1.

    Probability of failing recertification examination on first attempt, by motivation subgroup.

Tables

  • Figures
    • View popup
    Table 1.

    American Board of Family Physician Recertification Survey Questions Used in This Study (2017–2021)

    Why are you seeking to continue your ABFM certification at this time?
    • a. Maintain professional image

    • b. Personal preference

    • c. Professional advancement

    • d. Maintain or improve patient satisfaction

    • e. Patients prefer being treated by board certified physicians

    • f. Certification program helps me update my medical knowledge

    • g. Certification program helps me monitor or improve the quality of my patient care

    • h. Required by my employer

    • i. Required for hospital privileges/credentialing

    • j. Required by one or more payer/insurance company

    • k. Other (please specify)

    Which of the following describes your principal practice site:
    • a. Academic health center / faculty practice (residency or university teaching environment)

    • b. Federal (Military, Veterans Administration/Department of Defense)

    • c. Federally Qualified Health Center or Look-Alike

    • d. Government clinic, non-federal (eg, state, county, city, maternal and child health, public health center, etc.)

    • e. Hospital-/health system-owned medical practice (not including managed care or HMO)

    • f. Independently owned medical practice

    • g. Indian Health Service

    • h. Managed care / HMO practice

    • i. Other, please specify:

    • j. Rural Health Clinic (federally qualified) Indian Health Service

    • k. Worksite clinic

    Which of the following best describes your role in the ownership of your principal practice
    • a. No official ownership stake (100% employed)

    • a. Sole owner

    • b. Partial owner or shareholder

    • c. Self-employed as a contractor (including locums)

    • d. Other, please specify:

    Which of the following describes your principal practice size:
    • a. Solo practice

    • b. 2 to 5 providers

    • c. 6 to 20 providers

    • d. >20 providers

    • View popup
    Table 2.

    Percentage of Recertification Diplomates (2017–2021) within Each ML Cluster or Human Generated Group Who Endorsed Each Motivation

    Machine learning clusters
    ClusterDescriptionN (%)ImagePersonalProfessionalPatient satisfactionPatient preferenceMedical knowledgePatient careEmployerCredentialPayerOther
    1Credential + payer2895 (19.3)36241562222131565623
    2Employer3208 (21.4)32291761625157027103
    3Mainly extrinsic2491 (16.6)3325112.51828168692731
    4Broadly motivated3553 (23.7)888675708393867377661
    5Mainly intrinsic2821 (18.8)748439253083711320132
    Human classification
    Extrinsic only2626 (17.5)0%0%0%0%0%0%0%62%64%50%2%
    Intrinsic only3067 (20.5)59%70%39%25%29%57%49%0%0%0%3%
    Mixed9275 (62.0)68%60%41%31%48%65%52%66%72%58%2%
    • Shaded cells indicate major representative objects that different a cluster from others. Underlined cells indicate the allowed motivations for the Extrinsic Only and Intrinsic Only groups; all other combinations of motivations (ie, those that included at least one extrinsic motivation and at least one intrinsic motivation) were assigned to the Mixed group.

    • View popup
    Table 3.

    Breakdown of % of 2017–2021 Recertification Diplomates Within Each Practice Site/Ownership/Size Category Assigned to Each Cluster

    Cluster1 (Credential + Payer)2 (Employer)3 (Mainly extrinsic)4 (Broadly motivated)5 (Mainly intrinsic)
    Variable: Type of Site
     Academic (1046)2%29%33%30%7%
     Federal (570)3%37%13%20%28%
     FQHC (951)3%26%26%24%21%
     Govt, non-federal (230)2%36%15%18%28%
     Hospital/health system (5258)5%27%28%30%9%
     Independently Owned (4908)48%4%2%17%29%
     Indian Health Service (91)3%26%19%27%24%
     Managed care/ HMO (894)8%47%7%24%14%
     Other (448)10%32%13%19%27%
     Rural health clinic (345)17%20%19%21%22%
     Work site clinic (227)10%35%7%18%30%
    Site Ownership
     Employee (9584)5%28%25%27%15%
     Other (186)22%28%5%20%26%
     Partial owner /stakeholder (2863)44%13%2%20%21%
     Self-employed [contractor] (427)32%15%8%18%26%
     Sole owner (1908)51%1%0%16%32%
    Site size
     Solo practice (1687)42%8%3%18%29%
     2-to-5 (5068)26%18%9%21%27%
     6-to-20 (4687)11%15%33%28%13%
     >20 (3526)11%42%12%25%10%
    • Shaded cells for each variable indicate the major practice characteristics of each cluster (column).

    • Abbreviation: FQHC, federally qualified health center.

    • View popup
    Table 4.

    Percent of 2017–2021 American Board of Family Medicine Diplomates Failing Initial Attempt at Recertification Exam, by Endorsement of Motivation

    MotivationEndorses motivationDoes not endorse motivationP (χ2)
    Intrinsic
     Image6.8 (547/8093)7.6 (524/6875)0.041*
     Medical knowledge7.3 (569/7760)7.0 (502/7208)0.383
     Monitor/improve patient care7.8 (492/6334)6.7 (579/8634)0.013*
     Patient preference6.1 (327/5366)7.8 (744/9602)<0.001***
     Patient satisfaction8.5 (308/3617)6.7 (763/11,351)<0.001***
     Personal preference7.1 (548/7679)7.2 (523/7289)0.927
     Professional advancement8.2 (413/5035)6.6 (658/9923)<0.001***
    Extrinsic
     Credentialing5.6 (464/8325)9.1 (607/6643)<0.001***
     Employer4.5 (349/7772)10.0 (722/7196)<0.001***
     Payer5.6 (374/6665)8.4 (697/8303)<0.001***
     Other9.2 (26/283)7.1 (1045/14,685)0.181
    • ↵* P < .05, **P < .01, ***P < .001.

    • Bold figures indicate a higher probability of failure.

PreviousNext
Back to top

In this issue

The Journal of the American Board of Family     Medicine: 37 (2)
The Journal of the American Board of Family Medicine
Vol. 37, Issue 2
March-April 2024
  • Table of Contents
  • Table of Contents (PDF)
  • Cover (PDF)
  • Index by author
  • Back Matter (PDF)
  • Front Matter (PDF)
Print
Download PDF
Article Alerts
Sign In to Email Alerts with your Email Address
Email Article

Thank you for your interest in spreading the word on American Board of Family Medicine.

NOTE: We only request your email address so that the person you are recommending the page to knows that you wanted them to see it, and that it is not junk mail. We do not capture any email address.

Enter multiple addresses on separate lines or separate them with commas.
Machine Learning to Identify Clusters in Family Medicine Diplomate Motivations and Their Relationship to Continuing Certification Exam Outcomes: Findings and Potential Future Implications
(Your Name) has sent you a message from American Board of Family Medicine
(Your Name) thought you would like to see the American Board of Family Medicine web site.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
3 + 17 =
Solve this simple math problem and enter the result. E.g. for 1+3, enter 4.
Citation Tools
Machine Learning to Identify Clusters in Family Medicine Diplomate Motivations and Their Relationship to Continuing Certification Exam Outcomes: Findings and Potential Future Implications
David W. Price, Peter Wingrove, Andrew Bazemore
The Journal of the American Board of Family Medicine Mar 2024, 37 (2) 279-289; DOI: 10.3122/jabfm.2023.230369R1

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
Share
Machine Learning to Identify Clusters in Family Medicine Diplomate Motivations and Their Relationship to Continuing Certification Exam Outcomes: Findings and Potential Future Implications
David W. Price, Peter Wingrove, Andrew Bazemore
The Journal of the American Board of Family Medicine Mar 2024, 37 (2) 279-289; DOI: 10.3122/jabfm.2023.230369R1
Twitter logo Facebook logo Mendeley logo
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Jump to section

  • Article
    • Abstract
    • Introduction
    • Methods
    • Results
    • Discussion
    • Conclusion
    • Acknowledgments
    • Appendix.
    • Notes
    • References
  • Figures & Data
  • References
  • Info & Metrics
  • PDF

Related Articles

  • No related articles found.
  • PubMed
  • Google Scholar

Cited By...

  • Research to Improve Clinical Care in Family Medicine: Big Data, Telehealth, Artificial Intelligence, and More
  • Google Scholar

More in this TOC Section

  • Integrating Adverse Childhood Experiences and Social Risks Screening in Adult Primary Care
  • A Pilot Comparison of Clinical Data Collection Methods Using Paper, Electronic Health Record Prompt, and a Smartphone Application
  • Associations Between Modifiable Preconception Care Indicators and Pregnancy Outcomes
Show more Original Research

Similar Articles

Keywords

  • ABFM
  • Accreditation
  • Certification
  • Chi-Square Test
  • Family Medicine
  • Information Technology
  • Logistic Regression
  • Machine Learning
  • Motivation
  • Physicians
  • Specialty Boards

Navigate

  • Home
  • Current Issue
  • Past Issues

Authors & Reviewers

  • Info For Authors
  • Info For Reviewers
  • Submit A Manuscript/Review

Other Services

  • Get Email Alerts
  • Classifieds
  • Reprints and Permissions

Other Resources

  • Forms
  • Contact Us
  • ABFM News

© 2025 American Board of Family Medicine

Powered by HighWire