Skip to main content

Main menu

  • HOME
  • ARTICLES
    • Current Issue
    • Ahead of Print
    • Archives
    • Abstracts In Press
    • Special Issue Archive
    • Subject Collections
  • INFO FOR
    • Authors
    • Reviewers
    • Call For Papers
    • Subscribers
    • Advertisers
  • SUBMIT
    • Manuscript
    • Peer Review
  • ABOUT
    • The JABFM
    • The Editing Fellowship
    • Editorial Board
    • Indexing
    • Editors' Blog
  • CLASSIFIEDS
  • Other Publications
    • abfm

User menu

  • Log out

Search

  • Advanced search
American Board of Family Medicine
  • Other Publications
    • abfm
  • Log out
American Board of Family Medicine

American Board of Family Medicine

Advanced Search

  • HOME
  • ARTICLES
    • Current Issue
    • Ahead of Print
    • Archives
    • Abstracts In Press
    • Special Issue Archive
    • Subject Collections
  • INFO FOR
    • Authors
    • Reviewers
    • Call For Papers
    • Subscribers
    • Advertisers
  • SUBMIT
    • Manuscript
    • Peer Review
  • ABOUT
    • The JABFM
    • The Editing Fellowship
    • Editorial Board
    • Indexing
    • Editors' Blog
  • CLASSIFIEDS
  • JABFM on Bluesky
  • JABFM On Facebook
  • JABFM On Twitter
  • JABFM On YouTube
Brief ReportPolicy Brief

Less AND More Are Needed to Assess Primary Care

Rebecca S. Etz, Martha M. Gonzalez, E. Marshall Brooks and Kurt C. Stange
The Journal of the American Board of Family Medicine January 2017, 30 (1) 13-15; DOI: https://doi.org/10.3122/jabfm.2017.01.160209
Rebecca S. Etz
From the Department of Family Medicine and Population Health, Virginia Commonwealth University, Richmond, VA (RSE, MMG, EMB); Departments of Family Medicine & Community Health, Epidemiology & Biostatistics, and Sociology, Case Western Reserve University, Cleveland, OH (KCS).
PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Martha M. Gonzalez
From the Department of Family Medicine and Population Health, Virginia Commonwealth University, Richmond, VA (RSE, MMG, EMB); Departments of Family Medicine & Community Health, Epidemiology & Biostatistics, and Sociology, Case Western Reserve University, Cleveland, OH (KCS).
BS
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
E. Marshall Brooks
From the Department of Family Medicine and Population Health, Virginia Commonwealth University, Richmond, VA (RSE, MMG, EMB); Departments of Family Medicine & Community Health, Epidemiology & Biostatistics, and Sociology, Case Western Reserve University, Cleveland, OH (KCS).
PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Kurt C. Stange
From the Department of Family Medicine and Population Health, Virginia Commonwealth University, Richmond, VA (RSE, MMG, EMB); Departments of Family Medicine & Community Health, Epidemiology & Biostatistics, and Sociology, Case Western Reserve University, Cleveland, OH (KCS).
MD, PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Article
  • Figures & Data
  • References
  • Info & Metrics
  • PDF
Loading

Abstract

Significant federal investment is now being directed toward lessening the burden of clinical quality measurement; at the same time, there is growing recognition that current measures are inadequate to capture the domains of primary care that result in improved person and population health at sustainable cost. Our study reveals a significant gap between the universe of what is measured and those elements most critical to good quality primary care, indicating that the important efforts to reduce measurement burden must be accompanied by efforts to increase the relevance of measures to domains of care that affect patient-centered and community health outcomes.

  • Community Health Care
  • Patient-centered Care
  • Primary Health Care

Significant federal investment is now being directed toward lessening the burden of clinical quality measurement.1,2 At the same time, there is growing recognition that current measures are inadequate to assess the domains of primary care that result in improved person and population health at sustainable cost.3⇓–5 Our study reveals a significant gap between the universe of what is measured and those elements most critical to good quality primary care, indicating that efforts to reduce measurement burden must be accompanied by efforts to increase the relevance of measures to domains of care affecting population health outcomes.

Exemplified by the Institute of Medicine's Vital Signs report last year,1 the United States has experienced an increase in calls to identify an effective means to assess and pay for health care. The foundational role of primary care draws attention to the need for broad assessment and support of accessible, coordinated, whole-person, relationship-based care.3,5 Yet, funders, physicians, and policy makers agree: we have too many measures, creating tremendous administrative burden, leading to high cost and limited return.1,2 In addition, most measures used share a myopic focus on clinical processes and limited short-term outcomes.3 National efforts to fix this problem have focused on reducing the number of measures on which primary care is required to report.2 Although that effort may result in reduced administrative burden, it fails to address systemic gaps in the assessment of primary care characteristics most responsible for its added value and its ability to avoid the pitfalls associated with fragmented care.3

We administered an open-ended, electronic survey to primary care clinicians, allowing 1 to 5 free text responses to each of 2 questions, paraphrased: 1) how do you know good primary care when you see it, and 2) what questions would you ask a practice to know if they are helping to deliver health and wellness?6 Questions were first pilot-tested and then vetted among 30 multi-disciplinary primary care experts before fielding. The survey was distributed among 4 groups: practice-based research networks (n = 167), listservs (n = 8), a national cohort of innovating practices (n = 190),7 and a purchased list of 10,000 physicians evenly distributed among family medicine, internal medicine, and pediatrics. 412 clinicians provided 3524 unique survey responses.

Responses were coded using 92 codes, 27 of which were based on commonly used measures and 65 of which were based on code groups emergent from the data (see Table 1). Three coauthors reached agreement on code definitions and coded independently, using consensus to resolve any discrepancies. Forty-two percent of clinician responses could not be assigned measure-based codes, indicating a significant gap between how primary care is assessed and what those on the frontlines of its delivery identify as valuable. Concepts reflected among code groups using the (nonmeasure-based) emergent codes include ability to prioritize care, accurate problem recognition, management of patient complexity, focus on patient preferences and goals, investment in longitudinal relationships, and ability to adapt care based on personal and communal social determinants of health.

View this table:
  • View inline
  • View popup
Table 1.

Clinician Responses (n = 3,524) Coded Using a Combination of 1) Measures-based Coding and 2) Emergent Coding

None of the emergent concepts share an overlap with current measurement focus on clinical processes and outcomes. Such misalignment risks inadequate reporting of the work of primary care, and chronic undermining of the role of primary care within the larger health care system.4,5 Policies able to support both reduction in number of measures and creation of measures specific to primary care would allow for improved assessment of primary care and appropriate identification of areas on which to focus quality improvement.

Acknowledgments

This study was funded by awards from the American Board of Family Medicine Foundation and Family Medicine for America's Health. This study was approved by Virginia Commonwealth University IRB (HM20004302).

Notes

  • This article was externally peer reviewed.

  • Funding: This work was supported by the American Board of Family Medicine Foundation and Family Medicine for America's Health.

  • Conflict of interest: none declared.

  • See Related Commentary on Page 8.

  • To see this article online, please go to: http://jabfm.org/content/30/1/13.full.

  • Received for publication June 28, 2016.
  • Revision received September 9, 2016.
  • Accepted for publication September 13, 2016.

References

  1. 1.↵
    IOM (Institute of Medicine). Vital signs: Core metrics for health and health care progress. Washington, DC: The National Academies Press; 2015.
  2. 2.↵
    Core Measures—Centers for Medicare & Medicaid Services. Available from: https://www.cms.gov/Medicare/Quality-Initiatives-Patient-Assessment-Instruments/QualityMeasures/Core-Measures.html. Accessed June 16, 2016.
  3. 3.↵
    1. Starfield B,
    2. Shi L,
    3. Macinko J
    . Contribution of primary care to health systems and health. Milbank Q 2005;83:457–502.
    OpenUrlCrossRefPubMed
  4. 4.↵
    1. Green LA,
    2. Klinkman M
    . The foundational and urgent importance of a shared primary care data model. Ann Fam Med 2015;13:305–11.
    OpenUrl
  5. 5.↵
    1. Stange KC,
    2. Etz RS,
    3. Gullett H,
    4. et al
    . Metrics for assessing improvements in primary health care. Annu Rev Public Health 2014;35:423–42.
    OpenUrlCrossRefPubMed
  6. 6.↵
    Primary Care Measures. Available from: https://www.surveymonkey.com/s/PrimaryCareMeasures.
  7. 7.↵
    1. Etz RS,
    2. Hahn KA,
    3. Gonzalez MM,
    4. Crabtree BF,
    5. Stange KC
    . Practice-based innovations: More relevant and transportable than NIH-funded studies. J Am Board Fam Med 2014;27:738–9.
    OpenUrlAbstract/FREE Full Text
PreviousNext
Back to top

In this issue

The Journal of the American Board of Family     Medicine: 30 (1)
The Journal of the American Board of Family Medicine
Vol. 30, Issue 1
January-February 2017
  • Table of Contents
  • Table of Contents (PDF)
  • Cover (PDF)
  • Index by author
Print
Download PDF
Article Alerts
Sign In to Email Alerts with your Email Address
Email Article

Thank you for your interest in spreading the word on American Board of Family Medicine.

NOTE: We only request your email address so that the person you are recommending the page to knows that you wanted them to see it, and that it is not junk mail. We do not capture any email address.

Enter multiple addresses on separate lines or separate them with commas.
Less AND More Are Needed to Assess Primary Care
(Your Name) has sent you a message from American Board of Family Medicine
(Your Name) thought you would like to see the American Board of Family Medicine web site.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
9 + 5 =
Solve this simple math problem and enter the result. E.g. for 1+3, enter 4.
Citation Tools
Less AND More Are Needed to Assess Primary Care
Rebecca S. Etz, Martha M. Gonzalez, E. Marshall Brooks, Kurt C. Stange
The Journal of the American Board of Family Medicine Jan 2017, 30 (1) 13-15; DOI: 10.3122/jabfm.2017.01.160209

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
Share
Less AND More Are Needed to Assess Primary Care
Rebecca S. Etz, Martha M. Gonzalez, E. Marshall Brooks, Kurt C. Stange
The Journal of the American Board of Family Medicine Jan 2017, 30 (1) 13-15; DOI: 10.3122/jabfm.2017.01.160209
Twitter logo Facebook logo Mendeley logo
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Jump to section

  • Article
    • Abstract
    • Acknowledgments
    • Notes
    • References
  • Figures & Data
  • References
  • Info & Metrics
  • PDF

Related Articles

  • It Matters What Is Measured
  • PubMed
  • Google Scholar

Cited By...

  • How the Novel Person-Centered Primary Care Measure Performs in Canada
  • A New Comprehensive Measure of High-Value Aspects of Primary Care
  • Primary Care and Public Health Perspectives on Integration at the Local Level: A Multi-State Study
  • Counterpoint: How Quality Reporting Made Me a Worse Doctor
  • It Matters What Is Measured
  • Practice Innovation for Care Integration, Opioid Management, and Quality Measurement in Family Medicine
  • Google Scholar

More in this TOC Section

  • Rural Family Physicians Are More Likely to Collaborate with Multisector Community Organizations
  • Family Medicine Residents Intentions to Provide Gender Affirming Care
  • Only One Quarter of Family Physicians Are Very Satisfied with Their Electronic Health Records Platform
Show more Policy Brief

Similar Articles

Keywords

  • Community Health Care
  • Patient-Centered Care
  • Primary Health Care

Navigate

  • Home
  • Current Issue
  • Past Issues

Authors & Reviewers

  • Info For Authors
  • Info For Reviewers
  • Submit A Manuscript/Review

Other Services

  • Get Email Alerts
  • Classifieds
  • Reprints and Permissions

Other Resources

  • Forms
  • Contact Us
  • ABFM News

© 2025 American Board of Family Medicine

Powered by HighWire