Skip to main content

Main menu

  • HOME
  • ARTICLES
    • Current Issue
    • Ahead of Print
    • Archives
    • Abstracts In Press
    • Special Issue Archive
    • Subject Collections
  • INFO FOR
    • Authors
    • Reviewers
    • Call For Papers
    • Subscribers
    • Advertisers
  • SUBMIT
    • Manuscript
    • Peer Review
  • ABOUT
    • The JABFM
    • The Editing Fellowship
    • Editorial Board
    • Indexing
    • Editors' Blog
  • CLASSIFIEDS
  • Other Publications
    • abfm

User menu

Search

  • Advanced search
American Board of Family Medicine
  • Other Publications
    • abfm
American Board of Family Medicine

American Board of Family Medicine

Advanced Search

  • HOME
  • ARTICLES
    • Current Issue
    • Ahead of Print
    • Archives
    • Abstracts In Press
    • Special Issue Archive
    • Subject Collections
  • INFO FOR
    • Authors
    • Reviewers
    • Call For Papers
    • Subscribers
    • Advertisers
  • SUBMIT
    • Manuscript
    • Peer Review
  • ABOUT
    • The JABFM
    • The Editing Fellowship
    • Editorial Board
    • Indexing
    • Editors' Blog
  • CLASSIFIEDS
  • JABFM on Bluesky
  • JABFM On Facebook
  • JABFM On Twitter
  • JABFM On YouTube
Research ArticleOriginal Research

Primary Care Physicians' Conceptualization of Quality in Medicare's Merit-Based Incentive Payment System

Carl T. Berdahl, Molly C. Easterlin, Gery Ryan, Jack Needleman and Teryl K. Nuckols
The Journal of the American Board of Family Medicine May 2021, 34 (3) 590-601; DOI: https://doi.org/10.3122/jabfm.2021.03.200555
Carl T. Berdahl
From the Department of Medicine, Cedars-Sinai Medical Center, Los Angeles, CA (CTB, TKN); Department of Emergency Medicine, Cedars-Sinai Medical Center, West Hollywood, CA (CTB); University of California, Los Angeles (UCLA) National Clinician Scholars Program (CTB, MCE); Department of Pediatrics, Cedars-Sinai Medical Center (MCE); Division of Neonatal Medicine, Department of Pediatrics, Los Angeles County and University of Southern California Medical Center (MCE); Kaiser Permanente School of Medicine, Pasadena, CA (GR); Department of Health Policy and Management, UCLA Fielding School of Public Health (JN).
MD, MS
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Molly C. Easterlin
From the Department of Medicine, Cedars-Sinai Medical Center, Los Angeles, CA (CTB, TKN); Department of Emergency Medicine, Cedars-Sinai Medical Center, West Hollywood, CA (CTB); University of California, Los Angeles (UCLA) National Clinician Scholars Program (CTB, MCE); Department of Pediatrics, Cedars-Sinai Medical Center (MCE); Division of Neonatal Medicine, Department of Pediatrics, Los Angeles County and University of Southern California Medical Center (MCE); Kaiser Permanente School of Medicine, Pasadena, CA (GR); Department of Health Policy and Management, UCLA Fielding School of Public Health (JN).
MD, MS
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Gery Ryan
From the Department of Medicine, Cedars-Sinai Medical Center, Los Angeles, CA (CTB, TKN); Department of Emergency Medicine, Cedars-Sinai Medical Center, West Hollywood, CA (CTB); University of California, Los Angeles (UCLA) National Clinician Scholars Program (CTB, MCE); Department of Pediatrics, Cedars-Sinai Medical Center (MCE); Division of Neonatal Medicine, Department of Pediatrics, Los Angeles County and University of Southern California Medical Center (MCE); Kaiser Permanente School of Medicine, Pasadena, CA (GR); Department of Health Policy and Management, UCLA Fielding School of Public Health (JN).
PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Jack Needleman
From the Department of Medicine, Cedars-Sinai Medical Center, Los Angeles, CA (CTB, TKN); Department of Emergency Medicine, Cedars-Sinai Medical Center, West Hollywood, CA (CTB); University of California, Los Angeles (UCLA) National Clinician Scholars Program (CTB, MCE); Department of Pediatrics, Cedars-Sinai Medical Center (MCE); Division of Neonatal Medicine, Department of Pediatrics, Los Angeles County and University of Southern California Medical Center (MCE); Kaiser Permanente School of Medicine, Pasadena, CA (GR); Department of Health Policy and Management, UCLA Fielding School of Public Health (JN).
PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Teryl K. Nuckols
From the Department of Medicine, Cedars-Sinai Medical Center, Los Angeles, CA (CTB, TKN); Department of Emergency Medicine, Cedars-Sinai Medical Center, West Hollywood, CA (CTB); University of California, Los Angeles (UCLA) National Clinician Scholars Program (CTB, MCE); Department of Pediatrics, Cedars-Sinai Medical Center (MCE); Division of Neonatal Medicine, Department of Pediatrics, Los Angeles County and University of Southern California Medical Center (MCE); Kaiser Permanente School of Medicine, Pasadena, CA (GR); Department of Health Policy and Management, UCLA Fielding School of Public Health (JN).
MD, MSHS
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Article
  • Figures & Data
  • References
  • Info & Metrics
  • PDF
Loading

Abstract

Background: While administrators of pay-for-performance may have good intentions, physicians may be reluctant to participate for various reasons, including poor program alignment with realities of clinical practice. In this study, we sought to characterize how primary care physicians (PCPs) participating in Medicare's Merit-Based Incentive Payment System (MIPS) conceptualize the quality of health care to help inform future measurement strategies that physicians would understand and appreciate.

Methods: We performed semi-structured qualitative interviews with a nationwide sample of 20 PCPs in MIPS. We asked PCPs how they would characterize quality and what distinguished exceptional, good, and poor quality. Interviews were transcribed and 2 coders independently read transcripts, allowing data to emerge from the interviews and developing theories about the data. The coders met intermittently to discuss findings, harmonize the coding scheme, develop a final list of themes and subthemes, and aggregate a list of representative quotations.

Results: Participants described quality as consisting of 2 components: (1) evidence-based care that is safe, which included health maintenance and chronic disease control, accurate diagnoses, and guideline adherence, and (2) patient-centered care, which included spending enough time with patients, responding to patient concerns, and establishing long-term relationships founded on trust.

Conclusions: PCPs consider patient-centered care necessary for the provision of exceptional quality. Program administrators for quality measurement and pay-for-performance programs should explore new ways to reward PCPs for providing outstanding patient-centered care. Future research should be undertaken to determine whether patient-centered activities such as forging long-term, favorable patient-physician relationships, are associated with improved health outcomes.

  • Health Policy
  • Medicare
  • Outcomes Assessment
  • Patient-Centered Care
  • Pay for Performance
  • Physician-Patient Relations
  • Primary Health Care
  • Qualitative Research
  • Quality Improvement

Background

The primary care physician (PCP) practice environment has been changing rapidly over the last several decades due to many factors, including the development of quality measurement and pay-for-performance programs.1 In 2015, for example, Congress passed the Medicare Access and CHIP Reauthorization Act (MACRA), thereby firmly establishing a payment system that alters physician payment based on performance on measures of health care quality and value.2 Under MACRA, physicians participate in the Quality Payment Program either through the default pay-for-performance track—the Merit-Based Incentive Payment System (MIPS)—or via Advanced Alternative Payment Models, such as risk-bearing accountable care organizations, which reward physicians with a 5% lump-sum bonus payment. In the first year of the Quality Payment Program, approximately 700,000 physicians participated in MIPS by submitting data related to (1) quality, (2) cost, (3) improvement activities, or (4) use of certified electronic health record technology to the Centers for Medicare and Medicaid Services (CMS).3⇓–5 Based on performance on activities in these 4 categories each year, CMS generates composite scores determining whether physicians or groups will receive upward, neutral, or downward payment adjustments 2 years in the future. CMS reported that 94% of all eligible physicians participated in the first year of MIPS, and 74% of clinicians reported quality data for a full 12 months.6 These statistics demonstrate that the MIPS program affects a substantial number of physicians across the nation, and it has the potential to influence quality of care for millions of patient-physician encounters.

Meanwhile, a countermovement against quality measurement and pay-for-performance programs has been occurring. In a 2015 survey of PCP experiences and reactions to changes in health care payment, 67% of physicians reported believing that quality measures were having negative or no impact on their ability to provide high-quality healthcare to their patients.7 Additionally, some evidence indicates that increased burden of administrative rules and regulations has negatively impacted physician satisfaction,8 and that diversion of physician attention from patient-centered concerns may worsen health outcomes.9⇓–11 Prominent stakeholders now advocate for measurement parsimony,12 a decrease in the number of resources dedicated toward quality measurement,13⇓–15 a reduction of administrative burdens for physicians,16 and discontinuation of invalid measures.17 In particular, the MIPS program has fostered controversy and criticism from physician groups because of the burdens of data collection and reporting, particularly for smaller practices.18⇓⇓–21 Thus in a contemporary clinical practice environment characterized by both physician ambivalence to measurement and an expansion of quality measurement activities, there is a need to examine physician conceptualizations of the quality of healthcare so that quality measurement program administrators can align future measurement programs to optimize physician engagement.22,23 Thus, our objective was to describe how PCPs characterize the nature of quality in healthcare by performing interviews with PCPs reporting under MIPS.

Methods

Design, Setting, and Participants

We conducted a qualitative study using 1-on-one semi-structured interviews with MIPS-eligible PCPs in 2017 and 2018.24 To facilitate investigation of a variety of clinical experiences, we recruited PCPs from diverse practice settings across the United States by using maximum variation sampling.25 We considered PCPs who were trained in family medicine or internal medicine to be eligible for the study if they were expected to report under MIPS. We verified MIPS expected reporting status by using an online tool.26 PCPs were recruited by word-of-mouth, using a mixture of referrals from study investigators and physician organizations, including the Los Angeles County Medical Association. To ensure a diverse sample of participants, we began each interview with a brief pre-session survey to obtain information about the physician and his/her practice. As recruitment proceeded, we aimed to fill gaps in our sample by seeking out a specific physician or practice characteristics (eg, small practice, rural setting, etc). Interviews were planned to last approximately 30 minutes (duration range, 13 minutes 45 seconds to 40 minutes 52 seconds), and participants were additionally asked specific questions about the MIPS program as described in a related manuscript.21 We provided a $50 gift card as compensation for participation.

Description of Interview Sessions

At the beginning of each interview session, a brief pre-session survey was administered to confirm eligibility for the study, ascertain physician and practice characteristics (self-reported by the physician) to direct maximum variation sampling, and facilitate reporting of the study sample in this manuscript. One author (CTB), an emergency physician and fellowship-trained health services researcher with qualitative methods experience, performed all interviews either in person, for participants local to the Los Angeles area, or by telephone, for participants in other regions. In-person interviews were completed in participants' offices and audio recorded. Telephone interviews were performed using a secure audio recording. The interviewer used a semi-structured interview guide. (See Box 1 for a brief overview of interview questions. Appendix A1 provides the pre-session survey and the full semi-structured interview guide.) A professional transcription service transcribed all interviews. In the results section and appendices, quotes from study participants are annotated with unique participant numbers (e.g. P5 for participant number 5) so that readers can discern whether multiple quotes came from same or different participants. It should be noted that a related publication focusing on the MIPS policy itself describes results from the same interview sessions with the same PCPs.24

Analysis

We utilized a 2-step process to allow data to emerge from the semi-structured interviews, developing theories about the data and maintaining a log of ideas about the meaning of its content. Two coders, CTB (described above) and MCE (pediatrician and fellowship-trained health services researcher), independently read transcripts of the first 5 interviews and flagged all instances of responses related to the study questions using the text analysis software Atlas.ti Version 8 (ATLAS.ti Scientific Software Development GmbH, Berlin, Germany). We had an initial meeting to discuss and harmonize our coding schemes based on the emerging themes. We reviewed and coded through the eighteenth interview and then met again to discuss themes and subthemes. At this point, we decided that thematic saturation had likely been reached. We coded 2 final interviews without discovering new themes, confirming that thematic saturation had been achieved. We met once more to discuss findings and develop a final list of themes and subthemes, aggregating representative quotations from participants. We also assigned participants to subgroups to help facilitate exploratory analyses for participants with different practice characteristics. All study findings were additionally validated through discussions with senior co-authors (TKN, GR, JN) and others named in the acknowledgements.

Ethics

Institutional review boards at Cedars-Sinai Medical Center and the University of California, Los Angeles (UCLA) approved the study protocol. We obtained verbal consent from all study participants, which included consent for audio recording.

Results

Descriptive Characteristics of the Sample

Twenty PCPs participated in the study between November 2017 and June 2018. Eighteen of the 20 PCPs were board-certified at the time of interview (7 in family medicine and 11 in internal medicine). Nine physicians worked in small practices (groups of fewer than fifteen providers), and 5 worked in rural areas. Most PCPs worked in practices where most income arose from fee-for-service payment arrangements. Table 1 describes participants and their practice environments in further detail for the sample overall, and Appendix A3 provides participant-level practice characteristics that can be matched with quotes that seem in the remainder of the manuscript.

View this table:
  • View inline
  • View popup
Table 1.

Physician and Practice Characteristics Self-Reported by Study Participants, (n = 20)

Physician Conceptualizations of Health care Quality: Overview

A conceptual framework describing PCPs' characterization of quality in health care emerged via inductive analysis of the interviews. When asked to define health care quality, many respondents described the concept as consisting of 2 components: (1) evidenced-based care that is safe, and (2) patient-centered care that is responsive to individual patients' needs. Most PCPs described that their first responsibility was to deliver evidence-based care, which consisted of routine health maintenance, chronic disease management, care consistent with current recommendations, accurate diagnoses, and high-value care. Providing evidence-based care was viewed as necessary, but not sufficient, for the provision of exceptional health care. Delivering evidence-based care along with patient-centered care was viewed as exceptional. Physicians often described examples of outstanding care as offering particularly timely care, responding to patients' individual needs, or advocating for a patient under special circumstances. See Figure 1 for a graphical depiction of this conceptual framework, Table 2 for a complete list of themes and subthemes, and Appendix A2 for a list of sample quotes exemplifying all subthemes. The following paragraphs explore the components of evidence-based and patient-centered care in further detail.

Figure 1.
  • Download figure
  • Open in new tab
Figure 1.

Conceptual Framework: What Makes The Quality Of Health Care Exceptional?

View this table:
  • View inline
  • View popup
Table 2.

List of Study Themes, Associated Study Sub-Themes, and Relevant Institute of Medicine Domains

Component 1: Evidence-Based Care That is Safe

When asked to provide specific examples of high-quality care, many participants focused on providing recommended health maintenance: “I believe that there are certain elements of providing care that are standard of care and that are proven to be beneficial to patients. Flu vaccine, pneumonia vaccine, vaccines in general, cancer screenings, like breast screening, colon cancer screening, cervical cancer screening.” (P4) Participants also commonly mentioned control of chronic disease as important to health care quality: “When a physician is taking care of a patient with diabetes… The patient should come in at 1 month, then 3 months, then 6-month intervals. [The physician] should know what blood work they are getting at that interval. At every visit, [the physician] should take off their shoes and socks, check monofilaments on them, make sure that the medications are reconciled, and that this information is communicated with the patient's other physicians. This should be a set protocol.” (P12) Many physicians mentioned that they relied on evidence-based recommendations from trusted organizations to guide diagnostic and treatment decisions, stating that it was the PCP's responsibility to stay up-to-date with these standards: “I would say that practices [providing high-quality care are practices that are] making every effort to ensure that they are meeting the standard of care as put forth from well-established bodies such as US Preventive Services Task Force, from [Medicare], and from our own organizations such as the American Academy of Family Physicians.” (P6)

Participants also expressed the belief that safety was an important dimension of health care quality: They strived to make accurate diagnoses and avoid low-value care to ensure that patients received high-quality, evidence-based care. One PCP explained that making an accurate diagnosis could be challenging, but also believed doing so consistently was a physician's responsibility: “Everybody can do checklist medicine and check [a hemoglobin A1C] twice this calendar year. [On the other hand,] when you have a patient with a difficult diagnosis which you establish and come up with an effective treatment for–now that is good care.” (P11) There was also a sense among participants that low-value care could be harmful to patients, either because of costs or adverse consequences related to testing or treatments that were not indicated. One PCP provided an example by describing that his grandmother might demand care, but the right course of action was to withhold care in cases where potential harms outweighed potential benefits: “My grandma was a very wealthy person and she was very demanding. Basically, she would want you to forget about standards in health care and spend every health care dollar on her and waste everything on her to get every test possible, which is absolutely not right because [it is wasteful and potentially harmful.]” (P12) See Table 2 for more examples of subthemes that were categorized as related to evidence-based care.

Component 2: Patient-Centered Care

Many respondents reported believing that a good PCP provided patient-centered, personalized service. In other words, simply providing evidence-based medicine was not enough because patients needed and deserved excellent service as well. One respondent relayed, “I think broadly about right care, right place, right time for the patient, in a patient-centered way. I mean, I think in my own terms, I would think of quality care being all the care you need and none of the care that you do not need, delivered in a personalized way, in accord as much as possible with the best available evidence and done efficiently and in the flow of…working within the flow of patients' lives.” (P16) Several participants mentioned that helping patients achieve personalized goals was more important than scoring well on quality measures: “I think our job as doctors is to help patients achieve their life goals, their health-related life goals. So for me, that is what quality is about….At the end of the day, if I am achieving perfect scores [on quality measures] but not meeting the patients' goals, helping advance what they want, I am not doing a good job.” (P5) Providing unusually timely care was a subtheme that many participants discussed. PCPs tended to believe that providing easy, open access to patients was an important way to systematically deliver outstanding care: “I personally give my patients my e-mail address so they can directly contact me with any concerns without being filtered by my staff. I try to have good hours, leave slots for urgent care, essentially have them be able to access me so that they can get care.” (P1) Finally, ensuring that patients actually received the care that PCPs prescribed was a common challenge that PCPs noted: “I think developing systems as an individual or with teams in your clinic to ensure good follow-up for patients. So, seeing patients and tracking patients over time–Looking across your panel…and trying to be systematic and proactive about having patients come back in or refer to sites of care expeditiously and effectively.” (P16)

Several PCPs spoke about the importance of establishing long-term relationships with patients founded on trust. For example, 1 physician in a large group practice mentioned, “What people do not get is that if patients go to the person that they trust, they are more likely to be adherent to their medication or adherent to whatever regimen, if they know and trust the physician.” (P1) PCPs considered demonstrating caring and compassion to be important, and they believed that this helped establish good rapport with patients: “I think the patients are looking for someone who will listen, someone who seems to be interested in the problems that they are presenting…Obviously, they want you to be knowledgeable and compassionate and timely and everything else, but I think patients want to be listened to and taken more seriously than anything else.” (P20) PCPs perceived a contrast between evidence-based care, which tends to be feasible to measure, and patient-centered care, which tends to be hard to measure. Several physicians lamented that measurement priorities may be misaligned simply because measurement of patient-centered care is challenging: “The quality movement has been perverted to a kind of big data enterprise now and really, I think the focus of primary care is actually about relationships and building sort of meaningful relationships with people over time.” (P18)

Conceptualizing Exceptional and Poor Health care Quality

To further refine the PCP definition of health care quality, we asked participants to describe what separated exceptional care from good care. In describing exceptional care, respondents tended to emphasize the patient-centered component of quality even more, including relationship-building and shared decision making. One respondent explained, “I think, also, there's that human component that is hard to measure, the connection that people feel with their primary care doctor for those who feel connected.” (P10) Respondents also tended to include immediate access and timely responses in their definition of exceptional care, whether that was a patient's ability to obtain an appointment immediately or engage in brief conversations with PCPs by phone or e-mail: “I think it is about hearing people and really listening, engaging them, letting them know that you are there, even when they are not in the office. So they can run something by me either by e-mail or call my office. I guess for me, exceptional care has been really more about the relationship.” (P1) Some respondents included patient advocacy in their definition of exceptional health care quality: “When I think of a doctor who is exceptional, I just think of someone who is an awesome patient advocate and making sure that the patients get what they need to the best of their ability.” (P4)

Finally, we asked PCPs to distinguish poor care from good care. Participants cited faults in evidenced-based care that resulted in missed diagnosis or inappropriate treatment: “I guess I would say low quality of care, if I meet people who have been with other physicians, I would say honestly, either under or overtreatment…. So, I see people who are getting annual chest x-rays and cardiac stress tests for no reason. So, I find that as painful as people who are not receiving great care. So, I will get people who have never been asked if they have had their screening colonoscopy and they are 60 or are overdue for screening mammograms.” (P1) Another participant agreed, also adding that lack of care coordination contributes to low-quality care: “So, I think low quality of care could be a couple of different things. One could be—unfortunately, I have seen providers in practice that are not maybe following evidence-based recommendations or maybe do not have the skill level to address the problem they are trying to address but they are not kind of seeking out help. So, I guess I have seen misdiagnoses, mistreatments, so that is low quality of care definitely. Then I think also the other piece of it could be that they tend to just really not follow up well with their own patients and not coordinate care back to the primary care doctor well. That can sometimes result in low quality of care too because things that they recommend never get conducted.” (P9)

Differences in Responses according to Practice Characteristics

While the study was not designed to detect differences in quality conceptualization by practice characteristics, certain themes emerged more commonly during interviews with PCPs in large versus small practices and urban versus rural settings. PCPs from large practices more frequently quoted pre-existing definitions of quality and specific quality measures. For example, 1 participant from a large practice stated, “I learned that quality equals appropriateness times the combination of outcomes and service divided by waste.” (P15) Another PCP from a large practice mentioned that common measures included measures related to administration of “flu vaccine, pneumonia vaccine, vaccines in general, cancer screenings, like breast cancer screening, colon cancer screening, cervical cancer screening…A1C that is as close to normal, having blood pressures at certain levels, etc.” (P4) PCPs from small practices more commonly responded with definitions of quality that could be considered more practical rather than rule-based, for example: “Patient stable, kept out of the hospital, and medical conditions controlled” (P2) and “spending enough time, being responsive, being accessible, and having your delivery model be able to provide evidence-based medicine in a timely manner.” (P3)

PCPs in rural settings more commonly mentioned that a patient's socioeconomic status should be considered when interpreting performance on quality measures (2 of 5 rural vs 1 of 9 urban). For example, 1 PCP from a small practice in the rural South mentioned, “I think it is almost impossible to rate quality unless you can find a way to do it by socioeconomic status. Here's the deal: Our A1C goal for our accountable care organization is 9. It is hard to get a lot of them under a 9. I've got a son that is doing a residency in the Midwest. They never see 1 over 8.” (P14) The 1 urban PCP who mentioned socioeconomic status and its relevance to quality measurement referred to challenges involved with caring for homeless patients: “It may be that they are homeless and it does not make sense to have them on 9 medications a day for their heart failure, because there's no way they can possibly be compliant. So, we may go for a simpler regimen that makes more sense to them.” (P5)

Discussion

Quality of health care is notoriously challenging to define, and varying stakeholders have often defined it differently. In this qualitative investigation of PCP opinions about the nature of health care quality, participants revealed that they conceptualize health care quality as having 2 components: (1) evidence-based care that is safe and (2) patient-centered care. Moreover, evidence-based care that is safe is necessary but not sufficient in the provision of exceptional care. According to our panel of physicians, patient-centered care is an important component of the care experience, especially the establishment of long-standing patient-physician relationships built on trust. Understanding how physicians conceptualize quality is important to optimizing engagement in quality improvement efforts.23

The Institute of Medicine identified 6 domains of health care quality: safety, effectiveness, timeliness, patient-centeredness, equity, and efficiency.27 Physicians in our study identified all these subthemes except equity, and it is difficult to know whether this subtheme might have emerged with a larger sample size or a different sample of PCPs. The framework that emerged from our data (Figure 1) seems to be a simplified version of the framework from the Institute of Medicine (IOM), though our framework highlights the finding that PCPs believe the provision of patient-centered care is what distinguishes exceptional care from good care. Alternative conceptual frameworks relating to the quality of health care have been promulgated by various organizations including the Council of Europe,28 the Organization for Economic Cooperation and Development (OECD),29 the World Health Organization,30 and the European Commission.31 The OECD reviewed these models in a 2019 publication and proposed 3 core dimensions of quality that align with our components: effectiveness, safety (which we refer to collectively as “evidence-based care that is safe”), and responsiveness (“patient-centeredness”).32

Our interviews revealed physician beliefs that providing patient-centered care was necessary for care to be exceptional. If MIPS is intended to distinguish exceptional from good care, it may underemphasize the provision of patient-centered care, probably due to lack of availability of valid measures. A 2018 panel convened by the American College of Physicians (ACP) to review MIPS measures relevant to PCP practice found that only 37% (32 of 86) were valid measures of physician performance.17 Of 86 total measures, the only 1 relevant to patient-centered care was the Consumer Assessment of Healthcare Providers and Systems (CAHPS) for MIPS measure. This measure assesses Medicare beneficiaries' experiences with the care experience including interactions with physicians, office staff, care coordination, and more.33 The ACP panel deemed CAHPS for MIPS to have uncertain validity in measuring physician performance for several reasons, including limited physician influence on components of the measure and the measure's questionable relationship with health outcomes.17 Moreover, submission of the CAHPS measure is limited to groups and virtual groups, and it requires MIPS participants to pay for a CMS-approved vendor to administer the survey,34 further constraining physician participation. Thus, to better align the MIPS program with physician conceptualization of what makes quality outstanding in the minds of PCPs, program administrators could consider providing financial support for CAHPS survey administration, developing new CAHPS measures that assess longitudinal relationships between physicians and patients, and providing new types of incentives for patient-centered care.

Our findings have additional implications for quality measurement and pay-for-performance movements because our participants communicated that PCPs believe long-standing, trust-based relationships are important for the provision of exceptional health care. Our findings may provide primary care providers with talking points to guide payers, professional societies, and others to create a more robust data collection process and provider support program going forward. Further research is warranted to verify our findings across a larger population of PCPs and determine whether rewarding performance on other aspects of patient-centered care, such as the development of long-term patient-physician relationships founded on trust, could improve health outcomes for patients.

Moving beyond the direct implications of our study, a 2018 JAMA viewpoint article titled “Professionalism, Performance, and the Future of Physician Incentives” suggested that program administrators consider adoption of new incentives that are more local and more directly relevant to daily clinical practice. For example, (1) clinicians could be incentivized to develop and select their own quality goals; (2) the level of performance measurement could be altered so that interdisciplinary clinical teams are the focus rather than clinicians, which could lead to improved team-based care and improved physician satisfaction; and (3) nonfinancial rewards could be prioritized, which would capitalize on PCP physician intrinsic motivation. In our opinion and considering our study's findings, exploring incentives such as these could help align future quality measurement and pay-for-performance programs with PCP priorities.35

Limitations

Our study has several limitations. First, small-sample qualitative studies are useful for developing theories and identifying questions that should undergo further inquiry. Therefore, this study may be limited in its generalizability, though we attempted to minimize this risk by recruiting PCPs in different areas across the national and different practice environments. Second, because we decided to use maximum variation sampling, the characteristics of our sample may not reflect those of the population of physicians nationwide. Third, word of mouth was used to recruit PCPs in our sample, so our study population may be biased despite our best efforts to seek out diversity in physician and practice characteristics. Fourth, our interviews included questions about the MIPS program, and recruiting physicians for a study involving questions about a quality measurement program may have biased responses about the nature of quality in health care. Fifth, we report subgroup analyses (large vs small practices, rural vs urban setting) to explore our data completely and generate hypotheses for future inquiry; however, the study was not designed to facilitate subgroup analyses, so these analyses should be interpreted with caution. Finally, though we made attempts to ensure rigor and limit biases by employing reflexivity and bracketing33 during study design, recruitment, data collection, and analysis, there remains a risk that investigator and coder biases may have limited the reliability or validity of our findings.

Conclusions

PCPs consider patient-centered care to be necessary for the provision of exceptional quality in health care. Program administrators for quality measurement and pay-for-performance programs should explore new ways to reward PCPs for providing outstanding patient-centered care. Future research should be undertaken to determine whether patient-centered activities such as forging long-term, favorable patient-physician relationships, are associated with improved health outcomes.

Acknowledgments

The authors wish to thank John Jenrette, MD; Clement Yang, MD; Stephen Deutsch, MD; Caroline Goldzweig, MD, MSHS; Mark Noah, MD; and the Los Angeles County Medical Association for their assistance with study design and recruitment activities. The authors wish to thank Anish Mahajan, MD, for his thoughtful comments about the implications of the study results.

Appendix A1: Pre-Session Survey and Semi-Structured Interview Guide Pre-Session Survey

  1. Do you consider yourself a primary care physician?

    1. Yes

    2. No

  2. Are you licensed to practice medicine by the Medical Board in your state?

    1. Yes

    2. No

  3. Are you board certified in internal medicine or family medicine?

    1. Yes – internal medicine

    2. Yes – family medicine

    3. No

  4. How many physicians are in your practice group? (To clarify, I consider your group to be a collection of physicians who bill under the same taxpayer ID number.)

    1. 1 (solo practice)

    2. 2 to 14 (small group)

    3. 15 or more (large group)

  5. How many years have you practiced medicine (since finishing your training)?

    • a. < 5

    • b. 5 to 10

    • c. 10 to 15 days. 15 to 20

    • e. >20

  6. Which of the following best describes your practice environment?

    1. Urban

    2. Suburban

    3. Rural

  7. About what percent of your patients are covered by Medicare?

    1. 0%

    2. 1 to 9%

    3. 10 to 19%

    4. 20 to 29%

    5. 30 to 39%

    6. 40 to 49%

    7. >=50%

    8. I do not know

  8. About what percent of your patients face significant financial challenges such as housing and utility instability or having enough food to eat?

    1. 0%

    2. 1 to 9%

    3. 10 to 19%

    4. 20 to 29%

    5. 30 to 39%

    6. 40 to 49%

    7. >=50%

    8. I do not know

  9. How large is your panel of patients?

    1. <1000

    2. 1000 to 1500

    3. 1500 to 2000 days. 2000 to 2500

    4. >2500

    5. I do not know

  10. Which of the following best describes how you are paid for patient service?

    1. Fee-for-service

    2. Capitation

    3. Salary

    4. Other: ____________

  11. What percentage of your income related to patient encounters comes from fee-for-service payments?

    1. 0%

    2. 1 to 24%

    3. 25 to 49%

    4. 50 to 74%

    5. 75 to 99%

    6. 100%

    7. I do not know

  12. Do you have staff on hand that help you review and manage quality of care?

    1. Yes. If yes, please describe their training or educational background

      1. No

      2. I do not know

  13. Did you or your group participate in Medicare's Physician Quality Reporting System, also known as PQRS?

    1. Yes

    2. No

    3. I do not know

Semi-structured interview guide

Hello, Dr. ________. Thanks so much for meeting with me today and agreeing to participate in this study.

Let us begin our discussion.

PART 1: Exploring the nature of health care quality

First, I'd like to hear about what you believe quality means in health care.

  1. What do you consider to be “good” quality of care? What does it “look” like?

  2. What is exceptional quality of care, and how is it different from good quality of care?

  3. What is low quality care, and how is it different from good quality of care?

  4. What kinds of things can a primary care physician do to ensure he/she is providing exceptional quality of care?

  5. How do you know, given the constraints of a particular day, whether you have been able to meet your own expectations on quality for a particular patient?

  6. What are aspects of your practice that limit your ability to improve quality? (eg, limited time with patients, goal to work on patient satisfaction, etc.)

  7. How do you or your staff members track patients after a visit? What role, if any, does monitoring play?

###RESULTS FROM THE REMAINDER OF THIS GUIDE WERE PUBLISHED SEPARATELY###

###SEE REFERENCE 23 ABOVE###

PART 2a: Exploring experiences with quality measurement and pay-for-performance systems

Now, I'd like to learn about your past experiences with quality measurement programs. For example, you may be familiar with NCQA's HEDIS Program, IHA's Quality Measurement Program, Medicare's PQRS, or other quality improvement systems that measure your performance. Often, quality measures look at prevention and the management of chronic diseases, such as how often patients are getting recommended vaccines or cancer screening. Sometimes quality measures target outcomes, like hemoglobin A1C goals for diabetic patients.

8. Have you have participated in some kind of quality measurement or monitoring program? For instance, Medicare's PQRS? Has your own group or organization used quality measures to assess, monitor, or improve quality of care?

9. What has your experience been like with quality monitoring programs? (ie, positive or negative, and how so?)

10. What kinds of things make it hard to perform well on quality measures?

11. What kinds of things make it easier to perform well on quality measures?

12. To what extent do you think that quality scores accurately reflect the quality of care delivered?

PART 2b: Exploring experiences with MIPS

Let us change gears a bit to talk about a more specific policy. Some people have heard about this program and some haven't.

13. Have you ever heard of the Merit-Based Incentive Payment System, also known as MIPS?

13a. (If yes) Great.

13b. (If no) That is ok. Allow me to explain a bit.

In 2015, Congress passed MACRA, the “doc-fix” bill that stopped Medicare's SGR (Sustainable Growth Rate) and also started linking physician payment to quality in a few different ways. One of these quality payment links is the new Merit-Based Incentive Payment System (from now on we'll call it MIPS). This system requires physicians to submit data on quality of care to Medicare. Each physician, or his/her group, chooses quality measures, collects data, and submits it to Medicare. Then, Medicare assesses physician performance compared with peers nationally, and it increases reimbursement for those who performed well during a certain time period and decreases reimbursement for those who did not.

14. How familiar are you with MIPS?

In some practices, physicians are very involved in making decisions about things like MIPS, while in other practices, administrators do most of this work.

15. How far along are you or your practice in preparing to respond to MIPS? What changes have occurred as a result? What other changes are you anticipating? Have you needed to make changes in administrative and support staffing? Have you hired consultants to help out?

16. How did you or your group choose which MIPS measures to submit? (Or how do you or your group plan on choosing them?)

17. Who manages the data? What kind of feedback do you receive about how you are performing on the measures?

18. How do you think the MIPS policy will affect your ability to care for your patients?

19. How do you think this policy will affect quality of care for your patients?

Now, think about quality scores in MIPS. Physicians receive higher scores if they perform better on quality measures and lower scores if they do not perform as well.

20. To What Extent Do You Think That Quality Scores Reflect Quality of Care?

21. If a physician makes his or her score better or worse the next year, what does that mean for the quality of care that he or she provides?

Some people believe that the quality of health care is best measured by using health outcomes, such as mortality and morbidity.

22. How do you think this policy will affect health outcomes like morbidity and mortality for your patients?

PART 3: Exploring practice changes occurring as a result of MIPS

Now I'd like to talk about how this policy has affected you and your practice environment.

23. What changes have you or your practice made because of the policy? (or what changes do you anticipate needing to make?)

24. To what extent do you think that quality scores demonstrate true gaps in the care a physician provides? To what extent do you think quality scores can be improved by documentation rather than actual practice change? How do you think other doctors might try to game the system?

25. How much would your annual income have to change to motivate you to improve your scores?

26. To what extent has this policy changed the way you spend your time on a typical day, if at all?

27. To what extent has this policy changed your relationship with your patients, if at all?

28. To what extent has your conception of the quality of care you provide changed as a result of this policy? (ie, Do you know think you rank better or worse compared with other physicians?)

29. To what extent do you believe this policy changed power dynamics between PCPs and other physicians, if at all?

30. Imagine the opportunity arises to join a larger organization that has a team focused on quality measurement, allowing you to concentrate more on patient care. How attractive does that opportunity sound to you, everything else being equal?

31. How do you think the MIPS system could be improved?

32. In 5 to 10 years, what do you think doctors and patients will say about MIPS?

Thank you so much for sharing your thoughts and your time. I really appreciate it.

Appendix

View this table:
  • View inline
  • View popup
Appendix A2:

List of Representative Quotes for Themes and Sub-themes

Appendix

View this table:
  • View inline
  • View popup
Appendix A3:

Participant-level Characteristics

Notes

  • This article was externally peer reviewed.

  • Funding: The UCLA National Clinician Scholars program and Cedars-Sinai Medical Center contributed internal funds that made the study possible.

  • Conflicts of interest: None.

  • Pre-print: This article is available in pre-print at https://www.researchsquare.com/article/rs-26478/v1.

  • Related work: Results from the same participants and the same interview sessions (but relating to different research questions) are presented in the following manuscript: Berdahl CT, Easterlin MC, Ryan G, Needleman J, Nuckols TK. Primary Care Physicians in the Merit-Based Incentive Payment System (MIPS): A Qualitative Investigation of Participants' Experiences, Self-Reported Practice Changes, and Suggestions for Program Administrators. J Gen Intern Med 2019;34(10):2275-81.

  • Related work: Results from the same participants and the same interview sessions (but relating to different research questions) are presented in the following manuscript: Berdahl CT, Easterlin MC, Ryan G, Needleman J, Nuckols TK. Primary Care Physicians in the Merit-Based Incentive Payment System (MIPS): A Qualitative Investigation of Participants' Experiences, Self-Reported Practice Changes, and Suggestions for Program Administrators. J Gen Intern Med 2019;34(10):2275-81.

  • To see this article online, please go to: http://jabfm.org/content/34/3/590.full.

  • Received for publication October 21, 2020.
  • Revision received January 19, 2021.
  • Accepted for publication January 20, 2021.

References

  1. 1.↵
    1. Laiteerapong N,
    2. Huang ES
    . The pace of change in medical practice and health policy: collision or coexistence? J Gen Intern Med 2015;30:848–52.
    OpenUrlCrossRefPubMed
  2. 2.↵
    Centers for Medicare and Medicaid Services, US Department of Health and Human Services. Medicare Access and CHIP Reauthorization Act of 2015. Pub. L. No 2015;114:2015.
    OpenUrl
  3. 3.↵
    Centers for Medicare and Medicaid Services, US Department of Health and Human Services. Merit-Based Incentive Payment System (MIPS) Overview. 2020. Available from: https://qpp.cms.gov/mips/overview. Accessed April 9, 2020.
  4. 4.↵
    Centers for Medicare and Medicaid Services, US Department of Health and Human Services. Medicare Program; Merit-Based Incentive Payment System (MIPS) and Alternative Payment Model (APM) Incentive Under the Physician Fee Schedule, and Criteria for Physician-Focused Payment Models. Final rule with comment period. Fed Regist 2016;81:77008–831. Available from: https://www.federalregister.gov/documents/2016/11/04/2016-25240/medicare-program-merit-based-incentive-payment-system-mips-and-alternative-payment-model-apm. Accessed May 4, 2021.
    OpenUrl
  5. 5.↵
    1. Verma S
    . Centers for Medicare and Medicaid Services, US Department of Health and Human Services. Quality Payment Program (QPP) Year 1 Performance Results. 2018. Available from: https://www.cms.gov/blog/quality-payment-program-qpp-year-1-performance-results. Accessed June 3, 2019.
  6. 6.↵
    Centers for Medicare and Medicaid Services, US Department of Health and Human Services. 2017 Quality Payment Program Reporting Experience. 2018.
  7. 7.↵
    1. Henry J
    Commonwealth Fund; Henry J. Kaiser Family Foundation. Primary Care Providers' Views of Recent Trends in Health Care Delivery and Payment. Findings from the Commonwealth Fund/Kaiser Family Foundation 2015 National Survey of Primary Care Providers. Issue Brief (Commonw Fund). 2015;24:1–13.
    OpenUrl
  8. 8.↵
    1. Friedberg MW,
    2. Chen PG,
    3. Van Busum KR,
    4. et al
    . Factors affecting physician professional satisfaction and their implications for patient care, health systems, and health policy. Rand Health Q 2014;3:1.
    OpenUrlPubMed
  9. 9.↵
    1. Marmor RA,
    2. Clay B,
    3. Millen M,
    4. Savides TJ,
    5. Longhurst CA
    . The impact of physician EHR usage on patient satisfaction. Appl Clin Inform 2018;9:11–4.
    OpenUrl
  10. 10.↵
    1. Panagioti M,
    2. Geraghty K,
    3. Johnson J,
    4. et al
    . Association between physician burnout and patient safety, professionalism, and patient satisfaction: a systematic review and meta-analysis. JAMA Intern Med 2018;178:1317–30.
    OpenUrl
  11. 11.↵
    1. Kuhn T,
    2. Basch P,
    3. Barr M,
    4. Yackel T
    . Medical Informatics Committee of the American College of Physicians. Clinical documentation in the 21st century: executive summary of a policy position paper from the American College of Physicians. Ann Intern Med 2015;162:301–3.
    OpenUrlCrossRefPubMed
  12. 12.↵
    1. Meyer GS,
    2. Nelson EC,
    3. Pryor DB,
    4. et al
    . More quality measures versus measuring what matters: a call for balance and parsimony. BMJ Qual Saf 2012;21:964–8.
    OpenUrlAbstract/FREE Full Text
  13. 13.↵
    1. Casalino LP,
    2. Gans D,
    3. Weber R,
    4. et al
    . US physician practices spend more than $15.4 billion annually to report quality measures. Health Aff (Millwood) 2016;35:401–6.
    OpenUrlAbstract/FREE Full Text
  14. 14.↵
    1. Meltzer DO,
    2. Chung JW
    . The population value of quality indicator reporting: a framework for prioritizing health care performance measures. Health Aff (Millwood) 2014;33:132–9.
    OpenUrlAbstract/FREE Full Text
  15. 15.↵
    1. Panzer RJ,
    2. Gitomer RS,
    3. Greene WH,
    4. Webster PR,
    5. Landry KR,
    6. Riccobono CA
    . Increasing demands for quality measurement. JAMA 2013;310:1971–80.
    OpenUrlCrossRefPubMed
  16. 16.↵
    Centers for Medicare and Medicaid Services, US Department of Health and Human Services. Reducing Burden. 2019 Available from: https://www.cms.gov/About-CMS/Components/CPI/Reducing-Burden. Accessed May 4, 2021.
  17. 17.↵
    1. MacLean CH,
    2. Kerr EA,
    3. Qaseem A
    . Time Out - Charting a Path for Improving Performance Measurement. N Engl J Med 2018;378:1757–61.
    OpenUrlCrossRefPubMed
  18. 18.↵
    Medicare Payment Policy: Report to Congress. Washington, DC: Medicare Payment Advisory Commission; 2018. Available from: http://www.medpac.gov/docs/default-source/reports/mar18_medpac_entirereport_sec.pdf?sfvrsn=0. Accessed May 4, 2021.
  19. 19.↵
    1. Firth S
    . MIPS Takes a Beating at MedPAC - Medicare advisory panel says it needs to go. MedPage Today. 2017. Available from: https://www.medpagetoday.com/publichealthpolicy/medicare/68362. Accessed April 9, 2020.
  20. 20.↵
    1. Soylu TG,
    2. Goldberg DG,
    3. Cuellar AE,
    4. Kuzel AJ
    . Medicare access and CHIP reauthorization act in small to medium-sized primary care practices. J Am Board Fam Med 2020;33:942–52.
    OpenUrlAbstract/FREE Full Text
  21. 21.↵
    1. Berdahl CT,
    2. Easterlin MC,
    3. Ryan G,
    4. Needleman J,
    5. Nuckols TK
    . Primary care physicians in the Merit-Based Incentive Payment System (MIPS): a qualitative investigation of participants' experiences, self-reported practice changes, and suggestions for program administrators. J Gen Intern Med 2019;34:2275–81.
    OpenUrl
  22. 22.↵
    1. Liao JM,
    2. Shea JA,
    3. Weissman A,
    4. Navathe AS
    . Physician perspectives in year 1 of MACRA and its merit-based payment system: a national survey. Health Aff (Millwood) 2018;37:1079–86.
    OpenUrl
  23. 23.↵
    1. Wiig S,
    2. Aase K,
    3. von Plessen C
    , For QUASER-team, et al. Talking about quality: exploring how ‘quality’ is conceptualized in European hospitals and healthcare systems. BMC Health Serv Res 2014;14:478.
    OpenUrlPubMed
  24. 24.↵
    1. Barriball KL,
    2. While A
    . Collecting data using a semi-structured interview: a discussion paper. J Adv Nurs 1994;19:328–35.
    OpenUrlCrossRefPubMed
  25. 25.↵
    1. Patton MQ
    . Qualitative research & evaluation methods. 3rd ed. Thousand Oaks, CA: Sage Publications; 2002. xxiv, 598, 65 p. p.
    OpenUrl
  26. 26.↵
    Centers for Medicare and Medicaid Services, US Department of Health and Human Services. QPP Participation Status. 2020. Available from: https://qpp.cms.gov/participation-lookup. Accessed April 9, 2020.
  27. 27.↵
    Crossing the Quality Chasm: A New Health System for the 21st Century. Washington, DC. 2001.
  28. 28.↵
    The development and implementation of quality improvement systems (QIS) in health care. Strasbourg: Council of Europe; 1997. Recommendation No. R(97)17 adopted by the Committee of Ministers of the Council of Europe on 30 September 1997 and explanatory memorandum.
  29. 29.↵
    1. Arah OA,
    2. Westert GP,
    3. Hurst J,
    4. Klazinga NS
    . A conceptual framework for the OECD Health Care Quality Indicators Project. Int J Qual Health Care 2006;18 Suppl 1:5–13.
    OpenUrlCrossRefPubMed
  30. 30.↵
    World Health Organization. Handbook for national quality policy and strategy: a practical approach for developing policy and strategy to improve quality of care. Geneva, Switzerland: World Health Organization; 2018.
  31. 31.↵
    European Commission. Key findings and recommendations on reporting and learning systems for patient safety incidents across Europe. Report of the reporting and learning subgroup of the European Commission. 2014.
  32. 32.↵
    1. Busse R,
    2. Klazinga N,
    3. Panteli D,
    4. Quentin W
    , eds. Improving healthcare quality in Europe: Characteristics, effectiveness and implementation of different strategies. European Observatory Health Policy Series. Copenhagen (Denmark); 2019.
  33. 33.↵
    Centers for Medicare and Medicaid Services, US Department of Health and Human Services. Consumer Assessment of Healthcare Providers and Systems (CAHPS) for the Merit-based Incentive Payment System (MIPS) Survey via CMS-Approved Survey Vendor Reporting. 2019. Available from: https://qpp.cms.gov/resource/CAHPS%20for%20MIPS%20Fact%20Sheet. Accessed May 4, 2021.
  34. 34.↵
    Centers for Medicare and Medicaid Services, US Department of Health and Human Services. CAHPS for MIPS Survey. 2020. Available from: https://www.cms.gov/Research-Statistics-Data-and-Systems/Research/CAHPS/mips.html. Accessed April 9, 2020.
  35. 35.↵
    1. Khullar D,
    2. Wolfson D,
    3. Casalino LP
    . Professionalism, performance, and the future of physician incentives. JAMA 2018;320:2419–20.
    OpenUrlCrossRefPubMed
PreviousNext
Back to top

In this issue

The Journal of the American Board of Family     Medicine: 34 (3)
The Journal of the American Board of Family Medicine
Vol. 34, Issue 3
May/June 2020
  • Table of Contents
  • Table of Contents (PDF)
  • Cover (PDF)
  • Index by author
  • Back Matter (PDF)
  • Front Matter (PDF)
Print
Download PDF
Article Alerts
Sign In to Email Alerts with your Email Address
Email Article

Thank you for your interest in spreading the word on American Board of Family Medicine.

NOTE: We only request your email address so that the person you are recommending the page to knows that you wanted them to see it, and that it is not junk mail. We do not capture any email address.

Enter multiple addresses on separate lines or separate them with commas.
Primary Care Physicians' Conceptualization of Quality in Medicare's Merit-Based Incentive Payment System
(Your Name) has sent you a message from American Board of Family Medicine
(Your Name) thought you would like to see the American Board of Family Medicine web site.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
1 + 1 =
Solve this simple math problem and enter the result. E.g. for 1+3, enter 4.
Citation Tools
Primary Care Physicians' Conceptualization of Quality in Medicare's Merit-Based Incentive Payment System
Carl T. Berdahl, Molly C. Easterlin, Gery Ryan, Jack Needleman, Teryl K. Nuckols
The Journal of the American Board of Family Medicine May 2021, 34 (3) 590-601; DOI: 10.3122/jabfm.2021.03.200555

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
Share
Primary Care Physicians' Conceptualization of Quality in Medicare's Merit-Based Incentive Payment System
Carl T. Berdahl, Molly C. Easterlin, Gery Ryan, Jack Needleman, Teryl K. Nuckols
The Journal of the American Board of Family Medicine May 2021, 34 (3) 590-601; DOI: 10.3122/jabfm.2021.03.200555
Twitter logo Facebook logo Mendeley logo
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Jump to section

  • Article
    • Abstract
    • Background
    • Methods
    • Description of Interview Sessions
    • Analysis
    • Ethics
    • Results
    • Discussion
    • Conclusions
    • Acknowledgments
    • Appendix A1: Pre-Session Survey and Semi-Structured Interview Guide Pre-Session Survey
    • Appendix
    • Appendix
    • Notes
    • References
  • Figures & Data
  • References
  • Info & Metrics
  • PDF

Related Articles

  • No related articles found.
  • PubMed
  • Google Scholar

Cited By...

  • COVID-19 Pandemic Practices, Payment Models, and Publication Successes: Family Medicine Studies a Variety of Primary Care Questions
  • Google Scholar

More in this TOC Section

  • Associations Between Modifiable Preconception Care Indicators and Pregnancy Outcomes
  • Perceptions and Preferences for Defining Biosimilar Products in Prescription Drug Promotion
  • Evaluating Pragmatism of Lung Cancer Screening Randomized Trials with the PRECIS-2 Tool
Show more Original Research

Similar Articles

Keywords

  • Health Policy
  • Medicare
  • Outcomes Assessment
  • Patient-Centered Care
  • Pay for Performance
  • Physician-Patient Relations
  • Primary Health Care
  • Qualitative Research
  • Quality Improvement

Navigate

  • Home
  • Current Issue
  • Past Issues

Authors & Reviewers

  • Info For Authors
  • Info For Reviewers
  • Submit A Manuscript/Review

Other Services

  • Get Email Alerts
  • Classifieds
  • Reprints and Permissions

Other Resources

  • Forms
  • Contact Us
  • ABFM News

© 2025 American Board of Family Medicine

Powered by HighWire