The Effects of Major Disruptions on Practice Participation in Facilitation During a Primary Care Quality Improvement Initiative =============================================================================================================================== * Jennifer R. Hemler * Samuel T. Edwards * Steele Valenzuela * Andrea Baron * Jennifer D. Hall * Cynthia K. Perry * Bijal A. Balasubramanian * Laura Damschroder * Leif I. Solberg * Benjamin F. Crabtree * Deborah J. Cohen ## Abstract *Background:* Disruptions in primary care practices, like ownership change, clinician turnover, and electronic health record system implementation, can stall quality improvement (QI) efforts. However, little is known about the relationship between these disruptions and practice participation in facilitated QI. *Methods:* We explore this relationship using data collected from EvidenceNOW in a mixed-methods convergent design. EvidenceNOW was a large-scale facilitation-based QI initiative in small and medium primary care practices. Data included practice surveys, facilitator time logs, site visit field notes, and interviews with facilitators and practices. Using multivariate regression, we examined associations between disruptions during interventions and practice participation in facilitation, measured by in-person facilitator hours in 987 practices. We analyzed qualitative data on 40 practices that described disruptions. Qualitative and quantitative teams iterated analyses based on each other's emergent findings. *Results:* Many practices (51%) reported experiencing 1 or more disruptions during the 3- to 15-month interventions. Loss of clinicians (31.6%) was most prevalent. In adjusted analyses, disruptions were not significantly associated with participation in facilitation. Qualitative data revealed that practices that continued active participation were motivated, had some QI infrastructure, and found value in working with their facilitators. Facilitators enabled practice participation by doing EHR-related work for practices, adapting work for available staff, and helping address needs beyond the explicit aims of EvidenceNOW. *Conclusions:* Disruptions are prevalent in primary care, but practices can continue participating in QI interventions, particularly when supported by a facilitator. Facilitators may benefit from additional training in approaches for helping practices attenuate the effects of disruptions and adapting strategies to help interventions work to continue building QI capacity. * Family Medicine * Health Personnel * Health Services Research * Primary Health Care * Qualitative Research * Quality Improvement * Surveys and Questionnaires * Workforce ## Background Primary care medicine in the United States has experienced significant transformations over the past 2 decades due to new federal and state policies and recommendations,1⇓⇓–4 evolving care delivery models and frameworks,5⇓⇓⇓⇓⇓⇓⇓–13 technological innovations,6,14 and revised payment structures.15⇓⇓⇓–19 These changes have increased the need for quality improvement (QI): planning, monitoring, and adjusting workflows to new evidence-based practices; using electronic health records (EHRs) to identify and resolve care gaps; and measuring performance concerning clinical guidelines, stakeholder mandates, and incentives.20⇓⇓⇓⇓–25 To stay viable in today's landscape, primary care practices need to develop the ability to adapt quickly and embrace continual change.26,27 Thus far, making rapid and sustained change has been difficult for primary care practices,28⇓⇓⇓⇓–33 particularly small independent practices lacking financial and staff resources.34⇓⇓⇓⇓–39 Health system buy-outs, new affiliations, location changes and mergers, and new EHR implementations can disrupt staff, team structures, and workflows. Clinician and staff turnover has also risen in recent years,40⇓⇓⇓–44 creating discontinuities in leadership and basic practice operations. Researchers and QI organizations recognize the need for external support to help practices implement QI within this environment.45⇓⇓–48 Practice facilitation (henceforth, facilitation) has arisen to do this.49⇓⇓⇓⇓⇓⇓⇓–57 However, facilitators and researchers alike note that practice disruptions like turnover, EHR implementation, and ownership or leadership change can present serious obstacles to practices' engaging in facilitation and QI.39,58⇓⇓⇓⇓–63 In particular, pervasive turnover44,64,65 is noted as highly disruptive for team building and retaining institutional knowledge, reducing the capacity and motivation of remaining staff to do QI.66 Few studies, though, have systematically examined the prevalence and impact of different types of disruptions on practices' participation in facilitated QI.61,67 We examine qualitative and quantitative data from EvidenceNOW, an Agency for Healthcare Research and Quality (AHRQ) national initiative to improve primary care practices' capacity for QI and cardiovascular preventive care delivery, to explore the independent and cumulative effects of disruptions on practices' abilities to participate in facilitation-based QI interventions. ## Methods ### Setting AHRQ funded 7 Cooperatives across the United States for the EvidenceNOW initiative. Each Cooperative implemented multiple support strategies during an intervention to increase practice capacity for QI and improve cardiovascular preventive care as measured through the “ABCS of heart health”:68 prescribing Aspirin when appropriate, controlling Blood pressure, managing Cholesterol, and providing Smoking cessation counseling.69 Cooperatives collectively enrolled 1721 primary care practices, each enrolling between 208 and 276 sites.70 Practices varied in ownership, but most comprised 10 or fewer clinicians (see Table 1). Cooperatives varied in their intervention designs, including use of change models, length of interventions (3 to 15 months), facilitation models, and expected number of facilitator visits;56 intervention designs are reported elsewhere,71⇓⇓⇓⇓–76 but all used facilitators to support intervention goals.77 AHRQ funded our independent national evaluation team, ESCALATES (Evaluating System Change to Advance Learning and Take Evidence to Scale), to assess lessons across Cooperatives. View this table: [Table 1.](http://www.jabfm.org/content/35/1/124/T1) Table 1. Practice Characteristics ### Data Collection and Analysis For this study, we used multiple types and sources of quantitative and qualitative data collected by the Cooperatives and the ESCALATES team in a mixed-methods convergent design. We iteratively conducted mixed-methods analysis: emergent qualitative findings informed hypotheses and variables for quantitative modeling, and quantitative findings provoked additional qualitative analyses. ### Quantitative Data Collection Cooperatives administered 2 types of surveys. The Practice Survey, answered by 1 practice leader (office manager, practice owner, or lead clinician), included questions about practice size, ownership, location, and past participation in demonstration projects. This survey also asked if the practice had experienced a “major change,” providing a list of 6 potential disruptions and a write-in response (see Figure 1). ![Figure 1.](http://www.jabfm.org/https://www.jabfm.org/content/jabfp/35/1/124/F1.medium.gif) [Figure 1.](http://www.jabfm.org/content/35/1/124/F1) Figure 1. Practice Survey Question About Disruptions. Cooperatives also administered confidential Practice Member Surveys to multiple employees within each practice. This survey included the 18-item Adaptive Reserve questionnaire, assessing leadership and teamwork qualities associated with practice adaptation and resilience.78,79 Both surveys were administered at baseline (9/2015 to 3/2017) to assess the year before the intervention and post-intervention (11/2016 to 12/2017) to assess the intervention time frame. Survey administration (article, web-based, phone), incentive type (cash, gift card), and incentive amount ($2-$75) varied across Cooperatives. Facilitators kept logs across the intervention time frame to record the hours and mode (in-person, phone, or web) they worked with and in the practice. ### Quantitative Analysis We drew the primary independent variable, occurrence of types of disruptions during the intervention, from the post-intervention Practice Survey. We operationalized participation in facilitation, our outcome variable, as logged total hours of in-person facilitator time per practice. Our thinking was that practices would divert time from facilitation participation to managing disruptions if practice operations were unduly stressed. Covariates of practice size and ownership, geographic location, participation in other demonstration projects, occurrence of disruptions before the intervention, and Adaptive Reserve were obtained from baseline Practice and Practice Member Surveys. We dichotomized practices' Adaptive Reserve scores into the top 25% (scores of 0.78 and above) versus the bottom 75%, hypothesizing that practices with higher scores would be better able to continue interventions despite disruptions. We included whether or not disruptions occurred before EvidenceNOW to control for ongoing effects of past disruptions. We used frequencies to describe practice characteristics and participation in facilitation per Cooperative (see Table 1). To explore the relationship between disruptions and participation in facilitation, we performed a series of multivariable regressions, presenting estimated marginal means in hours. To account for Cooperative differences in intervention design and length, we used a generalized estimating equation (GEE) model with a γ distribution; this model accounts for clustering by Cooperative to give accurate estimates of the number of hours practices spent in facilitation and association with the selected independent variables. For disruptions during the intervention, we examined associations between participation in facilitation with each disruption type; with the number of disruption types experienced (0, 1, 2, and 3+); and with having 1 or more types of disruptions. We collapsed “being purchased by or affiliated with a larger organization” (n = 34) and “moving to a new location” (n = 79) into 1 category representing organizational disruptions. We collapsed “implemented a new or different EHR” (n = 160) and “new billing system” (n = 120) into a category representing information system disruptions. We recoded “Other” (n = 139) responses into the above categories when applicable. We did not include remaining write-in responses because descriptions were highly variable (see Appendix Table 1). We conducted sensitivity analyses using different definitions of practice participation in facilitation to ensure the reliability of our findings (see Appendix, Table 4). Statistical software included R version 4.0.0 and Stata version 15.1. ### Qualitative Data Collection ESCALATES collected interview and observational data throughout EvidenceNOW. During interventions, we shadowed 44 facilitators at 62 practices across the 7 Cooperatives. Cooperatives selected the facilitators and practices for us to observe. We wrote field notes from these site visits and interviewed 41 facilitators about 54 practices. Post-intervention, we sampled practices that had improved in at least 1 ABCS and/or had unique characteristics. We interviewed 66 practice members and 74 facilitators about their work in 110 of these practices. Altogether, the ESCALATES team collected qualitative data on 158 practices. Interviews were audio-recorded and professionally transcribed. Qualitative data were managed in Atlas.ti 7 Windows. ### Qualitative Data Analysis A team of analysts (JRH, AB, JDH, CP) read interviews and field notes for each of the 158 practices, identifying practices that had descriptions of the disruptions specified in the Practice Survey. Because medical assistants (MAs) were integral to EvidenceNOW intervention work, we included MA loss as a disruption. This team met weekly to analyze data, reading, and discussing key passages together. We wrote practice summaries and identified patterns in how and why disruptions affected participation in facilitation. ## Results ### Practice Characteristics and Reported Disruptions Of the 1721 practices enrolled in EvidenceNOW at baseline, 987 (57.4%) had complete data from baseline and follow-up surveys and between 1 and 90 hours of facilitation participation (see Appendix Figure 1). Practices varied in size and ownership, but most were located in an urban core and had not participated in a demonstration project previously. Practices, on average, participated in 18.2 hours of facilitation (SD = 16.7). (See Table 1.) Just over half of practices that completed the surveys reported at least 1 disruption both before and during the interventions (see Table 2), with one-third of these reporting 2 or more disruptions. The most common disruptions were loss of clinician(s) or office manager/head nurse(s), both of which happened more frequently during the intervention than pre-intervention. View this table: [Table 2.](http://www.jabfm.org/content/35/1/124/T2) Table 2. Disruptive Events Reported by Practices Before and During EvidenceNOW Interventions In our interview data and field notes, practice members or facilitators described disruptions in 40 of 158 practices. More than half of these practices were described as experiencing multiple types of disruption. Loss of personnel—clinicians, office managers/head nurses, or MAs—were described more often than organizational or information system disruptions. ### Disruptions' Effects on Practice Participation in Facilitation In quantitative models, practices that reported 1 or more disruptions during their intervention did not differ significantly in participation in facilitation from practices that did not report disruptions. Furthermore, participation in facilitation did not vary significantly by type or number of disruption types reported. (See Table 3; Appendix Table 2.) Neither Adaptive Reserve nor prior participation in demonstration projects was associated with participation in facilitation (Appendix Table 3). View this table: [Table 3.](http://www.jabfm.org/content/35/1/124/T3) Table 3. Association of Disruptive Events During Intervention with Participation in Facilitation Qualitatively, we found that disruptions had differing effects on practices' abilities to participate in facilitation. Some practices decreased or stopped participation in facilitation when disruptions occurred, particularly when they had only 1 person responsible for QI and this person left the practice. However, other practices that experienced similar types or numbers of disruptions continued facilitation. Practices that sustained participation in facilitation through disruptions shared several key attributes: they exhibited high motivation to do the intervention or some degree of preexisting QI infrastructure, and they were able to normalize disruptions as part of the work environment. In addition, practices that found value in their facilitator were likely to continue participating in facilitation despite, and sometimes because of, disruptions. Facilitators' approaches to working with practices appeared to influence practices' abilities to maintain participation, as well. ### QI Motivation and/or QI Infrastructure Practices that continued participating in facilitation during disruptions had specific goals they wanted to achieve through EvidenceNOW. Some of these practices were energized by embarking on QI or felt pressure to catch up on innovations or evidence-based learnings; others had well-established QI routines. Having specific reasons for joining the intervention bolstered participation regardless of QI experience, but practices with QI experience benefited from the stability of set monthly meetings, QI teams, and QI roles. Practices with an engaged QI team, rather than a single QI contact, were less vulnerable to negative turnover effects on participation: *[T]hey're a great clinic to work with, … [T]hey've been doing a lot of practice transformation… .[T]hey already had QI team put together. They were dedicated to actually work on the things we talked about in between sessions…. At the time we were doing this, they were in the process of losing three [providers] and gaining another three…. I don't really feel like they let that affect their work in this project too much…. [T]he QI team was very dedicated.* (Facilitator interview, Cooperative 6) ### Normalizing Disruptions Some practices accepted disruptions as an inevitable part of practice operations. Practices with consistent staff turnover adjusted to working with capacity gaps. Others realized that they needed to work on QI despite disruptions to avoid penalties or lost incentives, falling behind in evidence-based practices, or patient dissatisfaction. Practices that prioritized QI goals or committed to getting work “done” learned how to work around disruptions. For example, this practice experienced clinician loss and MA turnover during the intervention: *For the satellite office, [turnover is] not anything new. For the main location, it has been something new…. We had to pull people from this location to help the other location. That's why it's been a rat race.* **Interviewer:** *Yeah. Do you think that's influenced your ability to work on [EvidenceNOW] at all?* **CMA:** *I don't think so, because it's—things that we have to get done, it just means that you have to learn to multi-task and communicate more with your co-workers to fill in the gaps.* (CMA/Health Education Specialist interview, Cooperative 1) ### Valued Facilitators Facilitators fulfilled a variety of functions for practices. Practices with long-term facilitator relationships appreciated being accountable to someone they trusted. Practices new to QI often felt beholden to facilitators for the skills, tools, information, and support they delivered. Practices that continued participation in facilitation continued receiving these benefits, particularly important to some during times of disruption. For example, 1 clinician-owner who had several staff leave appreciated that his long-term facilitator could help train the new staff: “She works with our staff, and she really gives us a lot of help. It is like we have an extra manager help us” (Clinician Owner Interview, Cooperative 3). Another practice's administrator appreciated their facilitator's persistence despite office manager and staff turnover: “[C]oming in and meeting as a group and then also coming through individually was really good…. [S]he was persistent about being here [and] making sure she made contact with… all the different people here. [H]aving [information] repeated all the time… was really helpful” (Practice Administrator interview, Cooperative 7). ### Facilitators' Approaches to Working with Practices During Disruptions Facilitators used approaches that encouraged and, in some cases, enabled practices experiencing disruptions to continue their participation in facilitation. For example, facilitators focused on helping practices improve their ABCS performance often did basic EHR work for the practice: facilitators scheduled reminders, produced data reports, called EHR vendors to map out workflows, redesigned templates, and conducted chart audits. Facilitators described doing this kind of work to enable the practice to work on higher-order practice changes: *Turnover [has been] huge…. [T]hey've had actually three different office managers throughout the intervention…. Now we have this one office manager that's sort of been with them for a while…. [But] when I try to bring up, “Hey, can you run these reports?” she looks at me like to say, “I really like working with you, but I can't take any more work”…. For now, [I'm running the reports]…. I'm willing to take a few extra steps for them…. [T]hen when I need them to do something for me, they perform in return…. [S]ometimes that is also the incentive….* (Facilitator interview, Cooperative 3) Other facilitators focused on helping practices build QI capacity rather than doing work *for* the practice; they adapted intervention work to the situation by limiting the scope of PDSAs and aligning goals to help leverage other QI projects. If practices lost personnel, facilitators focused on work those remaining could do. When teams felt overwhelmed, facilitators paused work to give practices time to rebuild capacity. Sometimes, facilitators leveraged disruptions to improve leadership-staff dynamics or streamline workflows. These facilitators viewed progress as a long-term process and adjusted accordingly. For example, this facilitator helped her practice continue participation despite losing a head nurse and MA during the intervention: *The office manager tells the facilitator that they've been doing huddles to see who is high-risk…. [B]ecause of hiring and turnover, the office manager hasn't had a chance to change the test group of patients. (This practice started by focusing on 8 hypertensive patients and planned to slowly add more). The facilitator tells her, “That's OK!” The facilitator asks, “So how are you going to reach out to these patients?” The office manager thinks for a moment and then suggests they do a mailing. The facilitator asks her if she thinks [the business office] could just do five mailings a day, 25 a week. The office manager thinks that sounds doable. They walk through the workflow….* (ESCALATES Site Visit Fiel dnotes, Cooperative 1) To retain practice engagement, sometimes facilitators helped practices work on projects outside explicit EvidenceNOW goals. For example, facilitators helped practices with incentive programs like Meaningful Use or broader issues like high emergency department (ED) use, transportation needs, food scarcity, substance use disorders, and mental health needs. Facilitators attempted to address practice priorities, sometimes by merging them with EvidenceNOW-specific goals, but often working on these needs in parallel or before their EvidenceNOW agenda. In the following example, the clinician-owner lost a clinician and much of his MA staff. The facilitator focused on priorities the clinician outlined: *We worked some on ED utilization and just doing callbacks for patients that had ED visits… some other things that he was really interested in, too, that weren't specifically related to [EvidenceNOW]… around his populations that have behavioral health substance abuse problems…. [S]ome of them have chronic conditions such as hypertension… and he didn't [know] where to refer them. We worked on that as well as kind of an aside, but really tied [that] into providing good comprehensive care for his high-risk patients, too.* (Facilitator interview, Cooperative 6) ## Discussion EvidenceNOW findings affirm that disruptions are a reality across primary care practices, particularly the high turnover of key personnel. Nevertheless, and to our surprise, quantitative analyses revealed little evidence that any particular type of disruption, or even multiple disruptions, affected practices' abilities to participate in facilitation aimed at building QI capacity to achieve cardiovascular care goals. Qualitative analyses may help explain these unexpected results. We found that practices with specific motivations to participate in EvidenceNOW and/or preexisting QI infrastructure continued participating in facilitation while experiencing disruptions. Accepting disruptions as an inevitable part of their work also seemed to moderate the disruptive impact of disruptions. In addition, facilitators encouraged and, in some cases, *enabled* practices to continue participating in facilitation by doing EHR-related work, adapting QI work to available staff, and helping them make progress toward patient care goals beyond stated aims of EvidenceNOW. In fact, disruptions may have impelled some practices to continue working with facilitators to receive these highly valued benefits. Facilitators used these approaches to engage practices not experiencing disruptions, as well;80,81 however, these approaches may have been especially important for practices experiencing high levels of disruption that needed extra support. It is also possible that these types of disruption are not as disruptive as they once were. For instance, implementing a new EHR was a paradigm shift a decade ago, but most practices are now upgrading already-existing EHRs; they may know from previous experience what to expect, how to prepare, and where to receive support.59,82 Clinician and staff loss may also not be as surprising as it was a decade ago when physician-owned practices were dominant and long tenures the norm.83,84 Turnover has increased with increased system acquisitions and mergers, but systems may better compensate for personnel turnover due to their size and resources.61 These types of disruptions are no longer surprising or unexpected in the primary care practice landscape. While practices may have acculturated to these prevalent disruptions, the COVID-19 pandemic, occurring after this research was completed, has raised new research questions about practices' abilities and the strategies needed to quickly adapt or pivot when faced with unprecedented and large-scale disruptions. Future research may seek to assess how disruptions happening at different scales or levels (eg, practice, community, region, and beyond), in different domains (eg, personnel, supply delivery), and to different degrees of expectation affect practices' abilities to improve or even maintain their care performance. This study has a few notable limitations. In the Practice Surveys, we did not capture the number of specific disruption occurrences a practice experienced, only the number of types they experienced. We also did not capture the precise timing of disruptions. Logging disruptions as they occur would enable more sophisticated analyses of how disruptions affect participation in facilitation and for how long.85 We suspect that the timing of disruptions—for example, in the beginning, when facilitators and practices are forming relationships—could affect participation in facilitation. In addition, practices experiencing extreme disruptions may have declined to enroll in EvidenceNOW altogether. Qualitatively, we performed a secondary analysis of our data. Practices included in our qualitative sample were not selected based on survey reports of disruptions, nor were interview guides designed specifically to explore disruptions. Yet, when asked about intervention implementation and participation challenges, facilitators and/or practice contacts spontaneously described disruptions in 40 of the 158 practices. Our sample may skew toward better-performing practices in EvidenceNOW, but our findings of influential practice characteristics and facilitator support are likely generalizable across practices. We call attention to a couple of measurement considerations for future research. We chose practice participation in facilitation as our dependent variable because time spent in facilitation indicates an ability to commit to and invest in QI, as time is a precious resource in primary care practices. We operationalized participation as the number of hours of facilitation because this unit of analysis could be standardized across Cooperatives as the “dose” of facilitation that a practice received. We tested several operationalizations of facilitation “dose” (see Appendix Table 4) and found that reports of disruptions were not significantly associated with any of these measures. However, as our qualitative findings show, dose does not capture the complexities of practice engagement,85⇓–87 nor does it reflect entirely the amount and content of the intervention work the practice accomplished.85 Practice motivation to participate in QI likely influences engagement and participation as well, but a standardized measure was not collected across Cooperatives. Investigating various facets of participation in tandem with dose would help achieve a fuller understanding of the mechanisms leading to sustained practice improvement. We also relied on hours of in-person facilitation, positing that in-person visits require a deeper commitment to the intervention than phone or virtual facilitation; however, this assumption may need to be reevaluated in post-COVID-19 research, as practices continue to adopt and adapt to virtual health care innovations. It is important to note that our analysis relied on a list of specified disruptions. We suggest more precise and expanded specifications for future studies. For instance, “Lost 1 or more office managers or head nurses” was included as one type of disruption, although the loss of these roles may be experienced quite differently by practices, and each loss should be counted separately to determine disruptive load. Write-in responses and qualitative data suggest that other potential disruptions that should be considered for inclusion in survey response categories include loss of MAs,65,88 system-level leadership turnover,89 practice expansions, and consolidations.83,84 A separate and important consideration is turnover in the facilitator role. Despite these limitations, it is encouraging that practices continued working with facilitators during disruptions, as facilitation is a potential mechanism of practice change.90 External facilitators may be particularly poised to navigate the challenges and varying conditions that shape practice QI efforts, guiding practices toward holistic practice change,63,91,92 as they are not part of these conditions. Specific training in harnessing disruptions to help practices make necessary but difficult changes may help facilitators build greater practice capacity and get closer to achieving performance improvement goals. However, important questions remain about what facilitator approaches and types of participation in facilitation result in measurable performance improvement. Our study takes one step in that direction by showing that disruptions need not disrupt practice QI time, particularly when practices are supported by skilled facilitators who can help them design their QI efforts to fit their current conditions. ## Conclusion Disruptions are prevalent within primary care practices in the U.S. Practices can continue facilitation-based QI interventions during disruptions. Disruptions may motivate practices to work with a facilitator, and external facilitators can support practices that may otherwise experience deleterious effects of disruptions. Specific training that addresses how to modify intervention work based on the capacity and knowledge gaps that disruptions can produce will aid facilitators in helping practices make sustained improvements. Future studies should continue to investigate the impacts of different disruptions on different types of interventions and how facilitation can help strengthen practice QI capacity within these conditions. ## Acknowledgments We are grateful for the advice from Leah Gordon, David Ezekiel, Tom Kottke, Miguel Marino, Rachel Springer, and the EvidenceNOW Cooperatives. ## Appendix View this table: [Appendix Table 1.](http://www.jabfm.org/content/35/1/124/T4) Appendix Table 1. Descriptions of “Other” Responses to Post-Intervention Practice Survey Question About Disruptions ![Appendix Figure 1.](http://www.jabfm.org/https://www.jabfm.org/content/jabfp/35/1/124/F2.medium.gif) [Appendix Figure 1.](http://www.jabfm.org/content/35/1/124/F2) Appendix Figure 1. Variation in facilitation hours by practice ### Methods for Appendix Tables 2-4 We reported rates (exponentiated log-coefficients) and 95% asymptotic confidence intervals (CI). Postestimation of the model yielded estimated marginal means in hours, stratified by 1 or more disruptions versus no disruptions and difference in hours. 95% CIs were reported for all 3 outcomes (see Appendix Figure 1). Equal weight was assumed to calculate the estimated marginal means. To account for missing data, we implemented multiple imputation by chained equations, which determined the stability of model estimates (See Appendix Table 2). View this table: [Appendix Table 2.](http://www.jabfm.org/content/35/1/124/T5) Appendix Table 2. Estimated Marginal Hours and Difference in Hours (95% CI) of Participation in Practice Facilitation by Occurrence of Disruption* View this table: [Appendix Table 3.](http://www.jabfm.org/content/35/1/124/T6) Appendix Table 3. Association of Disruptions During Intervention with Participation in Practice Facilitation: Complete Model, with Imputed and Non-Imputed Results.* View this table: [Appendix Table 4.](http://www.jabfm.org/content/35/1/124/T7) Appendix Table 4. Alternative Definitions of Participation in Practice Facilitation: Summary and Association with Any Disruption ## Notes * This article was externally peer reviewed. * *Funding:* This work is supported by Agency for Healthcare Research and Quality grant #R01HS023940. * *Conflict of Interests:* The authors report no conflicts of interest in producing and submitting this manuscript for publication. Parts of this early manuscript were presented at the North American Primary Care Research Group, 48th Annual Meeting, November 20, 2020. * To see this article online, please go to: [http://jabfm.org/content/35/1/124.full](http://jabfm.org/content/35/1/124.full). * Received for publication May 17, 2021. * Revision received August 16, 2021. * Revision received September 16, 2021. * Accepted for publication September 27, 2021. ## References 1. 1.Institute of Medicine (US) Committee on Quality of Health Care in America. Crossing the Quality Chasm. Washington, DC: National Academies Press (US); 2001. 2. 2.Berwick DM. A user's manual for the IOM's ‘Quality Chasm’ report. Health Aff (Millwood) 2002;21:80–90. [Abstract/FREE Full Text](http://www.jabfm.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6OToiaGVhbHRoYWZmIjtzOjU6InJlc2lkIjtzOjc6IjIxLzMvODAiO3M6NDoiYXRvbSI7czoyMDoiL2phYmZwLzM1LzEvMTI0LmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 3. 3.Abrams M, Nuzum R, Mika S, Lawlor G. Realizing health reform's potential. New York: The Commonwealth Fund; 2011. 4. 4.Burke T. The health information technology provisions in the American Recovery and Reinvestment Act of 2009: implications for public health policy and practice. Public Health Rep 2010;125:141–5. [CrossRef](http://www.jabfm.org/lookup/external-ref?access_num=10.1177/003335491012500119&link_type=DOI) [PubMed](http://www.jabfm.org/lookup/external-ref?access_num=20402207&link_type=MED&atom=%2Fjabfp%2F35%2F1%2F124.atom) 5. 5.Wagner EH, Austin BT, Davis C, Hindmarsh M, Schaefer J, Bonomi A. Improving chronic illness care: translating evidence into action. Health Aff (Millwood) 2001;20:64–78. [Abstract/FREE Full Text](http://www.jabfm.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6OToiaGVhbHRoYWZmIjtzOjU6InJlc2lkIjtzOjc6IjIwLzYvNjQiO3M6NDoiYXRvbSI7czoyMDoiL2phYmZwLzM1LzEvMTI0LmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 6. 6.Bodenheimer T. Innovations in primary care in the United States (Primary Care in the United States). BMJ 2003;326:796–800. [FREE Full Text](http://www.jabfm.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiRlVMTCI7czoxMToiam91cm5hbENvZGUiO3M6MzoiYm1qIjtzOjU6InJlc2lkIjtzOjEyOiIzMjYvNzM5My83OTYiO3M6NDoiYXRvbSI7czoyMDoiL2phYmZwLzM1LzEvMTI0LmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 7. 7.Solberg LI. Improving medical practice: a conceptual framework. Ann Fam Med 2007;5:251–6. [Abstract/FREE Full Text](http://www.jabfm.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6ODoiYW5uYWxzZm0iO3M6NToicmVzaWQiO3M6NzoiNS8zLzI1MSI7czo0OiJhdG9tIjtzOjIwOiIvamFiZnAvMzUvMS8xMjQuYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 8. 8.Fisher ES. Building a medical neighborhood for the medical home. N Engl J Med 2008;359:1202–5. [CrossRef](http://www.jabfm.org/lookup/external-ref?access_num=10.1056/NEJMp0806233&link_type=DOI) [PubMed](http://www.jabfm.org/lookup/external-ref?access_num=18799556&link_type=MED&atom=%2Fjabfp%2F35%2F1%2F124.atom) [Web of Science](http://www.jabfm.org/lookup/external-ref?access_num=000259259900003&link_type=ISI) 9. 9.Bodenheimer T, Pham HH. Primary care: current problems and proposed solutions. Health Aff (Millwood) 2010;29:799–805. [Abstract/FREE Full Text](http://www.jabfm.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6OToiaGVhbHRoYWZmIjtzOjU6InJlc2lkIjtzOjg6IjI5LzUvNzk5IjtzOjQ6ImF0b20iO3M6MjA6Ii9qYWJmcC8zNS8xLzEyNC5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 10. 10.Nutting PA, Crabtree BF, Miller WL, Stange KC, Stewart E, Jaén C. Transforming physician practices to patient-centered medical homes: lessons from the national demonstration project. Health Aff (Millwood) 2011;30:439–45. [Abstract/FREE Full Text](http://www.jabfm.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6OToiaGVhbHRoYWZmIjtzOjU6InJlc2lkIjtzOjg6IjMwLzMvNDM5IjtzOjQ6ImF0b20iO3M6MjA6Ii9qYWJmcC8zNS8xLzEyNC5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 11. 11.Sidorov JE. The patient-centered medical home for chronic illness: is it ready for prime time? Health Aff (Millwood) 2008;27:1231–4. [Abstract/FREE Full Text](http://www.jabfm.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6OToiaGVhbHRoYWZmIjtzOjU6InJlc2lkIjtzOjk6IjI3LzUvMTIzMSI7czo0OiJhdG9tIjtzOjIwOiIvamFiZnAvMzUvMS8xMjQuYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 12. 12.Davy C, Bleasel J, Liu H, Tchan M, Ponniah S, Brown A. Effectiveness of chronic care models: opportunities for improving healthcare practice and health outcomes: a systematic review. BMC Health Serv Res 2015;15:1–11. [CrossRef](http://www.jabfm.org/lookup/external-ref?access_num=10.1186/s12913-014-0652-8&link_type=DOI) [PubMed](http://www.jabfm.org/lookup/external-ref?access_num=25603697&link_type=MED&atom=%2Fjabfp%2F35%2F1%2F124.atom) 13. 13.Reynolds R, Dennis S, Hasan I, et al. A systematic review of chronic disease management interventions in primary care. BMC Fam Pract 2018;19:1–13. [CrossRef](http://www.jabfm.org/lookup/external-ref?access_num=10.1186/s12875-018-0864-9&link_type=DOI) [PubMed](http://www.jabfm.org/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fjabfp%2F35%2F1%2F124.atom) 14. 14.Jensen RE, Rothrock NE, DeWitt EM, et al. The role of technical advances in the adoption and integration of patient-reported outcomes in clinical care. Med Care 2015;53:153–9. [CrossRef](http://www.jabfm.org/lookup/external-ref?access_num=10.1097/MLR.0000000000000289&link_type=DOI) [PubMed](http://www.jabfm.org/lookup/external-ref?access_num=25588135&link_type=MED&atom=%2Fjabfp%2F35%2F1%2F124.atom) 15. 15.Colla CH, Fisher ES. Beyond PCMHs and accountable care organizations: payment reform that encourages customized care. In: Springer; 2014. 16. 16.Centers for Medicare & Medicaid Services (CMS). HHS. Medicare Program; Merit-Based Incentive Payment System (MIPS) and Alternative Payment Model (APM) incentive under the physician fee schedule, and criteria for physician-focused payment models. Final rule with comment period 2016;81:77008. 17. 17.Kissam SM, Beil H, Cousart C, Greenwald LM, Lloyd JT. States encouraging value‐based payment: lessons from CMS's State Innovation Models Initiative. Milbank Q 2019;97:506–42. 18. 18.Casalino LP. The Medicare access and CHIP Reauthorization Act and the corporate transformation of American medicine. Health Aff (Millwood) 2017;36:865–9. [Abstract/FREE Full Text](http://www.jabfm.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6OToiaGVhbHRoYWZmIjtzOjU6InJlc2lkIjtzOjg6IjM2LzUvODY1IjtzOjQ6ImF0b20iO3M6MjA6Ii9qYWJmcC8zNS8xLzEyNC5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 19. 19.Rosenthal MB, Dudley RA. Pay-for-performance: will the latest payment trend improve care? JAMA 2007;297:740–4. [CrossRef](http://www.jabfm.org/lookup/external-ref?access_num=10.1001/jama.297.7.740&link_type=DOI) [PubMed](http://www.jabfm.org/lookup/external-ref?access_num=17312294&link_type=MED&atom=%2Fjabfp%2F35%2F1%2F124.atom) [Web of Science](http://www.jabfm.org/lookup/external-ref?access_num=000244291100027&link_type=ISI) 20. 20.Shortell SM, Waters TM, Clarke KW, Budetti PP. Physicians as double agents: maintaining trust in an era of multiple accountabilities. JAMA 1998;280:1102–8. [CrossRef](http://www.jabfm.org/lookup/external-ref?access_num=10.1001/jama.280.12.1102&link_type=DOI) [PubMed](http://www.jabfm.org/lookup/external-ref?access_num=9757863&link_type=MED&atom=%2Fjabfp%2F35%2F1%2F124.atom) [Web of Science](http://www.jabfm.org/lookup/external-ref?access_num=000076002400044&link_type=ISI) 21. 21.Grimshaw J, Eccles M, Thomas R, et al. Toward evidence-based quality improvement. J Gen Intern Med 2006;21:S14–S20.S14. [CrossRef](http://www.jabfm.org/lookup/external-ref?access_num=10.1111/j.1525–1497.2006.00357.x&link_type=DOI) [PubMed](http://www.jabfm.org/lookup/external-ref?access_num=16637955&link_type=MED&atom=%2Fjabfp%2F35%2F1%2F124.atom) 22. 22.Weisz G, Cambrosio A, Keating P, Knaapen L, Schlich T, Tournay VJ. The emergence of clinical practice guidelines. Milbank Q 2007;85:691–727. [CrossRef](http://www.jabfm.org/lookup/external-ref?access_num=10.1111/j.1468-0009.2007.00505.x&link_type=DOI) [PubMed](http://www.jabfm.org/lookup/external-ref?access_num=18070334&link_type=MED&atom=%2Fjabfp%2F35%2F1%2F124.atom) [Web of Science](http://www.jabfm.org/lookup/external-ref?access_num=000251386700005&link_type=ISI) 23. 23.Shojania KG, Grimshaw JM. Evidence-based quality improvement: the state of the science. Health Aff (Millwood) 2005;24:138–50. [Abstract/FREE Full Text](http://www.jabfm.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6OToiaGVhbHRoYWZmIjtzOjU6InJlc2lkIjtzOjg6IjI0LzEvMTM4IjtzOjQ6ImF0b20iO3M6MjA6Ii9qYWJmcC8zNS8xLzEyNC5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 24. 24.Tricoci P, Allen JM, Kramer JM, Califf RM, Smith SC. Scientific evidence underlying the ACC/AHA clinical practice guidelines. JAMA 2009;301:831–41. [CrossRef](http://www.jabfm.org/lookup/external-ref?access_num=10.1001/jama.2009.205&link_type=DOI) [PubMed](http://www.jabfm.org/lookup/external-ref?access_num=19244190&link_type=MED&atom=%2Fjabfp%2F35%2F1%2F124.atom) [Web of Science](http://www.jabfm.org/lookup/external-ref?access_num=000263609900024&link_type=ISI) 25. 25.Reddy S, Wakerman J, Westhorp G, Herring S. Evaluating impact of clinical guidelines using a realist evaluation framework. J Eval Clin Pract 2015;21:1114–20. [CrossRef](http://www.jabfm.org/lookup/external-ref?access_num=10.1111/jep.12482&link_type=DOI) [PubMed](http://www.jabfm.org/lookup/external-ref?access_num=26640246&link_type=MED&atom=%2Fjabfp%2F35%2F1%2F124.atom) 26. 26.Stroebel CK, McDaniel RR Jr., Crabtree BF, Miller WL, Nutting PA, Stange KC. How complexity science can inform a reflective process for improvement in primary care practices. Jt Comm J Qual Patient Saf 2005;31:438–46. [PubMed](http://www.jabfm.org/lookup/external-ref?access_num=16156191&link_type=MED&atom=%2Fjabfp%2F35%2F1%2F124.atom) 27. 27.Goldberg DG, Soylu TG, Kitsantas P, Grady VM, Elward K, Nichols LM. Burnout among primary care providers and staff: evaluating the association with practice adaptive reserve and individual behaviors. J Gen Intern Med 2021;36:1222–8. 28. 28.Cohen D, McDaniel RR, Crabtree BF, et al. A practice change model for quality improvement in primary care practice. J Healthc Manag 2004;49:155. [PubMed](http://www.jabfm.org/lookup/external-ref?access_num=15190858&link_type=MED&atom=%2Fjabfp%2F35%2F1%2F124.atom) [Web of Science](http://www.jabfm.org/lookup/external-ref?access_num=000221496600005&link_type=ISI) 29. 29.Gupta DM, Boland RJ, Aron DC. The physician's experience of changing clinical practice: a struggle to unlearn. Implement Sci 2017;12:1–11. [CrossRef](http://www.jabfm.org/lookup/external-ref?access_num=10.1186/s13012-017-0641-5&link_type=DOI) [PubMed](http://www.jabfm.org/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fjabfp%2F35%2F1%2F124.atom) 30. 30.Grumbach K, Knox M, Huang B, Hammer H, Kivlahan C, Willard-Grace R. A longitudinal study of trends in burnout during primary care transformation. Ann Fam Med 2019;17:S9–S16. [Abstract/FREE Full Text](http://www.jabfm.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6ODoiYW5uYWxzZm0iO3M6NToicmVzaWQiO3M6MTM6IjE3L1N1cHBsXzEvUzkiO3M6NDoiYXRvbSI7czoyMDoiL2phYmZwLzM1LzEvMTI0LmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 31. 31.Willard-Grace R, Knox M, Huang B, Hammer H, Kivlahan C, Grumbach K. Primary care clinician burnout and engagement association with clinical quality and patient experience. J Am Board Fam Med 2021;34:542–52. [Abstract/FREE Full Text](http://www.jabfm.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NToiamFiZnAiO3M6NToicmVzaWQiO3M6ODoiMzQvMy81NDIiO3M6NDoiYXRvbSI7czoyMDoiL2phYmZwLzM1LzEvMTI0LmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 32. 32.Busari JO, Onitilo AA. Fact or Fable: The Truth about Physician Engagement and Burnout. In: Marshfield Clinic; 2020. 33. 33.Crabtree BF, Nutting PA, Miller WL, et al. Primary care practice transformation is hard work: insights from a 15-year developmental program of research. Medical Care 2011;49:S28–S35. [CrossRef](http://www.jabfm.org/lookup/external-ref?access_num=10.1097/MLR.0b013e3181cad65c&link_type=DOI) [PubMed](http://www.jabfm.org/lookup/external-ref?access_num=20856145&link_type=MED&atom=%2Fjabfp%2F35%2F1%2F124.atom) [Web of Science](http://www.jabfm.org/lookup/external-ref?access_num=000208623700005&link_type=ISI) 34. 34.Wolfson D, Bernabeo E, Leas B, Sofaer S, Pawlson G, Pillittere D. Quality improvement in small office settings: an examination of successful practices. BMC Fam Pract 2009;10:14. [CrossRef](http://www.jabfm.org/lookup/external-ref?access_num=10.1186/1471-2296-10-14&link_type=DOI) [PubMed](http://www.jabfm.org/lookup/external-ref?access_num=19203386&link_type=MED&atom=%2Fjabfp%2F35%2F1%2F124.atom) 35. 35.Meyers DS, Clancy CM. Primary care: too important to fail. Ann Intern Med 2009;150:272–3. [CrossRef](http://www.jabfm.org/lookup/external-ref?access_num=10.7326/0003-4819-150-4-200902170-00009&link_type=DOI) [PubMed](http://www.jabfm.org/lookup/external-ref?access_num=19221380&link_type=MED&atom=%2Fjabfp%2F35%2F1%2F124.atom) [Web of Science](http://www.jabfm.org/lookup/external-ref?access_num=000263562500007&link_type=ISI) 36. 36.Rittenhouse DR, Casalino LP, Shortell SM, et al. Small and medium-size physician practices use few patient-centered medical home processes. Health Aff (Millwood) 2011;30:1575–84. [Abstract/FREE Full Text](http://www.jabfm.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6OToiaGVhbHRoYWZmIjtzOjU6InJlc2lkIjtzOjk6IjMwLzgvMTU3NSI7czo0OiJhdG9tIjtzOjIwOiIvamFiZnAvMzUvMS8xMjQuYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 37. 37.Nutting PA, Crabtree BF, McDaniel RR. Small primary care practices face four hurdles—including a physician-centric mind-set—in becoming medical homes. Health Aff (Millwood) 2012;31:2417–22. [Abstract/FREE Full Text](http://www.jabfm.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6OToiaGVhbHRoYWZmIjtzOjU6InJlc2lkIjtzOjEwOiIzMS8xMS8yNDE3IjtzOjQ6ImF0b20iO3M6MjA6Ii9qYWJmcC8zNS8xLzEyNC5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 38. 38.Casalino LP. Technical assistance for primary care practice transformation: free help to perform unpaid labor? Ann Fam Med 2018;16:S12–S15. [FREE Full Text](http://www.jabfm.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiRlVMTCI7czoxMToiam91cm5hbENvZGUiO3M6ODoiYW5uYWxzZm0iO3M6NToicmVzaWQiO3M6MTQ6IjE2L1N1cHBsXzEvUzEyIjtzOjQ6ImF0b20iO3M6MjA6Ii9qYWJmcC8zNS8xLzEyNC5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 39. 39.Noel PH, Romero RL, Robertson M, Parchman ML. Key activities used by community based primary care practices to improve the quality of diabetes care in response to practice facilitation. Qual Prim Care 2014;22:211–9. 40. 40.Dyrbye LN, Shanafelt TD. Physician burnout: a potential threat to successful health care reform. JAMA 2011;305:2009–10. [CrossRef](http://www.jabfm.org/lookup/external-ref?access_num=10.1001/jama.2011.652&link_type=DOI) [PubMed](http://www.jabfm.org/lookup/external-ref?access_num=21586718&link_type=MED&atom=%2Fjabfp%2F35%2F1%2F124.atom) [Web of Science](http://www.jabfm.org/lookup/external-ref?access_num=000290665500027&link_type=ISI) 41. 41.Shanafelt TD, Boone S, Tan L, et al. Burnout and satisfaction with work-life balance among US physicians relative to the general US population. Arch Intern Med 2012;172:1377–85. [CrossRef](http://www.jabfm.org/lookup/external-ref?access_num=10.1001/archinternmed.2012.3199&link_type=DOI) [PubMed](http://www.jabfm.org/lookup/external-ref?access_num=22911330&link_type=MED&atom=%2Fjabfp%2F35%2F1%2F124.atom) [Web of Science](http://www.jabfm.org/lookup/external-ref?access_num=000309540500003&link_type=ISI) 42. 42.Shanafelt TD, Hasan O, Dyrbye LN, et al. Changes in burnout and satisfaction with work-life balance in physicians and the general US working population between 2011 and 2014. Mayo Clin Proc 2015;90:1600–13. [CrossRef](http://www.jabfm.org/lookup/external-ref?access_num=10.1016/j.mayocp.2015.08.023&link_type=DOI) [PubMed](http://www.jabfm.org/lookup/external-ref?access_num=26653297&link_type=MED&atom=%2Fjabfp%2F35%2F1%2F124.atom) 43. 43.Edwards ST, Marino M, Balasubramanian BA, et al. Burnout among physicians, advanced practice clinicians and staff in smaller primary care practices. J Gen Intern Med 2018;33:2138–46. [CrossRef](http://www.jabfm.org/lookup/external-ref?access_num=10.1007/s11606-018-4679-0&link_type=DOI) 44. 44.Willard-Grace R, Knox M, Huang B, Hammer H, Kivlahan C, Grumbach K. Burnout and health care workforce turnover. Ann Fam Med 2019;17:36–41. [Abstract/FREE Full Text](http://www.jabfm.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6ODoiYW5uYWxzZm0iO3M6NToicmVzaWQiO3M6NzoiMTcvMS8zNiI7czo0OiJhdG9tIjtzOjIwOiIvamFiZnAvMzUvMS8xMjQuYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 45. 45.Regional Extension Centers (RECs). Department of Health and Human Services. Available at: [https://www.healthit.gov/providersprofessionals/rec-history](https://www.healthit.gov/providersprofessionals/rec-history). Updated November 7, 2018. Accessed August 3, 2020. 46. 46.Quality Improvement Organizations Centers for Medicare and Medicaid Services. Available at: [https://www.cms.gov/Medicare/Quality-Initiatives-Patient-Assessment-Instruments/QualityImprovementOrgs/index.html?redirect=/qualityimprovementorgs/](https://www.cms.gov/Medicare/Quality-Initiatives-Patient-Assessment-Instruments/QualityImprovementOrgs/index.html?redirect=/qualityimprovementorgs/). Updated February 11, 2020. Accessed August 3, 2020. 47. 47.Mold JW, Peterson KA. Primary care practice-based research networks: working at the interface between research and quality improvement. Ann Fam Med 2005;3:S12–S20. [Abstract/FREE Full Text](http://www.jabfm.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6ODoiYW5uYWxzZm0iO3M6NToicmVzaWQiO3M6MTM6IjMvc3VwcGxfMS9zMTIiO3M6NDoiYXRvbSI7czoyMDoiL2phYmZwLzM1LzEvMTI0LmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 48. 48.Quality Improvement in Primary Care. Agency for Healthcare Research and Quality. Available at: [https://www.ahrq.gov/research/findings/factsheets/quality/qipc/index.html](https://www.ahrq.gov/research/findings/factsheets/quality/qipc/index.html). Updated April 2020. 49. 49.Practice Facilitation Agency for Healthcare Research and Quality. Patient Centered Medical Home Resource Center Web site. Available at: [https://pcmh.ahrq.gov/page/practice-facilitation](https://pcmh.ahrq.gov/page/practice-facilitation). Accessed August 8, 2020. 50. 50.Module 4. Approaches to Quality Improvement. Agency for Healthcare Research and Quality. Available at: [https://www.ahrq.gov/ncepcr/tools/pf-handbook/mod4.html](https://www.ahrq.gov/ncepcr/tools/pf-handbook/mod4.html). Updated May 2013. Accessed August 3, 2020. 51. 51.IHI Timeline. Institute for Healthcare Improvement. Available at: [http://www.ihi.org/about/Documents/IHI\_Timeline\_2018.pdf](http://www.ihi.org/about/Documents/IHI_Timeline_2018.pdf). Updated 2020. Accessed August 3, 2020. 52. 52.Baskerville NB, Liddy C, Hogg W. Systematic review and meta-analysis of practice facilitation within primary care settings. Ann Fam Med 2012;10:63–74. [Abstract/FREE Full Text](http://www.jabfm.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6ODoiYW5uYWxzZm0iO3M6NToicmVzaWQiO3M6NzoiMTAvMS82MyI7czo0OiJhdG9tIjtzOjIwOiIvamFiZnAvMzUvMS8xMjQuYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 53. 53.Grumbach K, Bainbridge E, Bodenheimer T. Facilitating improvement in primary care: the promise of practice coaching. Issue Brief (Commonw Fund) 2012;15:1–14. [PubMed](http://www.jabfm.org/lookup/external-ref?access_num=22712103&link_type=MED&atom=%2Fjabfp%2F35%2F1%2F124.atom) 54. 54.Knox L, Taylor EF, Geonnotti K, et al. Developing and running a primary care practice facilitation program: a how-to guide. Mathematica Policy Research; 2011. 55. 55.Phillips RL, Cohen DJ, Kaufman A, Dickinson WP, Cykert S. Facilitating Practice Transformation in Frontline Health Care. In: Annals Family Med; 2019. 56. 56.Sweeney SM, Hemler JR, Baron AN, et al. Dedicated workforce required to support large-scale practice improvement. J Am Board Fam Med 2020;33:230–9. [Abstract/FREE Full Text](http://www.jabfm.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NToiamFiZnAiO3M6NToicmVzaWQiO3M6ODoiMzMvMi8yMzAiO3M6NDoiYXRvbSI7czoyMDoiL2phYmZwLzM1LzEvMTI0LmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 57. 57.Wang A, Pollack T, Kadziel LA, et al. Impact of practice facilitation in primary care on chronic disease care processes and outcomes: a systematic review. J Gen Intern Med 2018;33:1968–77. 58. 58.Howard J, Shaw EK, Clark E, Crabtree BF. Up close and (inter)personal: insights from a primary care practice's efforts to improve office relationships over time, 2003–2009. Qual Manag Health Care 2011;20:49–61. [PubMed](http://www.jabfm.org/lookup/external-ref?access_num=21192207&link_type=MED&atom=%2Fjabfp%2F35%2F1%2F124.atom) 59. 59.Goetz DG, Kuzel AJ, Feng LB, DeShazo JP, Love LE. EHRs in primary care practices: benefits, challenges, and successful strategies. Am J Managed Care 2012;18:e48-54–e54. 60. 60.Kadu MK, Stolee P. Facilitators and barriers of implementing the chronic care model in primary care: a systematic review. BMC Fam Pract 2015;16:12. [PubMed](http://www.jabfm.org/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fjabfp%2F35%2F1%2F124.atom) 61. 61.Mold JW, Walsh M, Chou AF, Homco JB. The alarming rate of major disruptive events in primary care practices in Oklahoma. Ann Fam Med 2018;16:S52–S57. [Abstract/FREE Full Text](http://www.jabfm.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6ODoiYW5uYWxzZm0iO3M6NToicmVzaWQiO3M6MTQ6IjE2L1N1cHBsXzEvUzUyIjtzOjQ6ImF0b20iO3M6MjA6Ii9qYWJmcC8zNS8xLzEyNC5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 62. 62.Olmos-Ochoa TT, Ganz DA, Barnard JM, Penney LS, Chawla N. Sustaining effective quality improvement: building capacity for resilience in the practice facilitator workforce. BMJ Qual Saf 2019;28:1016–20. [FREE Full Text](http://www.jabfm.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiRlVMTCI7czoxMToiam91cm5hbENvZGUiO3M6MzoicWhjIjtzOjU6InJlc2lkIjtzOjEwOiIyOC8xMi8xMDE2IjtzOjQ6ImF0b20iO3M6MjA6Ii9qYWJmcC8zNS8xLzEyNC5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 63. 63.Russell G, Lane R, Parker S, Preventive Evidence into Practice (PEP) Partnership Group, et al. Preventive evidence into practice: what factors matter in a facilitation intervention to prevent vascular disease in family practice? BMC Fam Pract 2019;20:113. 64. 64.Ruhe M, Gotler RS, Goodwin MA, Stange KC. Physician and staff turnover in community primary care practice. J Ambul Care Manage 2004;27:242–8. [CrossRef](http://www.jabfm.org/lookup/external-ref?access_num=10.1097/00004479-200407000-00008&link_type=DOI) [PubMed](http://www.jabfm.org/lookup/external-ref?access_num=15287214&link_type=MED&atom=%2Fjabfp%2F35%2F1%2F124.atom) 65. 65.Friedman JL, Neutze D. The financial cost of medical assistant turnover in an academic family medicine center. J Am Board Fam Med 2020;33:426–30. [Abstract/FREE Full Text](http://www.jabfm.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NToiamFiZnAiO3M6NToicmVzaWQiO3M6ODoiMzMvMy80MjYiO3M6NDoiYXRvbSI7czoyMDoiL2phYmZwLzM1LzEvMTI0LmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 66. 66.Baron AN, Hemler JR, Sweeney SM, et al. Effects of practice turnover on primary care quality improvement implementation. Am J Med Qual 2020;35:16–22. 67. 67.Parchman ML, Noel PH, Culler SD, et al. A randomized trial of practice facilitation to improve the delivery of chronic illness care in primary care: initial and sustained effects. Implement Sci 2013;8. 68. 68.Division for Heart Disease and Stroke Prevention. Million Hearts(R) Center for Disease Control and Prevention. Available at: [https://millionhearts.hhs.gov/data-reports/factsheets/ABCS.html](https://millionhearts.hhs.gov/data-reports/factsheets/ABCS.html). Updated July 13, 2020. Accessed October 4, 2020. 69. 69.EvidenceNOW: Evaluation Measures. Agency for Healthcare Research and Quality. Available at: [https://www.ahrq.gov/evidencenow/research-results/research/methods/measures.html](https://www.ahrq.gov/evidencenow/research-results/research/methods/measures.html). Updated August 2018. Accessed August 9, 2020. 70. 70.Cooperatives. Available at: [https://www.ahrq.gov/evidencenow/projects/heart-health/about/index.html](https://www.ahrq.gov/evidencenow/projects/heart-health/about/index.html). Updated May 2021. Accessed August 9, 2020. 71. 71.About EvidenceNOW: Background and Stories from the Field. Agency for Healthcare Research and Quality. Available at: [https://www.ahrq.gov/evidencenow/about/index.html](https://www.ahrq.gov/evidencenow/about/index.html). Updated May 2019. Accessed August 8, 2020. 72. 72.Ciolino JD, Jackson KL, Liss DT, et al. Design of healthy hearts in the heartland (H3): a practice-randomized, comparative effectiveness study. Contemp Clin Trials 2018;71:47–54. 73. 73.Shelley DR, Ogedegbe G, Anane S, et al. Testing the use of practice facilitation in a cluster randomized stepped-wedge design trial to improve adherence to cardiovascular disease prevention guidelines: HealthyHearts NYC. Implement Sci 2015;11:88. 74. 74.Weiner BJ, Pignone MP, DuBard CA, et al. Advancing heart health in North Carolina primary care: the Heart Health NOW study protocol. Implement Sci 2015;10:160. 75. 75.Parchman ML, Fagnan LJ, Dorr DA, et al. Study protocol for “Healthy Hearts Northwest”: a 2×2 randomized factorial trial to build quality improvement capacity in primary care. Implement Sci 2016;11:138. 76. 76.Chou AF, Homco JB, Nagykaldi Z, et al. Disseminating, implementing, and evaluating patient-centered outcomes to improve cardiovascular care using a stepped-wedge design: healthy hearts for Oklahoma. BMC Health Serv Res 2018;18:404. 77. 77.Perry CK, Damschroder LJ, Hemler JR, Woodson TT, Ono SS, Cohen DJ. Specifying and comparing implementation strategies across seven large implementation interventions: a practical application of theory. Implement Sci 2019;14:32. [PubMed](http://www.jabfm.org/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fjabfp%2F35%2F1%2F124.atom) 78. 78.Nutting PA, Crabtree BF, Miller WL, Stewart EE, Stange KC, Jaén CR. Journey to the patient-centered medical home: a qualitative analysis of the experiences of practices in the National Demonstration Project. Ann Fam Med 2010;8 Suppl 1:S45–56; S92. [Abstract/FREE Full Text](http://www.jabfm.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6ODoiYW5uYWxzZm0iO3M6NToicmVzaWQiO3M6MTM6IjgvU3VwcGxfMS9TNDUiO3M6NDoiYXRvbSI7czoyMDoiL2phYmZwLzM1LzEvMTI0LmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 79. 79.Miller WL, Crabtree BF, Nutting PA, Stange KC, Jaen CR. Primary care practice development: a relationship-centered approach. Ann Fam Med 2010;8 Suppl 1:S68–79; S92. [Abstract/FREE Full Text](http://www.jabfm.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6ODoiYW5uYWxzZm0iO3M6NToicmVzaWQiO3M6MTM6IjgvU3VwcGxfMS9TNjgiO3M6NDoiYXRvbSI7czoyMDoiL2phYmZwLzM1LzEvMTI0LmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 80. 80.Nguyen AM, Cuthel A, Padgett DK, et al. How practice facilitation strategies differ by practice context. J Gen Intern Med 2020;35:824–31. 81. 81.Hemler JR, Hall JD, Cholan RA, et al. Practice facilitator strategies for addressing electronic health record data challenges for quality improvement: EvidenceNOW. J Am Board Fam Med 2018;31:398–409. [Abstract/FREE Full Text](http://www.jabfm.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NToiamFiZnAiO3M6NToicmVzaWQiO3M6ODoiMzEvMy8zOTgiO3M6NDoiYXRvbSI7czoyMDoiL2phYmZwLzM1LzEvMTI0LmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 82. 82.Ryan MS, Shih SC, Winther CH, Wang JJ. Does it get easier to use an EHR? Report from an urban regional extension center. J Gen Intern Med 2014;29:1341–8. [CrossRef](http://www.jabfm.org/lookup/external-ref?access_num=10.1007/s11606-014-2891-0&link_type=DOI) [PubMed](http://www.jabfm.org/lookup/external-ref?access_num=24841560&link_type=MED&atom=%2Fjabfp%2F35%2F1%2F124.atom) 83. 83.Welch WP, Cuellar AE, Stearns SC, Bindman AB. Proportion of physicians in large group practices continued to grow in 2009–11. Health Aff (Millwood) 2013;32:1659–66. [Abstract/FREE Full Text](http://www.jabfm.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6OToiaGVhbHRoYWZmIjtzOjU6InJlc2lkIjtzOjk6IjMyLzkvMTY1OSI7czo0OiJhdG9tIjtzOjIwOiIvamFiZnAvMzUvMS8xMjQuYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 84. 84.Muhlestein DB, Smith NJ. Physician consolidation: rapid movement from small to large group practices, 2013–15. Health Aff (Millwood) 2016;35:1638–42. [Abstract/FREE Full Text](http://www.jabfm.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6OToiaGVhbHRoYWZmIjtzOjU6InJlc2lkIjtzOjk6IjM1LzkvMTYzOCI7czo0OiJhdG9tIjtzOjIwOiIvamFiZnAvMzUvMS8xMjQuYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 85. 85.Ye J, Zhang R, Bannon JE, et al. Identifying practice facilitation delays and barriers in primary care quality improvement: a report from Evidence NOW. J Am Board Fam Med 2020;33:655–64. [Abstract/FREE Full Text](http://www.jabfm.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NToiamFiZnAiO3M6NToicmVzaWQiO3M6ODoiMzMvNS82NTUiO3M6NDoiYXRvbSI7czoyMDoiL2phYmZwLzM1LzEvMTI0LmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 86. 86.Berry CA, Nguyen AM, Cuthel AM, et al. Measuring implementation strategy fidelity in HealthyHearts NYC: a complex intervention using practice facilitation in primary care. Am J Med Qual 2021;36:270–6. 87. 87.Halladay JR, Weiner BJ, Kim JI, et al. Practice level factors associated with enhanced engagement with practice facilitators: findings from the Heart Health Now study. BMC Health Serv Res 2020;20:1–11. [CrossRef](http://www.jabfm.org/lookup/external-ref?access_num=10.1186/s12913-020-06001-y&link_type=DOI) [PubMed](http://www.jabfm.org/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fjabfp%2F35%2F1%2F124.atom) 88. 88.Ferrante JM, Shaw EK, Bayly JE, et al. Barriers and facilitators to expanding roles of medical assistants in Patient-Centered Medical Homes (PCMHs). J Am Board Fam Med 2018;31:226–35. [Abstract/FREE Full Text](http://www.jabfm.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NToiamFiZnAiO3M6NToicmVzaWQiO3M6ODoiMzEvMi8yMjYiO3M6NDoiYXRvbSI7czoyMDoiL2phYmZwLzM1LzEvMTI0LmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 89. 89.Mosadeghrad AM, Ferdosi M, Afshar H, Hosseini-Nejhad SM. The impact of top management turnover on quality management implementation. Med Arch 2013;67:134–40. 90. 90.Balasubramanian BC, Marino M, Springer R, et al. Capacity for Practice Change, Quality Improvement, and Facilitation to Improve Cardiovascular Preventive Care in Primary Care. 48th Annual Proceedings of the North American Primary Care Research Group; Nov 22–4, 2020; Virtual Meeting. 91. 91.Cohen DJ, Crabtree BF, Etz RS, et al. Fidelity versus flexibility: translating evidence-based research into practice. Am J Prev Med 2008;35:S381–89. [CrossRef](http://www.jabfm.org/lookup/external-ref?access_num=10.1016/j.amepre.2008.08.005&link_type=DOI) [PubMed](http://www.jabfm.org/lookup/external-ref?access_num=18929985&link_type=MED&atom=%2Fjabfp%2F35%2F1%2F124.atom) [Web of Science](http://www.jabfm.org/lookup/external-ref?access_num=000260396800006&link_type=ISI) 92. 92.Bosch M, Van Der Weijden T, Wensing M, Grol R. Tailoring quality improvement interventions to identified barriers: a multiple case analysis. J Eval Clin Pract 2007;13:161–8. [CrossRef](http://www.jabfm.org/lookup/external-ref?access_num=10.1111/j.1365-2753.2006.00660.x&link_type=DOI) [PubMed](http://www.jabfm.org/lookup/external-ref?access_num=17378860&link_type=MED&atom=%2Fjabfp%2F35%2F1%2F124.atom) [Web of Science](http://www.jabfm.org/lookup/external-ref?access_num=000245067100001&link_type=ISI)