Practice Characteristics Associated with Better Implementation of Patient Self-Management Support ================================================================================================= * Bonnie T. Jortberg * Douglas H. Fernald * Danielle M. Hessler * L. Miriam Dickinson * Robyn Wearner * Lauri Connelly * Jodi Summers Holtrop * Lawrence Fisher * W. Perry Dickinson ## Abstract *Background:* Advanced primary care models emphasize patient-centered care, including self-management support (SMS). This study aimed to promote the translation of SMS into primary care practices and reported on key baseline practice characteristics that may impact SMS implementation. *Methods:* Thirty-six practices in Colorado and California participated in the study from December 2013 to March 2017. Practice administrators completed a Practice Information Form describing practice characteristics. Clinicians and staff (n = 716) completed the Practice Culture Assessment and the Patient-Centered Medical Home (PCMH) Monitor. Descriptive statistics were computed to determine practice characteristics related to culture, quality improvement, level of PCMH, and SMS implementation. Field notes and key informant interviews provided contextual details about practices. Iterative qualitative analyses identified important facilitators and barriers and change capabilities around SMS implementation. *Results:* In bivariate analyses, rural locations, fewer uncontrolled patients with diabetes, higher Medicaid or uninsured populations, underserved designation, and higher level of “PCMHness” were associated with greater reported implementation of patient SMS (all *P* < .05) at baseline. In the final multilevel model, specialty (FM vs mixed, *P* = .0081), rural location (*P* = .0109), and higher percent Medicaid (*P* < .0001) were associated with greater SMS. Practices described key facilitators (alignment, motivation, a visible champion, supporting infrastructure, and functional quality improvement and care teams) and barriers (no shared vision, no visible champion, siloed infrastructure, competing programs, turnover, and time constraints) to improving SMS delivery. *Conclusions:* Careful attention—and action—on key practice characteristics and context may create more favorable initial conditions for practice change efforts to improve SMS in primary care practices. * California * Chronic Disease * Colorado * Counseling * Disease Management * Information Technology * Life Style * Obesity * Patient Care Team * Patient-Centered Care * Primary Health Care * Quality Improvement * Self Care * Type 2 Diabetes Mellitus Most patients with type 2 diabetes mellitus (T2DM) in the United States receive diabetes care in primary care settings, which are undergoing rapid transformations due to the need to improve quality and decrease costs. The Patient-Centered Medical Home (PCMH) and the Chronic Care Model are complementary clinical intervention frameworks that are commonly used to support better T2DM outcomes in primary care.1⇓⇓⇓⇓⇓–7 Self-management support (SMS) is a core component of both the PCMH and Chronic Care Model, and focuses on providing patients with the necessary tools and resources so that they can better manage their illness, in particular by adopting and implementing healthy behaviors that promote optimal clinical outcomes.6,8⇓–10 SMS for diabetes typically targets improvements in medication adherence, diet, exercise, and other risk-related behaviors, all which are crucial for maintaining good glycemic control and reducing the risks of diabetes-related complications. Despite its recognized importance and success in clinical trials, SMS programs for diabetes continue to demonstrate limited adoptability and sustainability in the real world of primary care.11,12 Primary care clinicians have been unable to comprehensively and consistently address diabetes self-management within an efficient and systematic SMS framework for several interrelated reasons: they are often overwhelmed by competing demands, are poorly trained in assessing and intervening with health behavior change, lack practice systems for implementing change and quality improvement, and receive inadequate reimbursement for time spent in SMS activities.13⇓⇓–16 Few tools are available to assist practices with SMS. Interactive behavior-change technology (IBCT) can facilitate the adoption of crucial SMS interventions in primary care for patients with diabetes and related health risk behaviors.17⇓⇓–20. Compared with traditional, unstructured programs, technological options for delivery have the advantage of increased convenience and accessibility and may provide individualized support and resources necessary for initiating and maintaining healthful lifestyles, especially when they include nonautomated options to address patient preference and permit patient tailoring.19⇓⇓–22 There is strong evidence that Internet-based programs can effectively promote health behaviors to support diabetes self-management,23 such as healthful eating/weight management,24⇓⇓–27 increasing physical activity,28⇓–30 reducing depression symptoms, and smoking cessation.31,32 Multiple randomized trials have been conducted using IBCT programs for diabetes self-management with positive results.33,34 Connection to Health (CTH) is a comprehensive, evidence-based SMS program that supports behavior change through IBCT. The CTH logic model is informed by social-cognitive35⇓–37 and social-ecological38⇓–40 theories and is inclusive of the evidence based principles for implementing SMS in primary care.41 Multiple intervention components work together to promote enhanced, tailored diabetes management, which is linked to positive health outcomes.42⇓⇓–45 The simple availability of effective IBCT tools such as CTH does not assure their successful implementation.15,16,46⇓–48 Primary care practices are experiencing multiple pressures to see a large number of patients, to provide improved care, and to do so with very constrained reimbursement. Practices have few mechanisms to integrate new programs into routine care, which can exert major pressures on practice operations—even small changes can have substantial consequences that limit their effectiveness and sustainability.15,16,46⇓–48 Adoption and implementation of new care programs vary across practices based on practice characteristics, including practice culture and change capacity, practice size, location (rural vs urban), previous change experience, and decision-making style.13,14,46 This study was designed to promote the translation of SMS into primary care practices for patients with T2DM by combining 2 promising lines of research; specifically, testing the effectiveness of CTH for patients with T2DM in diverse primary care practices and evaluating the impact of practice facilitation to enhance uptake and maintenance of the intervention over time. This article reports on the baseline quantitative and qualitative results, which address this specific aim: to identify key practice characteristics (eg, practice size, organization, setting, and level of experience with practice redesign efforts) that affect CTH implementation and outcomes. The 2 other specific aims of this study, which will be reported on in another manuscript, are (1) to conduct a cluster randomized trial to examine the reach, effectiveness, adoption, implementation, and maintenance of CTH for patients with T2DM in primary care practices; and (2) to determine the incremental benefit of brief, targeted practice facilitation on the implementation of CTH in diverse primary care practices.49 ## Methods and Design ### Design CTH is a 3-arm, cluster-randomized trial to evaluate the reach, effectiveness, adoption, implementation, and maintenance of CTH for patients with T2DM in diverse primary care practices. This report is focused on postrandomization practice and practice member surveys and key informant interviews collected at baseline, before any intervention implementation. ### Practice Sample We recruited 36 primary care practices, 18 each in Colorado and California. Practices were recruited through the Colorado and California practice-based research networks, informational articles in the Colorado Academy of Family Physicians quarterly newsletter, and direct investigator contacts with health systems and individual practices. Inclusion criteria were family medicine or general internal medicine practices with a minimum of 80 patients with T2DM, with all clinicians agreeing to participate. Practices were selected to participate if they met these criteria. We recruited a diverse set of practices of various sizes and organizational structures (such as private, system-owned, and safety-net practices). Detailed information about practice recruitment was published in a previous manuscript.50 Practices participated for 18 months, with participation encompassing December 2013 to March 2017. ### Protections This project was reviewed and approved by the Colorado Multiple Institutional Review Board and the University of California San Francisco Institutional Review Board. ### Practice Participants All practice staff and clinicians were asked to complete the baseline surveys, resulting in 716 completed surveys from all 36 practices. In addition, 3 to 6 staff and clinicians per practice participated in key informant interviews. Interviewees were selected to represent a mixture of roles in the practice (ie, clinical and practice leadership, nursing, front and back office staff, and health educators) to ensure capture of the breadth of experience related to SMS. ### Measures ### Practice Surveys Clinicians and staff completed 2 surveys to determine baseline practice characteristics related to culture, quality improvement, PCMH-ness, and SMS implementation: 1. The SMS subscale of the Practice Monitor provided information about clinician and staffs' routine use of SMS as a component of patient care. Practice members rated their perceptions of SMS activities and practice culture using a Likert scale (strongly disagree to strongly agree) on 28 items. Prior validation and factor analysis yielded 7 reliable subscales used in our analysis; this survey can be found in Appendix A online. 2. The Practice Culture Assessment (PCA) provided practice-wide information about practice culture related to practice change and improvement.50 The PCA was completed by practice clinicians and staff using a 5-point Likert-type scale (strongly disagree to strongly agree) on 22 items. Before validation and factor analysis yielded 3 reliable subscales used in our analysis: improvement and Change Culture, Work Relationships, and Chaos.51 In addition, practice administrators completed a Practice Information Form, a 16-item form that describes main practice characteristics and descriptions of their patient population. ### Survey Data and Statistical Analysis Surveys were administered from introduction through the first SMS training session. Practice staff and clinicians completed the survey either via article copy or through an email link to Research Electronic Data Capture, which is a secure, web-based application designed to support data capture for research studies.52 Surveys were anonymous, and no individual information was obtained or shared with other staff. Practice characteristics were collected during the practice recruitment process. Practice characteristic data collected were level of quality improvement experience, level of PCMH implementation, number of clinicians, specialty type, percent of patients with diabetes, percentage of patients with hemoglobin A1c >9, location (rural/urban), type of practice organization, and percentage of Medicaid or uninsured patients. #### Survey Data Analysis Descriptive statistics were computed for baseline practice characteristics and key variables of interest from the practice member surveys. Exploratory factor analysis and item analysis were performed for items the SMS scale from the Practice Monitor survey, because this specific combination of items had not been previously used as a scale. The outcome variable for all subsequent analyses was the patient SMS scale. Independent variables of interest included items from the practice survey, listed above, and scores on the PCA subscales Change Culture, Chaos, and Work Culture. Each independent variable was assessed for possible association with the outcome in bivariate analyses (Pearson correlation coefficient); practice characteristic variables that were associated with the outcome at *P* < .10 in simple bivariate associations were considered for further analysis; PCA subscales were considered for further analysis regardless of strength of bivariate associations. Next, general linear mixed models (with random intercept for practice) were used to further examine associations between the outcome and each practice-level variable, 1 at a time. Practice-level variables that were significantly associated with the outcome (*P* < .05) after adjusting for clustering were included in an initial multivariable model, eliminating nonsignificant variables 1 at a time until all *P* values were less than 0.05. Finally, practice culture variables were added to the models. Because of collinearity, Change Culture and Work Culture were assessed in separate models. All statistical analyses were performed using SAS version 9.4 (SAS Institute Inc., Cary, NC). ### Qualitative Data Baseline qualitative data included (1) structured field notes completed by the facilitator and/or research staff after each substantive contact with the practice (from introduction through the first SMS training session) and (2) semistructured interviews conducted with staff and clinicians in each practice (before or immediately after the first SMS training session). Memo forms providing brief summary notes by the interviewer were also completed after each interview.53 Over 250 documents were included in this analysis. ### Qualitative Data Analysis Four qualitative analysts followed an iterative approach to the qualitative analysis, with the investigators going through cycles of reading, summarizing, and rereading the data.54 Beginning with immersion in the data (each analyst reviewed data from a selection of practices in each Colorado and California and in each arm) to read, review, and reread, and then to the development of conceptual categories relevant to the implementation of CTH or SMS. Fourteen provisional conceptual categories emerged, which were then used for template coding to begin segmenting relevant data for further review and analysis. After a review of coded data to assure conceptual inter-rater reliability, the analysts divided the data and coded it using the qualitative software program ATLAS.ti (version 7, Scientific Software Development, GmbH). The analysts continued to meet and discuss the data over a series of twice-monthly meetings over 6 months. Reading, refining, discussing, and summarizing continued until key themes emerged and clarity by practice for each theme was evident. The coded data were then summarized into a matrix, with key practice characteristics organized into the Solberg framework for practice improvement (see Figure 1). Finally, the analysts developed practice characteristic constructs as forces that potentially propel or repel the implementation of SMS in these practices. ![Figure 1.](http://www.jabfm.org/https://www.jabfm.org/content/jabfp/32/3/329/F1.medium.gif) [Figure 1.](http://www.jabfm.org/content/32/3/329/F1) Figure 1. Framework for self-management support (SMS) practice improvement. Adapted from: Solberg LI. Improving medical practice: a conceptual framework. Ann Fam Med 2007;5:251–256. ## Results ### Practice Survey Results A total of 716 clinicians and staff enrolled in CTH completed baseline surveys (73% response rate). Practice characteristics are shown in Table 1. The majority of the practices enrolled in CTH were Federally Qualified Health Centers, and as such, the percentage of patients with Medicaid or uninsured is higher than in the general population. View this table: [Table 1.](http://www.jabfm.org/content/32/3/329/T1) Table 1. Baseline Practice Characteristics from 36 Primary Care Practices in Colorado and Northern California; Data Collected from 12/2013 to 9/2015 Overall scores on practice member surveys for patient SMS activities and practice culture are shown in Table 2. Patient SMS Cronbach's α = 0.92. The overall score for patient self-management was 65.7 out of 100, and individual SMS items showed slightly higher implementation of specific SMS activities, such as systems implemented for identifying patients with needs for SMS, use of shared care plans, SMS tools provided to patients and families, and the presence of a care manager or staff member to assist with SMS activities. View this table: [Table 2.](http://www.jabfm.org/content/32/3/329/T2) Table 2. Baseline Practice Member Surveys from 36 Primary Care Practices in Colorado and Northern California; Data Collected from 12/2013 to 9/2015 Simple bivariate associations for variables that met initial screening criteria are shown in Table 3. After adjusting for clustering, the following variables were associated with a greater reported implementation of patient SMS (all *P* < .05; please see Table 2 for specific SMS items): rural location, higher percent Medicaid or uninsured populations, underserved designation, presence of a care manager, and a higher level of “PCMHness” (see Table 2). In the multivariable model with SMS implementation as the outcome and all practice level variables from the previous step included initially as independent variables, presence of a care manager (*P* = .0019), level of “PCMHness” (*P* = .0027), and underserved designation (*P* = .0272) were retained at *P* < .05. Because of high collinearity between PCA subscales Change Culture and Work Culture, these were included in separate models. After adjusting for significant practice level variables, higher scores on the Change Culture (*P* < .0001) and Work Culture (*P* = .0030) subscales were associated with greater SMS. Higher scores on the Chaos (*P* = .0020) subscale was associated with lower scores on SMS implementation. View this table: [Table 3.](http://www.jabfm.org/content/32/3/329/T3) Table 3. Baseline Practice and Practice Member Variables Associated with Greater Self-Management Support Activities, from 36 Primary Care Practices in Colorado and Northern California; Data Collected from 12/2013 to 9/2015 ### Qualitative Results Across all 36 practices, 119 baseline key informant interviews were completed (42 providers; 77 staff or administrators) and 53 field notes were filed covering the baseline period. Delivering SMS likely requires multiple people in a clinic having active and integrated roles in delivering key components of SMS to patients. Leif Solberg's work on practice improvement provided an organizing framework to describe initial conditions that could potentially promote or hinder the changes needed to effectively deliver SMS for patients with diabetes (Figure 2). The baseline analysis focused on Priority and Change Process Capability to elaborate details in the “black box” of these areas. It also provided a conceptual framework to organize analytic conceptual constructs over time. From the analysis of baseline data, practice priorities were identified and change process capabilities that could affect SMS implementation in these 36 practices (Figure 2). ![Figure 2.](http://www.jabfm.org/https://www.jabfm.org/content/jabfp/32/3/329/F2.medium.gif) [Figure 2.](http://www.jabfm.org/content/32/3/329/F2) Figure 2. Facilitators and barriers for self-management support (SMS) implementation. ### Priority: Alignment Around SMS Transformation At baseline, across all 36 practices, there were clinical leaders, staff, and clinicians who expressed SMS transformation as an important priority; however, other practice staff and clinicians expressed simultaneous concerns and reservations about practice changes for SMS. Propelling and repelling factors pushing for SMS transformation are described in Table 4. View this table: [Table 4.](http://www.jabfm.org/content/32/3/329/T4) Table 4. Priority Alignment Around Self-Management Support (SMS) Transformation ### Change Process Capability to Implement SMS Changes The details of change process capability varied widely across the 36 practices; however, there were consistent concepts that emerged about characteristics that propel implementation—supporting infrastructure, functional teams, and practice stability—and those that repel implementation—siloed infrastructure, communication issues, turnover, competing programs, and time/resource constraints. Propelling and repelling factors for change process capabilities are described in Table 5. View this table: [Table 5.](http://www.jabfm.org/content/32/3/329/T5) Table 5. Change Process Capability to Implement Self-Management Support (SMS) Changes ## Discussion The purpose of this article was to report on baseline practice characteristics and context from surveys and qualitative interviews that reflect previous implementation of SMS activities before participation in this study. SMS is a critical element of care for people with diabetes and other chronic conditions, and the current findings may assist primary care practices and researchers with identifying key practice characteristics that are necessary to provide SMS for patients with T2DM. At baseline, the practices reporting higher levels of SMS reported significantly higher levels of a positive work culture, the presence of a care manager, higher levels of “PCMHness,” and lower levels of practice Chaos. These characteristics are known to cluster and are often seen together, as have been reported in other studies.48,53 For example, the Enhancing Practice, Improving Care study found that practice facilitation using a continuous quality improvement approach was effective at improving measures of diabetes care.51 Likewise, Shetty et al55 examined the components of organizational support for SMS in primary care practices. These researchers found 8 essential elements of organizational support, including ongoing quality improvement, staff training and education, and integration of SMS into primary care. Results from the qualitative data also support the findings from the practice surveys regarding level of “PCMH-ness” and the importance of the presence of a care manager. SMS implementation facilitators included several key components of the PCMH,1 including functional quality-improvement teams; coordinated care with the presence of supporting infrastructure such as care managers, patient health educators, or Certified Diabetes Educators; and practice leadership who saw alignment with SMS and their PCMH activities. Leif Solberg's quality improvement framework suggests that multiple factors combine to produce improved quality. SMS is not business as usual. Results from this study suggest that SMS may require substantial redesign of workflows, responsibilities, and staffing along with careful coordination and communication across multiple roles in a practice for a sustained period. There are factors that seem to align with and promote SMS redesign (eg, conceptual and functional alignment, functional teams, and supporting infrastructure); yet, there may be specific repelling factors (eg, no visible champions, lack of consistent vision, different understandings of SMS, and siloed work) that are particularly at odds with implementing sustained and functional SMS. Addressing and minimizing the repelling forces and maximizing and building on the propelling forces across the entire practice may help to unify the practice vision and point staff and clinicians in the same direction. These findings may be useful for health systems, practices, researchers, and others to consider in identifying practice's readiness for SMS implementation. Lehman et al55 assessed organizational readiness for change in health care and found similar results, particularly for the importance of a positive work culture to be “ready” to implement technology and organizational changes. As such, it may be useful for practices and health care organizations to assess their work culture before embarking on implementing SMS as foundational work may need to be conducted to ensure success. ### Limitations This project was only implemented in primary care practices in Colorado and California and may not be representative of primary care in other states. In addition, federally qualified health centers were overrepresented in our sample. Because this is a limited sample, other important factors may exist, but we did not observe them in our data. This report does not consider the relative influence on the observed characteristics on important, downstream practice and patient outcomes. ## Conclusion Fully implemented SMS requires robust and active participation across clinical roles in primary care practices. The results from this study add to our understanding that careful attention—and action—on work culture and transformation readiness may create more favorable initial conditions for practice change efforts to improve SMS in primary care practices. Practices, health systems, and reseachers may need to take these key practice characteristics into account when considering implementation of SMS targeted for patients with T2DM. ## Notes * This article was externally peer reviewed. * *Funding:* none. * *Conflict of interest:* none declared. * See Related Article on Page [341](http://www.jabfm.org/lookup/volpage/32/341). * To see this article online, please go to: [http://jabfm.org/content/32/3/329.full](http://jabfm.org/content/32/3/329.full). * Received for publication April 23, 2018. * Revision received December 21, 2018. * Accepted for publication December 21, 2018. ## References 1. 1.Joint Principles of the Patient-Centered Medical Home Secondary Joint Principles of the Patient-Centered Medical Home 2007. Available from: [https://www.aafp.org/dam/AAFP/documents/practice\_management/pcmh/initiatives/PCMHJoint.pdf](https://www.aafp.org/dam/AAFP/documents/practice_management/pcmh/initiatives/PCMHJoint.pdf). Published March 2007. Accessed March 1, 2018. 2. 2.Wagner EH, Austin BT, Von Korff M. Improving outcomes in chronic illness. Manag Care Q 1996;4:12–25. [PubMed](http://www.jabfm.org/lookup/external-ref?access_num=10157259&link_type=MED&atom=%2Fjabfp%2F32%2F3%2F329.atom) 3. 3.Wagner EH, Austin BT, Von Korff M. Organizing care for patients with chronic illness. Milbank Q 1996;74:511–44. [CrossRef](http://www.jabfm.org/lookup/external-ref?access_num=10.2307/3350391&link_type=DOI) [PubMed](http://www.jabfm.org/lookup/external-ref?access_num=8941260&link_type=MED&atom=%2Fjabfp%2F32%2F3%2F329.atom) [Web of Science](http://www.jabfm.org/lookup/external-ref?access_num=A1996VU47200004&link_type=ISI) 4. 4.Bodenheimer T, Wagner EH, Grumbach K. Improving primary care for patients with chronic illness. JAMA 2002;288:1775–9. [CrossRef](http://www.jabfm.org/lookup/external-ref?access_num=10.1001/jama.288.14.1775&link_type=DOI) [PubMed](http://www.jabfm.org/lookup/external-ref?access_num=12365965&link_type=MED&atom=%2Fjabfp%2F32%2F3%2F329.atom) [Web of Science](http://www.jabfm.org/lookup/external-ref?access_num=000178484700034&link_type=ISI) 5. 5.Bodenheimer T, Wagner EH, Grumbach K. Improving primary care for patients with chronic illness: the chronic care model. Part 2. JAMA 2002;288:1909–14. [CrossRef](http://www.jabfm.org/lookup/external-ref?access_num=10.1001/jama.288.15.1909&link_type=DOI) [PubMed](http://www.jabfm.org/lookup/external-ref?access_num=12377092&link_type=MED&atom=%2Fjabfp%2F32%2F3%2F329.atom) [Web of Science](http://www.jabfm.org/lookup/external-ref?access_num=000178604200032&link_type=ISI) 6. 6.Berenson RA, Hammons T, Gans DN, et al. A house is not a home: keeping patients at the center of practice redesign. Health Aff (Project Hope) 2008;27:1219–30. 7. 7.Grumbach K, Bodenheimer T. A primary care home for Americans: putting the house in order. JAMA 2002;288:889–93. [CrossRef](http://www.jabfm.org/lookup/external-ref?access_num=10.1001/jama.288.7.889&link_type=DOI) [PubMed](http://www.jabfm.org/lookup/external-ref?access_num=12186609&link_type=MED&atom=%2Fjabfp%2F32%2F3%2F329.atom) [Web of Science](http://www.jabfm.org/lookup/external-ref?access_num=000177513100034&link_type=ISI) 8. 8.Riley KM, Glasgow RE, Eakin EG. Resources for health: a social-ecological intervention for supporting self-management of chronic conditions. J Health Psychol 2001;6:693–705. [CrossRef](http://www.jabfm.org/lookup/external-ref?access_num=10.1177/135910530100600607&link_type=DOI) [PubMed](http://www.jabfm.org/lookup/external-ref?access_num=22049471&link_type=MED&atom=%2Fjabfp%2F32%2F3%2F329.atom) [Web of Science](http://www.jabfm.org/lookup/external-ref?access_num=000172387200007&link_type=ISI) 9. 9.Glasgow RE, Toobert DJ, Hampson SE. Effects of a brief office-based intervention to facilitate diabetes dietary self-management. Diabetes Care 1996;19:835–42. [Abstract/FREE Full Text](http://www.jabfm.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NzoiZGlhY2FyZSI7czo1OiJyZXNpZCI7czo4OiIxOS84LzgzNSI7czo0OiJhdG9tIjtzOjIwOiIvamFiZnAvMzIvMy8zMjkuYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 10. 10.Barrera M Jr.., Toobert DJ, Angell KL, Glasgow RE, Mackinnon DP. Social support and social-ecological resources as mediators of lifestyle intervention effects for type 2 diabetes. J Health Psychol 2006;11:483–95. [CrossRef](http://www.jabfm.org/lookup/external-ref?access_num=10.1177/1359105306063321&link_type=DOI) [PubMed](http://www.jabfm.org/lookup/external-ref?access_num=16774900&link_type=MED&atom=%2Fjabfp%2F32%2F3%2F329.atom) [Web of Science](http://www.jabfm.org/lookup/external-ref?access_num=000238259400019&link_type=ISI) 11. 11.Schillinger D, Handley M, Wang F, Hammer H. Effects of self-management support on structure, process, and outcomes among vulnerable patients with diabetes: a three-arm practical clinical trial. Diabetes Care 2009;32:559–66. [Abstract/FREE Full Text](http://www.jabfm.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NzoiZGlhY2FyZSI7czo1OiJyZXNpZCI7czo4OiIzMi80LzU1OSI7czo0OiJhdG9tIjtzOjIwOiIvamFiZnAvMzIvMy8zMjkuYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 12. 12.Norris SL, Engelgau MM, Narayan KM. Effectiveness of self-management training in type 2 diabetes: a systematic review of randomized controlled trials. Diabetes Care 2001;24:561–87. [Abstract/FREE Full Text](http://www.jabfm.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NzoiZGlhY2FyZSI7czo1OiJyZXNpZCI7czo4OiIyNC8zLzU2MSI7czo0OiJhdG9tIjtzOjIwOiIvamFiZnAvMzIvMy8zMjkuYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 13. 13.Tallia AF, Stange KC, McDaniel RR Jr.., Aita VA, Miller WL, Crabtree BF. Understanding organizational designs of primary care practices. J Healthc Manag 2003;48:45–59; discussion 60–1. [PubMed](http://www.jabfm.org/lookup/external-ref?access_num=12592868&link_type=MED&atom=%2Fjabfp%2F32%2F3%2F329.atom) [Web of Science](http://www.jabfm.org/lookup/external-ref?access_num=000180462900009&link_type=ISI) 14. 14.Solberg LI, Brekke ML, Fazio CJ, et al. Lessons from experienced guideline implementers: attend to many factors and use multiple strategies. Jt Comm J Qual Improv 2000;26:171–88. [PubMed](http://www.jabfm.org/lookup/external-ref?access_num=10749003&link_type=MED&atom=%2Fjabfp%2F32%2F3%2F329.atom) 15. 15.Jaen CR. Successful health information technology implementation requires practice and health care system transformation. Ann Fam Med 2011;9:388–9. [FREE Full Text](http://www.jabfm.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiRlVMTCI7czoxMToiam91cm5hbENvZGUiO3M6ODoiYW5uYWxzZm0iO3M6NToicmVzaWQiO3M6NzoiOS81LzM4OCI7czo0OiJhdG9tIjtzOjIwOiIvamFiZnAvMzIvMy8zMjkuYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 16. 16.Sittig DF, Ash JS. On the importance of using a multidimensional sociotechnical model to study health information technology. Ann Fam Med 2011;9:390–1. [FREE Full Text](http://www.jabfm.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiRlVMTCI7czoxMToiam91cm5hbENvZGUiO3M6ODoiYW5uYWxzZm0iO3M6NToicmVzaWQiO3M6NzoiOS81LzM5MCI7czo0OiJhdG9tIjtzOjIwOiIvamFiZnAvMzIvMy8zMjkuYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 17. 17.Glasgow RE, Bull SS, Piette JD, Steiner JF. Interactive behavior change technology. A partial solution to the competing demands of primary care. Am J Prev Med 2004;27:80–7. [CrossRef](http://www.jabfm.org/lookup/external-ref?access_num=10.1016/j.amepre.2004.04.026&link_type=DOI) [PubMed](http://www.jabfm.org/lookup/external-ref?access_num=15275676&link_type=MED&atom=%2Fjabfp%2F32%2F3%2F329.atom) [Web of Science](http://www.jabfm.org/lookup/external-ref?access_num=000222967600009&link_type=ISI) 18. 18.Glasgow RE. Interactive media for diabetes self-management: issues in maximizing public health impact. Med Decis Making 2010;30:745–58. [CrossRef](http://www.jabfm.org/lookup/external-ref?access_num=10.1177/0272989X10385845&link_type=DOI) [PubMed](http://www.jabfm.org/lookup/external-ref?access_num=21183760&link_type=MED&atom=%2Fjabfp%2F32%2F3%2F329.atom) [Web of Science](http://www.jabfm.org/lookup/external-ref?access_num=000285580100014&link_type=ISI) 19. 19.Oenema A, Brug J, Dijkstra A, de Weerdt I, de Vries H. Efficacy and use of an internet-delivered computer-tailored lifestyle intervention, targeting saturated fat intake, physical activity and smoking cessation: a randomized controlled trial. Ann Behav Med 2008;35:125–35. [CrossRef](http://www.jabfm.org/lookup/external-ref?access_num=10.1007/s12160-008-9023-1&link_type=DOI) [PubMed](http://www.jabfm.org/lookup/external-ref?access_num=18363076&link_type=MED&atom=%2Fjabfp%2F32%2F3%2F329.atom) [Web of Science](http://www.jabfm.org/lookup/external-ref?access_num=000255057600001&link_type=ISI) 20. 20.Prochaska JO, Velicer WF, Redding C, et al. Stage-based expert systems to guide a population of primary care patients to quit smoking, eat healthier, prevent skin cancer, and receive regular mammograms. Prev Med 2005;41:406–16. [CrossRef](http://www.jabfm.org/lookup/external-ref?access_num=10.1016/j.ypmed.2004.09.050&link_type=DOI) [PubMed](http://www.jabfm.org/lookup/external-ref?access_num=15896835&link_type=MED&atom=%2Fjabfp%2F32%2F3%2F329.atom) [Web of Science](http://www.jabfm.org/lookup/external-ref?access_num=000230008000007&link_type=ISI) 21. 21.Vandelanotte C, De Bourdeaudhuij I, Brug J. Two-year follow-up of sequential and simultaneous interactive computer-tailored interventions for increasing physical activity and decreasing fat intake. Ann Behav Med 2007;33:213–9. [CrossRef](http://www.jabfm.org/lookup/external-ref?access_num=10.1007/BF02879903&link_type=DOI) [PubMed](http://www.jabfm.org/lookup/external-ref?access_num=17447874&link_type=MED&atom=%2Fjabfp%2F32%2F3%2F329.atom) [Web of Science](http://www.jabfm.org/lookup/external-ref?access_num=000247892500012&link_type=ISI) 22. 22.Glasgow RE, Edwards LL, Whitesides H, Carroll N, Sanders TJ, McCray BL. Reach and effectiveness of DVD and in-person diabetes self-management education. Chronic Ill 2009;5:243–9. 23. 23.Rabin B, Glasgow RE. Dissemination and implementation of interactive health communication applications. New York, NY: Routledge; 2012. 24. 24.Brug J, Oenema A, Campbell M. Past, present, and future of computer-tailored nutrition education. Am J Clin Nutr 2003;77:1028s–34s. [PubMed](http://www.jabfm.org/lookup/external-ref?access_num=12663313&link_type=MED&atom=%2Fjabfp%2F32%2F3%2F329.atom) [Web of Science](http://www.jabfm.org/lookup/external-ref?access_num=000181812300008&link_type=ISI) 25. 25.Tate DF, Jackvony EH, Wing RR. Effects of Internet behavioral counseling on weight loss in adults at risk for type 2 diabetes: a randomized trial. JAMA 2003;289:1833–6. [CrossRef](http://www.jabfm.org/lookup/external-ref?access_num=10.1001/jama.289.14.1833&link_type=DOI) [PubMed](http://www.jabfm.org/lookup/external-ref?access_num=12684363&link_type=MED&atom=%2Fjabfp%2F32%2F3%2F329.atom) [Web of Science](http://www.jabfm.org/lookup/external-ref?access_num=000182094900030&link_type=ISI) 26. 26.Oenema A, Brug J, Lechner L. Web-based tailored nutrition education: results of a randomized controlled trial. Health Educ Res 2001;16:647–60. [CrossRef](http://www.jabfm.org/lookup/external-ref?access_num=10.1093/her/16.6.647&link_type=DOI) [PubMed](http://www.jabfm.org/lookup/external-ref?access_num=11780705&link_type=MED&atom=%2Fjabfp%2F32%2F3%2F329.atom) [Web of Science](http://www.jabfm.org/lookup/external-ref?access_num=000172866800002&link_type=ISI) 27. 27.Vandelanotte C, De Bourdeaudhuij I, Brug J. Acceptability and feasibility of an interactive computer-tailored fat intake intervention in Belgium. Health Promot Int 2004;19:463–70. [CrossRef](http://www.jabfm.org/lookup/external-ref?access_num=10.1093/heapro/dah408&link_type=DOI) [PubMed](http://www.jabfm.org/lookup/external-ref?access_num=15522947&link_type=MED&atom=%2Fjabfp%2F32%2F3%2F329.atom) [Web of Science](http://www.jabfm.org/lookup/external-ref?access_num=000225361900008&link_type=ISI) 28. 28.Wanner M, Martin-Diener E, Braun-Fahrlander C, Bauer G, Martin BW. Effectiveness of active-online, an individually tailored physical activity intervention, in a real-life setting: randomized controlled trial. J Med Internet Res 2009;11:e23. [CrossRef](http://www.jabfm.org/lookup/external-ref?access_num=10.2196/jmir.1179&link_type=DOI) [PubMed](http://www.jabfm.org/lookup/external-ref?access_num=19666456&link_type=MED&atom=%2Fjabfp%2F32%2F3%2F329.atom) 29. 29.Spittaels H, De Bourdeaudhuij I, Brug J, Vandelanotte C. Effectiveness of an online computer-tailored physical activity intervention in a real-life setting. Health Educ Res 2007;22:385–96. [CrossRef](http://www.jabfm.org/lookup/external-ref?access_num=10.1093/her/cyl096&link_type=DOI) [PubMed](http://www.jabfm.org/lookup/external-ref?access_num=16971674&link_type=MED&atom=%2Fjabfp%2F32%2F3%2F329.atom) [Web of Science](http://www.jabfm.org/lookup/external-ref?access_num=000247138800008&link_type=ISI) 30. 30.Steele R, Mummery WK, Dwyer T. Using the Internet to promote physical activity: a randomized trial of intervention delivery modes. J Phys Act Health 2007;4:245–60. [PubMed](http://www.jabfm.org/lookup/external-ref?access_num=17846455&link_type=MED&atom=%2Fjabfp%2F32%2F3%2F329.atom) 31. 31.Strecher VJ, McClure J, Alexander G, et al. The role of engagement in a tailored web-based smoking cessation program: randomized controlled trial. J Med Internet Res 2008;10:e36. [CrossRef](http://www.jabfm.org/lookup/external-ref?access_num=10.2196/jmir.1002&link_type=DOI) [PubMed](http://www.jabfm.org/lookup/external-ref?access_num=18984557&link_type=MED&atom=%2Fjabfp%2F32%2F3%2F329.atom) 32. 32.Strecher VJ, McClure JB, Alexander GL, et al. Web-based smoking-cessation programs: results of a randomized trial. Am J Prev Med 2008;34:373–81. [CrossRef](http://www.jabfm.org/lookup/external-ref?access_num=10.1016/j.amepre.2007.12.024&link_type=DOI) [PubMed](http://www.jabfm.org/lookup/external-ref?access_num=18407003&link_type=MED&atom=%2Fjabfp%2F32%2F3%2F329.atom) [Web of Science](http://www.jabfm.org/lookup/external-ref?access_num=000255761500001&link_type=ISI) 33. 33.Austin Boren S, Gunlock TL, Krishna S, Kramer TC. Computer-aided diabetes education: a synthesis of randomized controlled trials. AMIAAnnu Symp Proc 2006:51–5. 34. 34.Welch G, Weinger K, Anderson B, Polonsky WH. Responsiveness of the Problem Areas In Diabetes (PAID) questionnaire. Diabet Med 2003;20:69–72. [CrossRef](http://www.jabfm.org/lookup/external-ref?access_num=10.1046/j.1464-5491.2003.00832.x&link_type=DOI) [PubMed](http://www.jabfm.org/lookup/external-ref?access_num=12519323&link_type=MED&atom=%2Fjabfp%2F32%2F3%2F329.atom) [Web of Science](http://www.jabfm.org/lookup/external-ref?access_num=000180250700011&link_type=ISI) 35. 35.Bandura A. Self-efficacy: The exercise of control. New York, NY, US: W H Freeman/Times Books/ Henry Holt & Co; 1997. 36. 36.Glasgow RE. A practical model of diabetes management and education. Diabetes Care 1995;18:117–26. [Abstract/FREE Full Text](http://www.jabfm.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NzoiZGlhY2FyZSI7czo1OiJyZXNpZCI7czo4OiIxOC8xLzExNyI7czo0OiJhdG9tIjtzOjIwOiIvamFiZnAvMzIvMy8zMjkuYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 37. 37.Glasgow RE, Eakin EG. Issues in diabetes self-management. New York: Springer Publishing Company; 1998. 38. 38.Glasgow RE, Strycker LA, Toobert DJ, Eakin E. A social-ecologic approach to assessing support for disease self-management: the Chronic Illness Resources Survey. J Behav Med 2000;23:559–83. [CrossRef](http://www.jabfm.org/lookup/external-ref?access_num=10.1023/A:1005507603901&link_type=DOI) [PubMed](http://www.jabfm.org/lookup/external-ref?access_num=11199088&link_type=MED&atom=%2Fjabfp%2F32%2F3%2F329.atom) [Web of Science](http://www.jabfm.org/lookup/external-ref?access_num=000166284300005&link_type=ISI) 39. 39.McLeroy KR, Bibeau D, Steckler A, Glanz K. An ecological perspective on health promotion programs. Health Educ Q 1988;15:351–77. [CrossRef](http://www.jabfm.org/lookup/external-ref?access_num=10.1177/109019818801500401&link_type=DOI) [PubMed](http://www.jabfm.org/lookup/external-ref?access_num=3068205&link_type=MED&atom=%2Fjabfp%2F32%2F3%2F329.atom) [Web of Science](http://www.jabfm.org/lookup/external-ref?access_num=A1988R191400001&link_type=ISI) 40. 40.Stokols D, Allen J, Bellingham RL. The social ecology of health promotion: implications for research and practice. Am J Health Promot 996;10:247–51. 41. 41.Battersby M, Von Korff M, Schaefer J, et al. Twelve evidence-based principles for implementing self-management support in primary care. Jt Comm J Qual Patient Saf 2010;36:561–70. [PubMed](http://www.jabfm.org/lookup/external-ref?access_num=21222358&link_type=MED&atom=%2Fjabfp%2F32%2F3%2F329.atom) 42. 42.Daubenmier JJ, Weidner G, Sumner MD, et al. The contribution of changes in diet, exercise, and stress management to changes in coronary risk in women and men in the multisite cardiac lifestyle intervention program. Ann Behav Med 2007;33:57–68. [CrossRef](http://www.jabfm.org/lookup/external-ref?access_num=10.1207/s15324796abm3301_7&link_type=DOI) [PubMed](http://www.jabfm.org/lookup/external-ref?access_num=17291171&link_type=MED&atom=%2Fjabfp%2F32%2F3%2F329.atom) [Web of Science](http://www.jabfm.org/lookup/external-ref?access_num=000244464800007&link_type=ISI) 43. 43.Ades PA. Cardiac rehabilitation and secondary prevention of coronary heart disease. N Engl J Med 2001;345:892–902. [CrossRef](http://www.jabfm.org/lookup/external-ref?access_num=10.1056/NEJMra001529&link_type=DOI) [PubMed](http://www.jabfm.org/lookup/external-ref?access_num=11565523&link_type=MED&atom=%2Fjabfp%2F32%2F3%2F329.atom) [Web of Science](http://www.jabfm.org/lookup/external-ref?access_num=000171039600007&link_type=ISI) 44. 44.Brochu M, Poehlman ET, Ades PA. Obesity, body fat distribution, and coronary artery disease. J Cardiopulm Rehabil 2000;20:96–108. [CrossRef](http://www.jabfm.org/lookup/external-ref?access_num=10.1097/00008483-200003000-00003&link_type=DOI) [PubMed](http://www.jabfm.org/lookup/external-ref?access_num=10763157&link_type=MED&atom=%2Fjabfp%2F32%2F3%2F329.atom) 45. 45.Dickinson WP DL, Jortberg BT, Hessler DM, Fernald DH, Fischer L. A cluster randomized trial comparing strategies for translating self-management support into primary care practices. BMC Fam Pract 2018;19:126. 46. 46.Baron RJ. Quality improvement with an electronic health record: achievable, but not automatic. Ann Intern Med 2007;147:549–52. [CrossRef](http://www.jabfm.org/lookup/external-ref?access_num=10.7326/0003-4819-147-8-200710160-00007&link_type=DOI) [PubMed](http://www.jabfm.org/lookup/external-ref?access_num=17938393&link_type=MED&atom=%2Fjabfp%2F32%2F3%2F329.atom) [Web of Science](http://www.jabfm.org/lookup/external-ref?access_num=000250437100004&link_type=ISI) 47. 47.Crosson JC, Etz RS, Wu S, Straus SG, Eisenman D, Bell DS. Meaningful use of electronic prescribing in 5 exemplar primary care practices. Ann Fam Med 2011;9:392–7. [Abstract/FREE Full Text](http://www.jabfm.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6ODoiYW5uYWxzZm0iO3M6NToicmVzaWQiO3M6NzoiOS81LzM5MiI7czo0OiJhdG9tIjtzOjIwOiIvamFiZnAvMzIvMy8zMjkuYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 48. 48.Crosson JC, Isaacson N, Lancaster D, et al. Variation in electronic prescribing implementation among twelve ambulatory practices. J Gen Intern Med 2008;23:364–71. [CrossRef](http://www.jabfm.org/lookup/external-ref?access_num=10.1007/s11606-007-0494-8&link_type=DOI) [PubMed](http://www.jabfm.org/lookup/external-ref?access_num=18373131&link_type=MED&atom=%2Fjabfp%2F32%2F3%2F329.atom) [Web of Science](http://www.jabfm.org/lookup/external-ref?access_num=000254456400004&link_type=ISI) 49. 49.Dickinson WP, Dickinson LM, Jortberg BT, et al. A cluster randomized trial comparing strategies for translating self-management support into primary care practices. J Am Board Fam Med 2019;32:341–352. [Abstract/FREE Full Text](http://www.jabfm.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NToiamFiZnAiO3M6NToicmVzaWQiO3M6ODoiMzIvMy8zNDEiO3M6NDoiYXRvbSI7czoyMDoiL2phYmZwLzMyLzMvMzI5LmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 50. 50.Fernald DH, Jortberg BT, Hessler DM, Wearner R., Dickenson L.M., Fisher L, Dickinson W.P. Recruiting primary care practices for research: reflections and reminders. J Am Board Fam Med 2018;31:947–951. [Abstract/FREE Full Text](http://www.jabfm.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NToiamFiZnAiO3M6NToicmVzaWQiO3M6ODoiMzEvNi85NDciO3M6NDoiYXRvbSI7czoyMDoiL2phYmZwLzMyLzMvMzI5LmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 51. 51.Dickinson WP, Dickinson LM, Nutting PA, et al. Practice facilitation to improve diabetes care in primary care: a report from the EPIC randomized clinical trial. Ann Fam Med 2014;12:8–16. [Abstract/FREE Full Text](http://www.jabfm.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6ODoiYW5uYWxzZm0iO3M6NToicmVzaWQiO3M6NjoiMTIvMS84IjtzOjQ6ImF0b20iO3M6MjA6Ii9qYWJmcC8zMi8zLzMyOS5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 52. 52.Harris PA, Taylor R, Thielke R, Payne J, Gonzalez N, Conde JG. Research electronic data capture (REDCap)–a metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inform 2009;42:377–81. [CrossRef](http://www.jabfm.org/lookup/external-ref?access_num=10.1016/j.jbi.2008.08.010&link_type=DOI) [PubMed](http://www.jabfm.org/lookup/external-ref?access_num=18929686&link_type=MED&atom=%2Fjabfp%2F32%2F3%2F329.atom) [Web of Science](http://www.jabfm.org/lookup/external-ref?access_num=000264958800018&link_type=ISI) 53. 53.Miles MB, Huberman AM, Saldana J. Qualitative data analysis: a methods sourcebook, 3rd ed. Thousand Oaks, CA: SAGE Publications; 2014. 54. 54.Miller WL, Crabtree BF. The dance of interpretation. Thousand Oaks, CA: Sage Publications; 1999. 55. 55.Shetty G, Brownson CA. Characteristics of organizational resources and supports for self management in primary care. Diabetes Educ 2007;33:185s–92s. 56. 56.Lehman WE, Greener JM, Simpson DD. Assessing organizational readiness for change. J Subst Abuse Treat 2002;22:197–209. [CrossRef](http://www.jabfm.org/lookup/external-ref?access_num=10.1016/S0740-5472(02)00233-7&link_type=DOI) [PubMed](http://www.jabfm.org/lookup/external-ref?access_num=12072164&link_type=MED&atom=%2Fjabfp%2F32%2F3%2F329.atom) [Web of Science](http://www.jabfm.org/lookup/external-ref?access_num=000176529100004&link_type=ISI)