A Logic Model Framework for Evaluation and Planning in a Primary Care Practice-based Research Network (PBRN) ============================================================================================================ * Holly Hayes * Michael L. Parchman * Ray Howard ## Abstract Evaluating effective growth and development of a practice-based research network (PBRN) can be challenging. The purpose of this article is to describe the development of a logic model and how the framework has been used for planning and evaluation in a primary care PBRN. An evaluation team was formed consisting of the PBRN directors, staff, and its board members. After the mission and the target audience were determined, facilitated meetings and discussions were held with stakeholders to identify the assumptions, inputs, activities, outputs, outcomes, and outcome indicators. The long-term outcomes outlined in the final logic model are 2-fold: (1) improved health outcomes of patients served by PBRN community clinicians and (2) community clinicians are recognized leaders of quality research projects. The logic model proved useful in identifying stakeholder interests and dissemination activities as an area that required more attention in the PBRN. The logic model approach is a useful planning tool and project management resource that increases the probability that the PBRN mission will be successfully implemented. * Evaluation * Logic Model * Practice-based Research With the heightened emphasis on translational and comparative effectiveness research to improve patient outcomes, practice-based research networks (PBRNs) have an unprecedented opportunity to become effective laboratories to address high priority research questions. As PBRNs engage in more funded research, these research dollars come with increased accountability to demonstrate the effectiveness of the work conducted in PBRNs. Despite a significant growth in the number of PBRNs over the past 15 years, little is known about effective and useful methods of evaluating PBRNs.1 One method with significant potential for PBRN evaluation and planning is a logic model. ### What Is a Logic Model? The logic model has proven to be a successful tool for program planning as well as implementation and performance management in numerous fields, including primary care.2(#ref-3)(#ref-4)(#ref-5)(#ref-6)(#ref-7)(#ref-8)(#ref-9)(#ref-10)(#ref-11)(#ref-12)(#ref-13)–14 A logic model (see Figure 1) is defined as a graphical/textual representation of how a program is intended to work and links outcomes with processes and the theoretical assumptions of the program.6 It is a depiction of a program or project showing what the program or project will do and what it is to accomplish. It is a series of “if then” relationships that, if implemented as intended, lead to the desired outcomes. Stated another way, it is a framework for describing the relationships between resources, activities and results as they related to a specific program or project goal. The logic model also helps to make underlying assumptions about the program or project explicit. It provides a common approach to integrating planning, implementation and evaluation. Figure 1 defines the key components of a logic model and what variables are included for each section. ![Figure 1.](http://www.jabfm.org/https://www.jabfm.org/content/jabfp/24/5/576/F1.medium.gif) [Figure 1.](http://www.jabfm.org/content/24/5/576/F1) Figure 1. Program/logic model framework. ### Why Use a Logic Model? A logic model is an efficient tool that requires little resources other than personnel time. Because evaluation dollars are not usually set aside in PBRN budgets, the cost-efficiency of this framework is attractive. In addition, the process of developing the logic model requires PBRN team members to work together in a manner that has a side benefit of improving team relationships and focus. A logic model can also provide much needed detail about how resources and activities can be connected with the desired results which helps with project management, resource allocation, and strategic planning.2(#ref-3)(#ref-4)(#ref-5)(#ref-6)(#ref-7)(#ref-8)(#ref-9)(#ref-10)(#ref-11)(#ref-12)(#ref-13)–14 The process of developing the logic model also facilitates critical thinking through the process of planning and communicating network objectives and outcomes. According to the Kellogg Foundation, the development of a logic model is a “conscious process that creates an explicit understanding of the challenges ahead, the resources available, and the timetable in which to hit the target.”6 For more detailed information regarding logic models, refer to the W.K. Kellogg Foundation Logic Model Development Guide.6 To date, there are no publications demonstrating how a logic model framework can be used for evaluation and program planning in a primary care PBRN. The purpose of this article is to describe the development of a logic model and how the framework has been used in a primary care PBRN, the South Texas Ambulatory Research Network (STARNet). ### Setting and Context STARNet was founded in 1992 “*to conduct & disseminate practice-based research that results in new knowledge and improves the health of patients in South Texas*.” STARNet has 165 practitioners in 108 primary care practices. These are primarily small group practices or solo practitioners located throughout south Texas—spanning a territory from the southernmost Mexico/Texas border to north central Austin, Texas. Over the years, STARNet has published more than 20 peer-reviewed manuscripts of research findings from studies conducted in member primary care practice settings.15(#ref-16)(#ref-17)(#ref-18)(#ref-19)(#ref-20)(#ref-21)(#ref-22)(#ref-23)(#ref-24)(#ref-25)(#ref-26)(#ref-27)(#ref-28)(#ref-29)(#ref-30)(#ref-31)(#ref-32)(#ref-33)–34 ### Development of a Logic Model #### Step 1: Agree on the Mission and Target Audience The STARNet Board of Directors had previously agreed that the primary goal of all STARNet projects is to improve the health of primary care patients in South Texas. The board believed that to achieve this goal, STARNet clinicians and academic investigators (Target Audiences) were both equally critical for the success of the network. Investigators facilitate the research process and pursue grant opportunities for the overall sustainability of the network and STARNet clinicians are needed to frame and define the research questions that are relevant to their daily practice and assist in the interpretation of results. #### Step 2: Identify and Describe Assumptions, Inputs, and Activities After defining the mission and the target audience, the STARNet coordinator and evaluation specialist facilitated 10 meetings and discussions with key stakeholders over a 6-month period. Stakeholders at the meetings included STARNet Board of Directors who are full-time primary care clinicians in family and internal medicine, practice facilitators who visit clinics regularly and assist with change processes, and two STARNet directors with more than 10 years of experience with the Network and STARNet partners including the School of Public Health and the South Texas Area Health Education Center. This group was tasked with identifying the assumptions, inputs, and activities for the STARNet logic model. Assumptions are identified elements that you assume are in place and necessary to carrying out your strategies. For example, one assumption for PBRN research is that clinicians have time to participate in PBRN research and that investigators have funded grants that will contribute to network support. Once assumptions are identified, inputs are defined. Inputs include a list of identified resources (e.g., Network directors with clinical expertise and connections with the community) as well as constraints (e.g., lack of discretionary funds for relationship-building—food, small gifts). After assumptions and inputs are defined, the activities are described for the program that meets the needs of the target audience. Because the network has existed for over 18 years, it took a concerted effort on all members to think beyond current and past activities and initiatives. The coordinator encouraged the team to place equal attention to thinking about STARNet's past and current activities and what activities need to take place to fulfill its mission. Well-designed activities are an essential element for logic model development. For STARNet, if activities could not be linked directly or deemed relevant to the two long-term outcomes (improved health outcomes of patients and clinician-led research projects), they would not be included in the logic model. #### Step 3: Identify Outputs, Outcomes, and Outcome Indicators To demonstrate STARNet's growth and development, it was necessary to identify the specific outputs and outcomes necessary to fulfill its mission. Outputs are the actual deliverables or the units of service specific to STARNet—what occurs as a result of the planned activities. For example, the specific output for recruiting STARNet clinicians to the network is the number of new network members. The outcome is the actual impact and change associated with each output and is typically broken down into short-term (1 to 3 years), intermediate (3 to 5 years), and long-term (5 to 10 years). For example, an outcome that would apply to most PBRNs would be the development of the research and resource capacity of the STARNet clinicians (short-term) would lead to an increase in the number/quality of research projects in which STARNet clinicians participate (intermediate), which would in turn result in STARNet clinicians becoming recognized leaders of quality research projects (long-term). Once the outcomes were identified, we created the outcome indicators. The outcome indicators are the milestones that can be observed and measured toward meeting the program's mission. These measures are an indicator of how successful your program is in making progress toward the identified goals. The most time-consuming component of the logic model process was identifying the activities, outputs and outcomes, especially ensuring that linkages existed between these three components. Developing meaningful outcomes that would be useful for grants, reports, publications and that informed members was the most difficult exercise during the logic model development process. The evaluation specialist was extremely helpful in assisting the logic model team in determining what outcomes were important enough to measure. The initial model was circulated to the group several times through e-mail and monthly meetings and further refined in an iterative process. ### Final Logic Model As a result of the above activities, the logic model in Figure 2 was agreed on by all members. The logic model begins with the target population and underlying assumptions and leads into the inputs, activities, outputs and outcomes (short-term, intermediate, and long-term). The long-term outcomes of STARNet are 2-fold: (1) improved health outcomes of patients served by STARNet clinicians and (2) STARNet clinicians are recognized leaders of quality research projects. Every input, activity, and outcome in STARNet's logic model can be linked back to these two long-term outcomes—our mission's “bull's eye.” ![Figure 2.](http://www.jabfm.org/https://www.jabfm.org/content/jabfp/24/5/576/F2.medium.gif) [Figure 2.](http://www.jabfm.org/content/24/5/576/F2) Figure 2. South Texas Ambulatory Research Network (STARNet) logic model. ### Application of the Logic Model to PBRN Activities Development of the logic model was considered only an initial phase in the process of evaluating, planning and developing the network. It remained clear throughout the process that an ongoing review and refinement of the logic model would be necessary to ensure that the PBRN implementation activities remained consistent with established outcomes. ### Collecting Outcome Data The group agreed that the first step in using our logic model would be to track the key indicators outlined in the outcomes. The group created detailed “to-do” lists based on the logic model, quarterly reports, and updated board member job descriptions. STARNet staff made a concerted effort to collect data on all the outputs in an excel spreadsheet. Thus, the logic model informed and focused staff on what specific data needed to be recorded. The STARNet coordinator is charged with collecting all the quantitative process and qualitative data each year. Detailed minutes and recordings are now being kept for the following meetings: network staff, all membership, board of directors, and one-on-one site visits with STARNet clinicians. Qualitative data has proven to be very important in documenting the extent of involvement of members in network activities (output 9), not just the number involved, and network contextual changes. ### Assessing PBRN Progress The team meets monthly to assess progress and perform an internal evaluation based on logic model activities, outputs, and outcomes. One example of this use of the logic model occurred when we discussed our progress toward conducting the activities outlined in the logic model framework during one of our monthly meetings. It was obvious that no efforts had been made to “disseminate research findings” to the network members and the broader community (Activity 9 and Output 6). The Board of Directors and STARNet leadership considered this to be a major process gap if the ultimate outcome is to improve patient health. As a result, STARNet is currently working with the University of Texas School Of Public Health and the South Central Area Health Education Center (AHEC) to create two comprehensive social marketing plans regarding research findings of studies conducted in STARNet for clinicians and their staff as well as patients. STARNet Directors and members will participate in focus groups in summer 2011 to develop a strategic communication and dissemination plan. This exemplifies how the logic model can also be used for problem identification and re-allocation of resources to meet a predetermined outcome. Another example of the value of our logic model is when the STARNet Board of Directors decided to take a more proactive role in the financial status of the network. Board agendas now include a financial report at every meeting. STARNet recently became an incorporated nonprofit and has updated by-laws and elected officers to Executive Committee. The Board of Directors considers these as crucial steps in meeting the mission of the network and is now developing a business plan to assist with future planning. ## Discussion Subsequent to initiating our work on a logic model, Bleeker35 and colleagues from the Netherlands identified only two existing PBRN evaluation tools. These tools were developed by Clement36 and Fenton37 to evaluate the overall effectiveness of PBRNs. Clement36 proposed a conceptual framework to evaluate primary care PBRNs, based on seven primary objectives with specific process and outcome indicators. The objectives could be categorized into network infrastructure, activity, and dissemination efforts. Based on our review of the evaluation framework proposed by Clement,36 it appeared to be a very usable and feasible tool for implementation. However, Bleeker35 questioned the validity of these indicators and the feasibility of Clement's framework for conducting an overall evaluation. Fenton37 and colleagues developed the second identified evaluation tool, a Primary Care Research Network Toolkit, which includes a contextualized case study of five networks in the United Kingdom. This toolkit described eight primary dimensions of networks—each one with associated subdimensions. Networks could score themselves over time and even conduct comparisons across networks. Although the Primary Care Research Network Toolkit may be useful in conducting formal evaluations, it lacked sufficient information regarding resources and time needed to successfully replicate the process in the United States. Considering the relative limited resources of PBRNs, it is not surprising that a majority of PBRNs have not conducted a thorough evaluation of their efforts. Although evaluating a network takes time and requires the involvement of various individuals throughout the process, outcome evaluation efforts are a worthwhile investment. Unfortunately, we realized early on that our budget would not allow us to complete all the activities outlined in the logic model. It became important to prioritize activities within the logic model due to budget constraints. The logic model should be modified regularly based on the changing capacity and resources of the network. It is yet to be proven whether our logic model framework will meet the planning and evaluation needs of STARNet. In addition, logic models can be a tremendous tool in determining what is working well and what is not. The board of directors continually reminded the staff that all the activities need to be centered on the mission—improving patient care. As a result, all the activities—planned and not planned—are viewed critically from that perspective. It is important to note, however, that every activity cannot be linked directly to long-term outcomes. Based on the logic model framework, the co-directors turned away investigators wanting to initiate projects in the network that did not meet the current priorities of the members. This was one of the first times in the history of the Network that it appropriately said “no” to an incompatible research interest. The logic model, in essence, united and empowered the efforts of members in advancing the STARNet mission. Finally, the logic model reminded the PBRN team that a balance has to be maintained between the hard/traditional measures such as number of studies and publications and the more subjective measures such as easy access to PBRN member offices by PBRN coordinators and researchers. In addition, the core tenet of successful PBRNs is developing and maintaining respectful and trusting long-term relationships that continue beyond research studies.38 The complexity of the relationships and communication within a network is difficult to capture in evaluation efforts. The logic model helped us realize that it's not just about the quantitative outcomes. To share a comprehensive story of STARNet, we also began to collect qualitative data (e.g., rich stories from the members). The logic model helped us realize that in the future, we need to collect this data more systematically from members and patients following the completion of research studies. ## Conclusion In conclusion, we found the logic model to be an effective planning and evaluation tool and a useful project management resource that greatly increases the probability that PBRN goals will be reached consistent with its mission. The logic model framework not only helped facilitate the Network evaluation process, but equally important, it engaged the leadership and members in a meaningful way. As a result, the board of directors, community clinician members, academic investigators, and staff all have taken a more proactive role working together to advance the STARNet mission. ## Acknowledgments The authors would like to thank the members of the South Texas Ambulatory Research Network for their support and contribution to this study. ## Notes * This article was externally peer reviewed. * *Funding:* Funding for this study was provided by Clinical Translational Science Award No. UL1RR025767 from NCRR/NIH to the University of Texas Health Sciences Center at San Antonio. * *Conflict of interest:* none. * Received for publication February 9, 2011. * Revision received May 10, 2011. * Accepted for publication May 16, 2011. ## References 1. 1. AHRQ PBRN Resource Center. PBRN networks listed by acronym. Available at [http://pbrn.ahrq.gov/portal/server.pt/community/practice\_based\_research\_networks](http://pbrn.ahrq.gov/portal/server.pt/community/practice_based_research_networks). 2. 2. Frechtling JA. Logic modeling methods in program evaluation. San Francisco: Jossey-Bass; 2007. 3. 3. Knowlton LW, Phillips CC. The logic model guidebook: Better strategies for great results. Los Angeles: Sage; 2009. 4. 4. 1. Wholey JS, 2. Hatny HP, 3. Newcomer KE McLaughlin JA, Jordan GB. Using logic models. In: Wholey JS, Hatny HP, Newcomer KE eds. Handbook of practical program evaluation. San Francisco, CA: Jossey-Bass Inc; 2004:7–32. 5. 5. University of Wisconsin Extension: Program Development and Evaluation. Logic Model. Available at [http://www.uwex.edu/ces/pdande/evaluation/evallogicmodel.html](http://www.uwex.edu/ces/pdande/evaluation/evallogicmodel.html). 6. 6. WK Kellogg Foundation. Using logic models to bring together planning, evaluation and action: logic model development guide. 2004. 7. 7. Innovation Network. Logic Model Workbook. Available at [http://www.innonet.org/client\_docs/File/logic\_model\_workbook.pdf](http://www.innonet.org/client_docs/File/logic_model_workbook.pdf). 8. 8. Kaplan S, Garrett K. The use of logic models by community based initiatives. Evaluation and Program Planning 2005;28:167–72. [CrossRef](http://www.jabfm.org/lookup/external-ref?access_num=10.1016/j.evalprogplan.2004.09.002&link_type=DOI) [Web of Science](http://www.jabfm.org/lookup/external-ref?access_num=000228259800005&link_type=ISI) 9. 9. McLaughlin J, Jordan G. Logic models: a tool for testing your program's performance story. Evaluation and Program Planning 1999;22:65–72. [CrossRef](http://www.jabfm.org/lookup/external-ref?access_num=10.1016/S0149-7189(98)00042-1&link_type=DOI) [Web of Science](http://www.jabfm.org/lookup/external-ref?access_num=000080053500008&link_type=ISI) 10. 10. Taylor-Powell E. Building capacity in evaluating outcomes. Madison, WI: University of Wisconsin-Extension, Cooperative Extension, Program Development and Evaluation; 2008. 11. 11. Taylor-Powell E, Jones AL, Henert E. Enhancing program performance with logic models. 2009. Available at [http://www.uwex.edu/ces/lmcourse](http://www.uwex.edu/ces/lmcourse). 12. 12. Ribeiro I, Torres A, Parra D, et al. Using logic models as iterative tools for planning and evaluating physical activity promotion programs in Curitiba, Brazil. J Physical Activity Health 2010;S155–62. 13. 13. Stinson S, Wilkinson C. Creating a successful clinical extern program using a program planning logic model. J Nurses Staff Development 2004;140–144. 14. 14. Burge SK, Schneider FD, Ivy L, Catala S. Patients' advice to physicians about intervening in family conflict. Ann Fam Med 2005;3:248–54. [Abstract/FREE Full Text](http://www.jabfm.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6ODoiYW5uYWxzZm0iO3M6NToicmVzaWQiO3M6NzoiMy8zLzI0OCI7czo0OiJhdG9tIjtzOjIwOiIvamFiZnAvMjQvNS81NzYuYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 15. 15. Dergance JM, Calmbach WL, Dhanda R, et al. Barriers to and benefits of leisure time physical activity in the elderly: differences across cultures. J Am Geriatr Soc 2003;51:863–8. [CrossRef](http://www.jabfm.org/lookup/external-ref?access_num=10.1046/j.1365-2389.2003.51271.x&link_type=DOI) [PubMed](http://www.jabfm.org/lookup/external-ref?access_num=12757577&link_type=MED&atom=%2Fjabfp%2F24%2F5%2F576.atom) [Web of Science](http://www.jabfm.org/lookup/external-ref?access_num=000183049200020&link_type=ISI) 16. 16. Katerndahl DA, Trammell C. Prevalence and recognition of panic states in STARNET patients presenting with chest pain. J Fam Pract 1997;45:54–63. [PubMed](http://www.jabfm.org/lookup/external-ref?access_num=9228915&link_type=MED&atom=%2Fjabfp%2F24%2F5%2F576.atom) [Web of Science](http://www.jabfm.org/lookup/external-ref?access_num=A1997XK68300009&link_type=ISI) 17. 17. Katerndahl DA. Diagnosing panic attacks in chest pain patients. Strat Med 1998;2:12–7. 18. 18. Mouton CP, Calmbach WL, Dhanda R, et al. Barriers and benefits to leisure-time physical activity among older Mexican Americans. Arch Fam Med 2000;9:892–7. [CrossRef](http://www.jabfm.org/lookup/external-ref?access_num=10.1001/archfami.9.9.892&link_type=DOI) [PubMed](http://www.jabfm.org/lookup/external-ref?access_num=11031397&link_type=MED&atom=%2Fjabfp%2F24%2F5%2F576.atom) [Web of Science](http://www.jabfm.org/lookup/external-ref?access_num=000089957400021&link_type=ISI) 19. 19. Parchman ML, Burge SK. Continuity and quality of care in type 2 diabetes: a Residency Research Network of South Texas study. J Fam Pract 2002;51:619–24. [PubMed](http://www.jabfm.org/lookup/external-ref?access_num=12160500&link_type=MED&atom=%2Fjabfp%2F24%2F5%2F576.atom) 20. 20. Parchman ML, Romero RL, Pugh JA. Encounters by patients with type 2 diabetes: complex and demanding: an observational study. Ann Fam Med 2006;4:40–5. [Abstract/FREE Full Text](http://www.jabfm.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6ODoiYW5uYWxzZm0iO3M6NToicmVzaWQiO3M6NjoiNC8xLzQwIjtzOjQ6ImF0b20iO3M6MjA6Ii9qYWJmcC8yNC81LzU3Ni5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 21. 21. Wen L, Parchman ML, Linn WD, Lee S. Association between self-monitoring of blood glucose and glycemic control in patients with type 2 diabetes mellitus. Am J Health Syst Pharm 2004;61:2401–5. [Abstract/FREE Full Text](http://www.jabfm.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NDoiYWpocCI7czo1OiJyZXNpZCI7czoxMDoiNjEvMjIvMjQwMSI7czo0OiJhdG9tIjtzOjIwOiIvamFiZnAvMjQvNS81NzYuYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 22. 22. Wen LK, Parchman ML, Shepherd MD. Family support and diet barriers among older Hispanic adults with type 2 diabetes. Fam Med 2004;36:423–30. [PubMed](http://www.jabfm.org/lookup/external-ref?access_num=15181555&link_type=MED&atom=%2Fjabfp%2F24%2F5%2F576.atom) [Web of Science](http://www.jabfm.org/lookup/external-ref?access_num=000221888700013&link_type=ISI) 23. 23. Parchman ML, Pugh JA, Romero RL, Bowers KW. The case of elevated glycosylated hemoglobin. Ann Fam Med 2007;5:196–201. [Abstract/FREE Full Text](http://www.jabfm.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6ODoiYW5uYWxzZm0iO3M6NToicmVzaWQiO3M6NzoiNS8zLzE5NiI7czo0OiJhdG9tIjtzOjIwOiIvamFiZnAvMjQvNS81NzYuYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 24. 24. Parchman ML, Pugh JA, Wang CP, Romero RL. Glucose control, self-care behaviors and the presence of the chronic care model in primary care clinics. Diabetes Care 2007;30:2849–54. [Abstract/FREE Full Text](http://www.jabfm.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NzoiZGlhY2FyZSI7czo1OiJyZXNpZCI7czoxMDoiMzAvMTEvMjg0OSI7czo0OiJhdG9tIjtzOjIwOiIvamFiZnAvMjQvNS81NzYuYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 25. 25. Parchman ML, Zeber JE, Romero RL, Pugh JA. Risk of coronary artery disease in type 2 diabetes and delivery of care consistent with the chronic care model in primary care settings: a STARNet Study. Med Care 2007;45:1129–34. [CrossRef](http://www.jabfm.org/lookup/external-ref?access_num=10.1097/MLR.0b013e318148431e&link_type=DOI) [PubMed](http://www.jabfm.org/lookup/external-ref?access_num=18007162&link_type=MED&atom=%2Fjabfp%2F24%2F5%2F576.atom) [Web of Science](http://www.jabfm.org/lookup/external-ref?access_num=000251538700003&link_type=ISI) 26. 26. Kaissi AA, Parchman ML. Assessing chronic illness care for diabetes in primary care clinics. Joint Commission Journal on Quality and Patient Safety 2006;32:318–23. 27. 27. Parchman ML, Pugh JA, Culler SD, et al. A group randomized trial of a complexity-based organizational intervention to improve risk factors for diabetes complications in primary care settings: study protocol. Implement Sci 2008;3:15. [CrossRef](http://www.jabfm.org/lookup/external-ref?access_num=10.1186/1748-5908-3-15&link_type=DOI) [PubMed](http://www.jabfm.org/lookup/external-ref?access_num=18321386&link_type=MED&atom=%2Fjabfp%2F24%2F5%2F576.atom) 28. 28. Parchman M, Kassi AA. Are elements of the chronic care model associated with cardiovascular risk factor control in type 2 diabetes? Jt Comm J Qual Patient Saf 2009;35:133–8. [PubMed](http://www.jabfm.org/lookup/external-ref?access_num=19326804&link_type=MED&atom=%2Fjabfp%2F24%2F5%2F576.atom) 29. 29. Parchman ML, Munoz A. Risk factors for methicillin-resistant Staphylococcal aureus skin and soft tissue infections presenting to primary care clinics: a STARNet study. J Am Board Fam Med 2009;22:375–9. [Abstract/FREE Full Text](http://www.jabfm.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NToiamFiZnAiO3M6NToicmVzaWQiO3M6ODoiMjIvNC8zNzUiO3M6NDoiYXRvbSI7czoyMDoiL2phYmZwLzI0LzUvNTc2LmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 30. 30. Parchman ML, Flannagan D, Ferrer RL, Matamoras M. Communication competence, self-care behaviors and glucose control in patients with type 2 diabetes. Patient Educ Couns 2009;77:50–9. 31. 31. Kaissi AA, Parchman M. Organizational factors associated with self-management behaviors in diabetes in primary care clinics. Diabetes Educator 2009;35:843–50. [Abstract/FREE Full Text](http://www.jabfm.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NToic3B0ZGUiO3M6NToicmVzaWQiO3M6ODoiMzUvNS84NDMiO3M6NDoiYXRvbSI7czoyMDoiL2phYmZwLzI0LzUvNTc2LmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 32. 32. Katerndahl D, Parchman M. Dynamical differences in patient encounters involving uncontrolled diabetes: an orbital decomposition analysis. J Eval Clin Pract 2010;211–9. 33. 33. Nagykaldi Z, Calmbach W, Dealleaume L, et al. Facilitating patient self-management through telephony and web technologies in seasonal influenza. Inform Prim Care 2010;18:9–16. [PubMed](http://www.jabfm.org/lookup/external-ref?access_num=20429974&link_type=MED&atom=%2Fjabfp%2F24%2F5%2F576.atom) 34. 34. Bleeker J, Stalman W, van der Horst H. Evaluating primary care research networks: a review of currently available tools. JABFM 2010;23:465–75. [PubMed](http://www.jabfm.org/lookup/external-ref?access_num=20616289&link_type=MED&atom=%2Fjabfp%2F24%2F5%2F576.atom) 35. 35. Clement S, Pickering A, Rowlands G, et al. Towards a conceptual framework for evaluating primary care research networks. Br J Gen Pract 2000;50:651–2. [Abstract/FREE Full Text](http://www.jabfm.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NDoiYmpncCI7czo1OiJyZXNpZCI7czoxMDoiNTAvNDU3LzY1MSI7czo0OiJhdG9tIjtzOjIwOiIvamFiZnAvMjQvNS81NzYuYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 36. 36. Fenton E, Harvey J, Sturt J. Evaluating primary care research networks. Health Serv Manag Res 2007;162–173. 37. 37. Westfall J, Fagnan LJ, Handley M, et al. Practice-based research is community engagement. JABFM 2009;22:423–7. [PubMed](http://www.jabfm.org/lookup/external-ref?access_num=19587257&link_type=MED&atom=%2Fjabfp%2F24%2F5%2F576.atom)