Abstract
Background: Diabetes care requires management of complex clinical information. We examine the relationship between diabetic outcomes and practices’ use of information.
Methods: We performed a cross-sectional, secondary analysis of baseline data from 50 community primary care practices participating in a practice improvement project. Medical record review assessed clinical targets for diabetes (HbA1c ≤8, LDL ≤100, BP ≤130/85). Practices’ use of information was derived from clinician responses to a survey on their use of clinical information systems for patient identification and tracking. Hierarchical linear modeling examined relationships between patient outcomes and practice use of information, controlling for patient level covariates (age, gender, hypertension, and cardiovascular comorbidities) and practice level covariates (solo/group, and electronic health record [EHR] presence).
Results: Practices’ use of identification and tracking systems significantly (P < .007 and 0.002) increased odds of achieving diabetes care targets (odds ratio [OR] 1.23 95%, confidence interval [CI] 1.06 to 1.44, and OR 1.32 95% CI 1.11 to 1.59). For diabetic patients with hypertension, odds of hypertension control were higher with higher use of tracking systems (OR = 1.52, P = .0017) and reflected similar trend with higher use of identification systems (OR = 1.28, P = .1349). EHR presence was not associated with attainment of clinical targets.
Conclusions: Use of relatively simple systems to identify and track patient information can improve diabetic care outcomes. Practices making investments in an EHR must recognize that this technology alone is not sufficient for achieving desirable clinical outcomes. Researchers must explore the interrelationships of organizational factors necessary for successful information use.
Although a gap exists between guidelines and practice in diabetic patient care,1 increasing evidence suggests guideline application efforts require prioritization and customization to those patients who are most at risk from complications and who would benefit most from interventions.2 Consequently both practitioners and researchers are challenged to apply interventions to minimize resources and maximize results.
Primary care of diabetic patients requires access to and management of complex clinical information. Primary care practices deal with multiple competing demands,3 and the ability to identify at risk patients4 and track their management and prevention parameters are important information needs.5 Therefore, clinical information systems should help focus scarce practice resources on patients most at risk. However, the ability to meet these information needs in primary care practices is increasingly challenged by a host of factors, including rapid scientific advances,6 financial pressures to increase patient throughput7 and limit expenditures,8 and discontinuity of care caused by patient mobility,9 insurance turnover,10 and the provision of care through multiple providers.11 Rather than being used as excuses, these challenges actually provide reasons for better information systems. Information cannot be retained in the memory of a single clinician or buried in longitudinal progress notes and at the same time be reliably available for decision making. Reconciling information needs with practice resources remains a challenge.
Recent models for improving quality12–14 advocate expanding interventions beyond clinicians and effecting change in the practice as an organization. Although some models have advocated considerable investment in infrastructure such as EHR,15,16 and personnel,14 a model for change and improvement developed by our research team focuses on the importance of practice work relationships and incorporates the concept of interdependent practice organizational attributes.17 One organizational attribute is the practice's capacity to access and use information to deliver quality care.18 The use of clinical information systems is one aspect of this capacity hypothesized as supporting individual and organizational decision making.19 Whether electronic or paper, these information systems identify at-risk patients and track relevant prevention and treatment parameters.
In this study, we empirically test 3 hypotheses, which were developed a priori: Hypothesis 1 (H1), the use of clinical information systems favorably impacts patient-level measures of diabetes assessment, treatment and achievement of targets among all diabetic patients; H2, information use favorably impacts patient level measures particularly in diabetics with comorbidities; and H3, information use favorably impacts hypertensive control in diabetics with hypertension. H2 and H3 examine practice information use for those patients with more complex decision making information needs, at greater risk and who would benefit the most from intervention.
Methods
Study Design and Data Collection
This secondary analysis focused on cross-sectional data from 56 group and solo New Jersey and Pennsylvania family medicine practices participating in ULTRA (Using Learning Teams for Reflective Adaptation), an intervention study20 aimed at improving adherence to guidelines for multiple conditions. Six practices were eliminated because of insufficient data (0% response rate on clinician surveys). Chart auditors retrospectively assessed each practice's adherence to diabetes guidelines in up to 20 patients randomly selected from a list of all adult patients within the past year treated for diabetes (ICD-9 codes 250.00–250.91). Some practices had fewer than 20 patients that could be identified using ICD-9 codes. Individual and interauditor reliability was assessed several times throughout the course of data collection. Clinicians (physicians, NPs, PAs) completed a 20-minute self-administered organizational survey that included items intended to assess their use of clinical information systems. This study was approved by the University of Medicine and Dentistry of New Jersey institutional review board.
Measures
The primary outcome measure was adherence to diabetic care guidelines developed by research team by adapting clinical practice guidelines of the American Diabetes Association.21 These guidelines can comprise 3 components: assessment, treatment, and attainment of targets. Individual items that are included in each of these components are described in Table 1. These analyses focused on the effect of information system use on the attainment of quality comprehensive care for diabetes as measured by each guideline component rather than individual items of the guideline components.
Description of Dependent Variables in Diabetes Guidelines
Main independent variables were use of clinical information systems and presence of comorbid diseases. The use of clinical information systems was divided into 2 categories: 1) Identification of patients (assessed by 2 questions: “How often do you use a patient registry to track patients with specific conditions?” and “How often do you use a health risk assessment protocol or questionnaire to identify patients who may benefit from counseling or other interventions targeting 4 health behaviors [tobacco use, alcohol use, eating habits/patterns, physical activity]?”); and 2) tracking systems (assessed by 4 questions: “How often do use computerized clinician reminders?”, “How often do you use checklists/flowsheets in general?”, “How often do you use checklists/flowsheets for chronic disease?”, and “How often do you use risk factor chart stickers?”). Clinicians rated each item on a 5-point Likert scale (1, never; 5, always). For each independent variable category, clinicians were assigned the maximum value of all items comprising that category. For instance, of the 2 patient identification items, a clinician was assigned a score of 5 if he or she scored 4 on one item and 5 on the other. A practice's overall score was the average of clinicians’ maximums. Maximums were used to assess clinicians’ use of any of these systems and reflects the variety of information systems (eg, computer or paper) that exist among practices and clinicians within practices. Moreover, using averages didn't substantially alter the findings.
Two comorbid conditions were recorded from each chart, if present: hypertension and heart disease (coronary artery bypass graft, stent, myocardial infarction, angina, congestive heart failure). Additional patient level covariates included age and gender. Other patient level variables were not available through chart audit. Practice level covariates included solo or not and presence of EHR.
Analysis
Hierarchical logistic regression22 assessed the association between a practice's use of clinical information systems and patient-level measures of diabetes assessment, treatment and achievement of targets (H1). Specifically, generalized estimating equations, via the GENMOD procedure within SAS,23 estimated log-odds adherence as a function of practice- and patient-level covariates. Standard errors for estimates were adjusted to account for correlation between patients within a practice through use of a working correlation matrix with an exchangeable structure. Type III score tests were used to evaluate main effects of identification and tracking systems.
These analyses were stratified by comorbidity. We hypothesized (H2) that information systems would favorably affect outcomes in diabetic patients with comorbidities because of more complex decision-making information needs.
Additional analyses to explore the thesis around more complex decision-making information needs looked at patients with both diabetes and hypertension. Rather than examine the effect of hypertension as a comorbid condition on the impact of diabetic care information systems, this analysis explored the hypothesis: Information systems would effect coexisting condition outcomes (H3).
Results
Description of Practices, Patients, and Use of Clinical Information Systems
Overall, 69.5% of the clinicians returned a completed organizational survey that provided information on their use of clinical information systems. For individual practices, response rates ranged from 25% to 100%, with an average practice response rate of 73.8% for the 50 practices.
Of 50 practices, 9 were solo and 13 used EHRs. Practices differed with respect to the Identification of Patients scale (mean = 3.24, SD = 0.86), with 10 falling between 4.0 and 5.0 and, at the low end, 2 in the range from 1.0 to 1.9. The scale for Tracking Systems demonstrated similar differences between practices (mean = 3.54, SD = 0.95), with 24 practices scoring between 4.0 and 5.0 and 4 between 1.0 and 1.9.
Of the 883 patients eligible for inclusion, 49% were male and the mean age was 60.1 years (SD = 14.3). A total of 16.0% of the patients had heart disease and 62.5% were diagnosed with hypertension. Across the 50 practices, mean rates of adherence for assessment, treatment, achievement of 2 of 3 targets and achievement of all 3 targets were 55% (SD = 25%), 64% (SD = 19%), 49% (SD = 14%), and 11% (SD = 9%), respectively.
(H1) Use of Clinical Information Systems Favorably Impacts Patient-Level Measures of Diabetes Assessment, Treatment and Achievement of Targets Among All Diabetic Patients
Table 2 summarizes the main effects of the use of clinical information systems on adherence to guidelines. The use of identification systems, whether through health risk assessment protocols or a registry was found to significantly improve the partial achievement of targets (at least 2 of 3 targets, P = .007), but not adherence to assessment or treatment guidelines. Subsequent analyses of individual targets demonstrated that this significance was largely due to achievement of blood pressure targets (P = .0420).
OR, P values, and 95% CI for the effect of Clinical Information Systems Use (Measured as an Average of Clinician Usage Scores on Adherence to Diabetes Care Guidelines, Controlling for Patient- and Practice-Level Covariates)*
The use of tracking systems, including computerized clinician reminders, checklists/flowcharts in general, checklists/flowcharts for chronic disease or risk factor chart stickers, also significantly increased the odds of partial achievement of targets (P = .002) for patients with diabetes, but not the odds of appropriate assessment or treatment. Subsequent analyses of individual targets demonstrated that this significance was due to both achievement of blood pressure as well as LDL targets (P = .0027 and 0.0420, respectively).
(H2) Use of Clinical Information Systems Favorably Impacts Patient Level Diabetes Measures Particularly in Diabetic Patients with Comorbidities
Table 3 presents the odds ratios and P values describing the effectiveness of each information system component at improving diabetes care among patients with hypertension or a heart condition or neither. Use of tracking systems was associated with increased odds of achievement of diabetes targets (both partial and full, P = .010 and 0.027) in patients with hypertension. For example, patients’ odds of achievement of 2 of 3 targets were increased by 23% in practices in which the usage of patient identification systems was increased by 1 point (on a scale of 1 to 5).
OR and P Values Describing the Effect of Clinical Information Systems Use (Measured as an Average of Clinician Usage Scores) on Adherence to Diabetes Care Guidelines Among Patients With and Without Comorbid Conditions*
Identification systems was also associated with increased odds of achievement of all 3 targets (P = .029). A negative relationship was found between the use of identification systems and achievement of treatment guidelines (P = .015) in patients with hypertension, although this relationship did not carry over into achievement of targets (P = .284 and 0.651).
(H3) Use of Clinical Information Systems Favorably Impacts Hypertensive Control in Diabetics with Hypertension
For patients with diabetes and hypertension, the odds of achieving target blood pressure were higher if the practice had more frequent use of tracking systems (OR = 1.52, P = .0017) and reflected a similar trend with more frequent use of identification systems (OR = 1.28, P = .1349).
Discussion
This study suggests that the use of relatively simple systems to identify and track patient information may improve diabetic care outcomes. Furthermore the effect was slightly stronger in the management of higher risk diabetic patients with hypertension or heart condition as comorbid conditions. Furthermore, among diabetic patients with coexisting hypertension, both identification and tracking systems favorably impacted hypertensive control. Providing care to these high-risk diabetic patients requires management of more complex information for decision making. In other organizational settings the access to information and in particular the use of information impacts performance through influencing work relationships for better decision making, learning, and task execution.24,25
Although we found no relationship with measures of assessment and treatment (process measures), a finding reflected also in mixed results from other studies,26,27 outcomes still remain most relevant. If the current conceptualization of processes and outcomes is not consistent with real-world practices, perhaps exploring further the capacity of a practice to access and use information can enhance our understanding of these presumed connections and assist in implementing guidelines.
Although drawn from cross-sectional data, our results suggest as in other studies28–30 that relatively modest practice efforts might be associated with significantly improved outcomes of diabetes care. Our findings are particular salient because the majority of primary care practices are smaller, independent practices31,32 such as those represented in our study.
Interestingly, this study also suggests that practices can achieve better outcomes without reliance on highly expensive office systems for patient identification and tracking. Our results are consistent with previous reports,33–37 and should caution the rush to EHR implementation as an automatic fix for quality-of-care issues. In fact combining results from this analysis and another34 suggest that practices with identification systems (if used in conjunction with an EHR) seem to do better on patient care despite the EHR, rather than because of any advantage provided by the EHR. EHR design and implementation requires specific attention to how information is accessed and used for identification and tracking chronic care patients. Whether implementing more technologically sophisticated or relatively simpler information systems, practitioner and research attention should be extended to reasons why some practices not only choose a particular system or combination but also why the variation in their effective incorporation. As in other organizational settings, paying attention to social factors like the characteristics of work relationships may be salient.38,39
Strengths of this study include participation by smaller community practices that are independent or owned by loosely organized health systems, and using process and outcome measures for diabetes. There are also limitations. Survey questions regarding information system usage were not specific to diabetes care and, thus, the positive associations with diabetes care need confirmation. However, diabetes is highly prevalent in practices, and one would expect diabetes to have been considered in responses to the survey. Further, clinician self-report on the extent of use of information systems may have been less accurate than, for example, direct observation of that use.
Finally, one finding remains unexplained. Those practices with high use of identification systems seemed to reflect poorer treatment adherence in patients with hypertension. However, even these patients in the higher-use group had better scores (treated better) than those patients without any comorbid condition, and we did not see this negative effect translate into achieving targets.
Overall, for practicing clinicians, these results suggest that efforts summarizing patient specific clinical information are not misplaced, and that expensive technology is not always necessary for achieving good outcomes. For researchers, the conceptualization of practices’ capacity to access and use information needs refinement to expand the framework beyond clinical information systems. Acquiring, distributing, and using the best clinical information at the point of service are no longer sufficient to achieving successful outcomes.40–42 Practices must also incorporate processes to share and develop40,41 information or knowledge to impact care by enhancing organizational as well as individual decision making and learning. Knowledge Management24,43,44 and related disciplines and practices such as organizational learning, organizational knowledge, and learning organization19,45 may provide fruitful exploration. In addition, this refinement must also explore the interdependencies of this capacity with other organizational attributes such as leadership, motivation, and office relationships.17,18 Such an integrative framework may better inform future research on how diabetes care and primary care delivery generally can be improved in the context of a myriad of competing demands, limited practice resources, and a misaligned health system.
Notes
This article was externally peer reviewed.
Funding: This work was supported by Agency for Healthcare Research and Quality grant K08 HS14018 and National Heart, Lung, and Blood Institute grant R01 HL070800.
Conflicts of interest: none declared.
- Received for publication October 29, 2006.
- Revision received February 2, 2007.
- Accepted for publication February 12, 2007.
References
Jump to section
Related Articles
Cited By...
- 2017 National Standards for Diabetes Self-Management Education and Support
- 2017 National Standards for Diabetes Self-Management Education and Support
- Accelerated Adoption of Advanced Health Information Technology in Beacon Community Health Centers
- Outpatient EHR-Based Diabetes Clinical Decision Support That Works: Lessons Learned From Implementing Diabetes Wizard
- Using Electronic Health Records to Improve Outpatient Diabetes Care: Preface
- Methylselenocysteine Resets the Rhythmic Expression of Circadian and Growth-Regulatory Genes Disrupted by Nitrosomethylurea In vivo
- Features of the Chronic Care Model (CCM) Associated with Behavioral Counseling and Diabetes Care in Community Primary Care
- Diabetes Flow Sheet Use Associated With Guideline Adherence