Abstract
Introduction: Use of electronic prescribing (e-prescribing) can improve safety and reduce costs of care by alerting prescribers to drug-drug interactions, patient nonadherence to therapies, and insurance coverage information. Deriving these benefits will require clinical decision support based on presentation of accurate and complete formulary and benefit (F&B) and medication history (RxH) data to prescribers, but relatively little is known about how this information is used in primary care.
Methods: This is a multimethod comparative case study of 8 practices, which were selected to ensure practice size and physician specialty variation, implementing a stand-alone e-prescribing program. Field researchers observed prescription workflow and interviewed physicians and office staff.
Results: Before implementation, few prescribers reported using F&B references when making medication choices; all used paper-based methods for tracking medication history. After implementation, some prescribers reported using F&B data to inform medication choices but missing information reduced confidence in these resources. Low confidence in RxH data led to paper-based workarounds.
Conclusions: Challenges experienced with formulary checks and RxH documentation led to prescriber distrust and unwillingness to rely on e-prescribing-based information. Greater data accuracy and completeness must be assured if e-prescribing is to meet meaningful use objectives to improve the efficiency and safety of prescribing in primary care settings.
The use of electronic prescribing (e-prescribing) offers the potential to improve the quality, safety, and cost effectiveness of medical care by reducing the risk of adverse drug events and medication errors.1–7 However, use of this technology remains in the early adoption phase,8,9 recently representing approximately 20% of eligible US prescriptions and renewals.10,11 In recognition of the potential for this technology to improve care, the Medicare Prescription Drug Improvement and Modernization Act of 2003 included a mandate that health plans and pharmacies participating in providing the new Medicare prescription drug benefit support e-prescribing.12 More recently, the newly finalized core criteria for the “meaningful use” of health information technologies established under the Health Information Technology for Economic and Clinical Health provisions of the American Recovery and Reinvestment Act of 2009 include requirements for the electronic transmission of prescriptions and the maintenance of a medication history list.13–16 Along with these core criteria, the Office of the National Coordinator for Health Information Technology included in the “menu” set of criteria the implementation of drug formulary checks (see Table 1). Technical standards for e-prescribing systems have been adopted to support these functions, but relatively little is known about how prescribers use the information communicated by these standards in prescribing practice.17
The formulary and benefit (F&B) standard is designed to provide prescribers with information at the point of care to make informed treatment decisions, taking into account the costs to the patient of various treatment options. Using the standard, payers can communicate information about what is approved for insurance coverage (ie, “on formulary”); which medication alternatives are preferred by a particular health plan; patient copayment amounts; benefit-related exclusions (eg, patient age or sex, quantity limitations, step therapies, medical necessity documentation requirements); and requirements for prior authorization before prescribing certain medications. Communication of this information could reduce medication-related health costs by helping prescribers choose the most cost-effective medications for their patients,18 thus potentially improving patient adherence.19 Accurate formulary information also could reduce work in ambulatory care practices by reducing or eliminating calls from pharmacies for responses to formulary-based rejections of insurance coverage, which currently are determined at the pharmacy and then communicated by telephone or fax communication to the prescriber for remedial action.19,20 Evidence does show that when doctors prescribe “on formulary” medications, patients are more likely to follow regimens, perhaps because of lower costs.21,22 The medication history (RxH) standard offers the option of alerting prescribers to potential drug-drug interactions or patient nonadherence to therapies through the inclusion of RxH information derived from prescription medication insurance claims data, thus including both electronic and paper prescriptions written by other prescribers.19,23
Despite the ongoing policy commitment to e-prescribing, relatively little is known about how e-prescribing system–based F&B and RxH information is used in ambulatory care settings, especially in smaller private practices, and how this differs from both planned usage and usage of paper-based resources.24 Previous studies have found that variation in the implementation of health information technologies, such as electronic medical records and e-prescribing, and unrealistic expectations about the capabilities of these systems before implementation contributes to suboptimal usage, indicating that understanding actual rather than planned usage is necessary for accurately determining the effectiveness of health information technology for achieving expected gains.25,26 As part of the pilot testing of e-prescribing standards, we evaluated the use of F&B and RxH information provided by 2 e-prescribing systems used in ambulatory care practices, and we report here the actual usage of these data by clinicians and the extent to which these early adopters were able to meet the objectives of the meaningful use criteria established for e-prescribing in new federal legislation.19,24,27,28
Methods
We conducted a comparative case study of ambulatory medical practices that had not adopted an electronic health record (EHR) to assess how RxH and F&B information was handled before and after the scheduled installation of one of 2 stand-alone e-prescribing systems incorporating e-prescribing F&B and RxH standards: Caremark's iScribe system (Scottsdale, AZ) and Allscripts' TouchScript system (Chicago, IL). (Because the study was not designed to evaluate specific program features, the programs are blinded as program A or B in Table 2). The data collection and analysis procedures used in this study previously have been described in detail.26 As a brief summary, we identified a sample of 12 ambulatory medical practices selected to ensure a mix of physician specialty and practice size from a list of those scheduled to implement either of two commercial e-prescribing programs: the Caremark iScribe or the Allscripts TouchScript systems. Horizon Blue Cross and Blue Shield of New Jersey sponsored system implementation, covering the costs of hardware, software, installation, training, ongoing support, and prescriber honoraria to encourage e-prescribing use in practices that voluntarily signed up for the program.29 Before implementation and again approximately 3 months after scheduled implementation, field researchers visited each practice for 2 to 3 days and used observation and interview guides to observe prescription-related work and conduct key informant and in-depth interviews with practice members.30,31 At baseline and follow-up, physicians and practice staff (including medical assistants, nurses, receptionists, and office managers) were selected for in-depth interviews based on their leadership roles within the practice organization or their involvement in prescription workflow. Field researchers with backgrounds in medical anthropology and labor relations were trained by the lead author (JCC) to ensure standard data collection procedures at baseline and follow-up. These field researchers then conducted key informant interviews with other members of the practice to assess organizational preparation for and adaptation to e-prescribing use. After initial data collection, 10 practices successfully installed e-prescribing; 2 later discontinued use.26 Follow-up data collection for the results reported here focused on assessing practice adaptations to e-prescribing in the 8 practices that had sustained e-prescribing use. Prescribers and practice staff interviewed at baseline were re-interviewed at follow-up, except in a few instances where interviewees had left the practice.
Interview transcripts and field notes were entered into ATLAS.ti (Windows version 6.0.23, Scientific Software Development, Berlin, Germany), and a diverse team of investigators including medical professionals, social scientists, and industry experts coded text data using a template organizing style based on observation and interview guides.32 A process of group and distributed coding of data resulted in substantial agreement (K = 0.72) on the meaning and application of codes before data analysis.26,33 The lead author (JCC) then analyzed coding reports containing text segments relating to RxH and F&B functions to determine common themes and identify representative text segments. The analyses and selection of these segments were then checked with the coauthors (AJS, NI, DSB) to ensure validity.
Results
Both of the e-prescribing programs used in the ambulatory care sites visited for the research reported here received formulary information and RxH data through the currently mandated standards. Practices ranged in size from 1 to 4 physicians and included general internal medicine, family medicine, and obstetrics and gynecology practices that had adopted either of the 2 stand-alone e-prescribing systems (see Table 2). Practices were all independent physician-owned, did not use EHRs, and were located in urban and suburban communities. All practices had indicated an interest in using a stand-alone e-prescribing program through their enrollment in the health plan–sponsored implementation support program and voluntarily enrolled in the program. Both e-prescribing programs were represented among the 8 practices successfully using an e-prescribing system practice-wide at follow up. Use of F&B and RxH resources varied across these sites at baseline. After implementation of the e-prescribing programs, we observed uneven use of electronic F&B and RxH information across the practice sites. This uneven usage was common to both e-prescribing systems used in this study (see Table 3for representative quotes).
Formulary and Benefit
At baseline, practices reported using a variety of paper and electronic resources to identify formulary status, drug coverage, copayment information, and preferred medication choices for patients with particular insurance plans. The use of these resources, including health plan mailings and electronic resources such as Epocrates (Epocrates, Inc., San Mateo, CA), was highly uneven. Many reported that the information is very complex and, because of constantly changing drug benefits, often unreliable. Faced with this complexity and unreliability, many reported ignoring F&B information received from health plans or other sources and relying on patients or pharmacists to alert them to instances where medication costs or other health plan considerations made selection of an alternative medication preferable. Finally, there was tendency to rely on patients' communication of F&B-related messages that the pharmacy receives from the payer and an expectation from some that e-prescribing, once implemented, would help them to better manage this information and use it to help reduce patient costs.
At follow-up, despite implementation of e-prescribing with standard underlying F&B information, variable use of F&B information remained; some prescribers reported that they relied on the new system whereas others continued to ignore formulary information regardless of the source. Some prescribers were convinced of the accuracy of the information and claimed to use it regularly. However, others reported getting misinformation from the program, which led to additional work in the practice; thus, they relied on pharmacists to determine what is covered for each patient.
Medication History
At baseline, all practices were using paper-based systems for tracking the medications that patients had taken or were currently taking. A commonly reported method for collecting this information was to ask patients to report their current medications at each office visit. Others relied on nursing or medical support staff to document current medications but thought that their lists were likely incomplete because of gaps in patients' knowledge about their own medications. Others thought that their medication lists were mostly complete and that prescribers or pharmacists consistently averted drug-drug and drug-allergy interactions. In both cases, the physicians did not seem to believe their current record-keeping systems were in need of improvement.
At follow-up, the e-prescribing systems for tracking RxH were widely reported to be unreliable, and most continued using paper record-keeping systems to track RxH. Part of the reason may have been the belief on the part of prescribers that there was incomplete capture of prescription information because of the use of both paper and electronic systems for prescribing. In addition, some physicians mistakenly thought that if their patients were seeing other physicians who do not use e-prescribing systems then their other prescriptions would not be in the system. Finally, the RxH provided by these systems is separate from medications that are entered into the medication list by the provider and typically are provided as a separate list. Because none of the practices used an electronic medical record system, dual record keeping was required. This dual record-keeping system, coupled with physicians' beliefs that the RxH information represented in the e-prescribing system was incomplete, limited the potential of the technology to provide information that could be used to inform physician/patient discussions of the importance of medication adherence or the exploration of potential barriers to adherence.
Discussion
Among a group of voluntary early adopters of e-prescribing technology, we found uneven use of both F&B and RxH data by prescribers and support staff and widespread concerns about the accuracy, completeness, and usefulness of the data presented through these systems. Our findings indicate that many current e-prescribers likely will struggle to use these data to improve medication management in their practices even though they may manage to meet the stage 1 meaningful use criteria for F&B and RxH.14 These findings add depth to those from several previous studies. Physician surveys and other recent studies have found relatively large numbers of e-prescribers who report being unable to identify prescriptions written by other prescribers in their system, despite the fact that such information is generated from prescription claims databases and thus should be available in any standards-based e-prescribing system.24,34–36 There are likely several underlying causes for the inadequacy of these data. RxH and F&B information are often incomplete or erroneous because of challenges in correctly identifying patients using current technical standards for electronic determination of insurance eligibility, as well as the more than 40 million uninsured patients in the US who lack RxH data because it is based on insurance claims information.19 Our findings provide evidence that these coverage gaps have real effects on ambulatory care delivery, which limits both the potential quality and safety gains from e-prescribing in these settings and likely will limit the ability of current e-prescribers to improve care systematically while meeting meaningful use criteria relating to F&B and RxH functions.
Currently, pharmacy benefit management companies have disparate ways of providing and managing F&B information, and the technical standard must be designed to support all them. This complexity is multiplied by the use of National Drug Codes as drug identifiers in the F&B files, creating the need for dozens of or even hundreds of entries to cover each drug that is on or off the formulary. These complexities make maintaining and ensuring the accuracy of F&B information challenging for the data aggregators.19 As a result, formulary files typically are rife with potential and actual mistakes. In addition, health plans have a great deal of latitude in how they use the standard and must pay to publish their F&B information themselves. Unless health plans are required to provide a full set of formulary information, some will only use selected elements of the standard or opt out. This means that, for the foreseeable future, formulary data may be missing or incorrect for a substantial number of insured patients. Furthermore, in an effort to present F&B information in a simplified, consistent manner, some clinical software systems “normalize” F&B data, collapsing multiple coverage and copayment tiers into categories such as “preferred,” “on formulary” and “off formulary,” thus limiting the utility of this coverage information for informing cost-effective medication choices. Finally, even those systems that use the F&B standard receive only group-level rather than plan-level formulary information, thus providing incorrect coverage information for those patients whose coverage plans differ from those in the overall coverage group to which they belong. Given all these potential sources of error and incomplete data, many prescribers are not likely to rely on e-prescribing F&B data when making medication choices and may continue to rely on pharmacies to identify insurance coverage problems. (Pharmacies access true plan-level coverage when submitting a prescription through the insurance companies' claim adjudication systems.) These problems will be present in any system using current technical standards for e-prescribing, including those integrated into full-function EHR systems.
Physicians in this study also experienced RxH information as inaccurate or incomplete and, as has been found in other studies, continued to rely on patients to provide this information.24,34 Because RxH data are returned after a successful check for insurance eligibility, failures to match patients with their insurance benefit information accurately or gaps in prescription claims data could prevent retrieval of accurate RxH data.19,37 Unless prescribers can obtain RxH-related data consistently and reliably, it is unlikely that this technology will be able to meet the objectives of the core criteria of electronically maintaining an active medication list as required. Though prescribers may meet standards of meaningful use by having at least 80% of their patients with at least one entry as structured data on an electronic medication list, more complete data will be required before prescribers will rely on these lists to assist in providing high-quality clinical care.14
Because this is a qualitative study of e-prescribing use in ambulatory settings, our findings are not intended to represent the prevalence of issues related to the use of e-prescribing–based F&B and RxH data. However, the systems that we studied are widely used and based on accepted technical standards that remain in use; thus other systems likely present the same problems identified here. Another limitation of the study is that the practices examined here did not include multispecialty group practices or other large ambulatory care settings. However, the smaller practices observed here are of a size similar to those in which the majority of ambulatory care is delivered in the US, and the technical issues underlying our findings are present regardless of the size or integrated nature of the ambulatory practice setting. In addition, we do not have detailed information about prior experiences with computerized systems among practice members, and longer-term follow-up would be required to determine if practices subsequently developed effective methods for using F&B or RxH data. The e-prescribing industry is rapidly changing and we evaluated the use of only 2 widely used stand-alone e-prescribing systems. Some of the challenges we identified may have evolved since the time of our data collection. For example, the e-prescribing products evaluated here likely have improved their user interfaces and displays of data since this study, and we did not formally evaluate usability-related issues that may have presented additional barriers to accessing these data. Others have found that users of stand-alone systems are less likely to check formularies or RxHs than those with prescribing systems integrated into their medical record system.38 However, the root causes of the problems we identified lie in the e-prescribing standards and technical gaps that have not been addressed to date. Furthermore, relatively low use of the functions supported by the F&B and RxH standards persists among users of both stand-alone and integrated systems.38 Thus, the deficiencies and problems that we observed here likely remain in currently available e-prescribing systems. Finally, we do not have specific information about the number of users represented by each of the systems used in this study. However, they are widely used programs produced by 2 leading companies in the e-prescribing field and, in any case, the technical standards underlying them are the same as for other e-prescribing products.
Conclusion
The findings reported here provide evidence that physicians using e-prescribing systems perceive substantial data quality problems in the F&B and RxH information they receive through these systems and that these problems lead them to discount or ignore the information provided. These problems present challenges for primary care practices meeting the meaningful use criteria established by the Health Information Technology for Economic and Clinical Health Act. Several policy actions are needed to improve these data. Revision of the standards is needed to address data quality issues inherent in the nature of the standards themselves. The reliance by providers using e-prescribing technology on prescription claims data to generate RxH data for use at the point of care also should be revisited, and alternative approaches that have been pilot tested, such as using pharmacy sales data,39 should be expanded. The information communicated by e-prescribing standards should be evaluated regularly to ensure that the quality of information is sufficiently high to aid clinical decision making and to meet other federal standards. In addition, prescribers will need to be trained in how best to integrate this information into clinical encounters. Until the technical and data quality problems we have identified here are addressed, it is likely that health system–level quality gains and efficiencies expected from e-prescribing use will be realized unevenly as practices struggle to meet the meaningful use policy objectives relating to e-prescribing.
Acknowledgments
We acknowledge the participation of Horizon Blue Cross and Blue Shield of New Jersey, Caremark, and Allscripts in this research project.
Notes
-
This article was externally peer reviewed.
-
Funding: This research was supported by the US Agency for Health Care Research and Quality and the Centers for Medicare and Medicaid Services, grant no. 1 U18 HS016391-01.
-
Prior presentation: Preliminary findings from this study were presented at the 35th annual meeting of the North American Primary Care Research Group, October 20–23, 2007, Vancouver, British Columbia, Canada.
-
Conflict of interest: none declared.
-
See Related Article on Page 5.
- Received for publication December 12, 2010.
- Revision received September 21, 2011.
- Accepted for publication September 23, 2011.