|
|
||||||||
Original Research |
From the University of Oklahoma College of Medicine (CWF)
Department of Family and Preventive Medicine, University of Oklahoma Health Sciences Center, Oklahoma City, OK (CBA, JWM)
Correspondence: Corresponding author: Cheryl B. Aspy, PhD, Department of Family and Preventive Medicine, University of Oklahoma Health Sciences Center, 900 NE 10th Street, Oklahoma City, OK 73104 (E-mail: Cheryl-aspy{at}ouhsc.edu)
| Abstract |
|---|
|
|
|---|
Methods: Using the "best practices research" method within a primary care practice-based research network, we delineated steps involved in the process and the most important requirements for each step. We identified potential exemplary practices for each step and conducted practice audits and patient surveys to document actual performance. Methods with the highest performance ratings for the predetermined requirements for the steps were combined into a "best" unified approach.
Results: Half of the surveyed practices were satisfied with at least one step in their current refill management process, but only 9% (3 practices) were satisfied with all 5 steps. Practice audits identified acceptable methods for each step. The best combined method involves teaching patients to call the pharmacy first for prescription refills, accepting only fax requests from the pharmacy, allowing a nurse or medical assistant to make most refill decisions, documenting them in the chart immediately, responding back to the pharmacy by fax, and relying on the pharmacy to notify the patient when the refill is ready. Patient satisfaction with this method was reasonably good. The cost per refill was approximately $0.25 excluding overhead associated with office equipment and utilities.
Conclusions: A satisfactory method for managing prescription refills in primary care practices was identified using the best practices research method.
Very few studies have addressed methods for managing prescription refills. Those that have were conducted in unique settings or have addressed narrow aspects of the problem. For example, a recent study explored giving pharmacists the authority to refill chronic medications for patients in a Veterans Affairs hospital system until a visit could be scheduled with the patients physician.4 Other studies have examined ways to improve documentation of prescriptions in the medical record,5 the efficiency of a medical screening clinic that employed a pharmacist as a part of the health care team,6 and the use of E-mail for refill requests.7
The purpose of this study was to identify and describe at least one effective and efficient method for managing prescription refills in primary care practice settings. We used a research method that we have called "best practices research."8 Because management of prescription refills is a common challenge faced by virtually all primary care physicians, we believed that we could find clinicians who had already developed components of an effective and efficient refill management system. Best practices research attempts to tap into the wisdom of practicing clinicians to identify effective, field-tested solutions or partial solutions, combining the best of these into a single unified approach. We have used this method to identify effective ways to increase pneumococcal immunization rates,9 manage laboratory test results,10 and improve the quality of care provided to patients with diabetes.11
| Methods |
|---|
|
|
|---|
Identification of Steps Involved in the Process
During a semiannual convocation, physician members of the Oklahoma Physicians Resource/Research Network (OKPRN) identified the steps involved in the management of prescription refills. Subsequently, office staff who were attending an OKPRN staff training conference were asked to reflect on these steps and revise them. The revised set of steps was then critiqued by a group of pharmacists. This revision was sent to all members of OKPRN over its listserv for review and comment. Through this process, 5 steps were agreed upon, not necessarily occurring in this order: (1) patient access to the process, (2) communication between clinic and pharmacy, (3) decision-making by clinic staff, (4) patient notification, and (5) medical record documentation.
Reduction of the frequency of refill requests by providing more doses and more refills per prescription was also discussed. Some physicians reported that they limit the number of refills given to a patient to ensure follow-up. Others suggested writing for the maximum number of refills allowed and creating a separate system for tracking adherence to follow-up appointments. We chose not to evaluate this aspect of the process in this study while acknowledging its potential importance.
Definition of Best
Following the identification of steps, a committee consisting of the authors [a second year medical student (CWF), an academic family physician (JWM), a PhD faculty member (CBA)], met to define the meaning of best for each step. A list of possible requirements for each step was generated through brainstorming; after which, each was discussed and consensus was reached regarding the top 2 requirements and their order of importance.
For all 5 steps, the group agreed that a good prescription refill management process required accuracy, efficiency, acceptability for patients and office staff, and applicability to a wide range of primary care practices. However, these requirements were prioritized differently for each step. The top 2, prioritized requirements for step 1, were efficiency and patient satisfaction, in that order; for step 2, accuracy and efficiency; for step 3, accuracy and efficiency; for step 4, patient satisfaction and efficiency; and for step 5, accuracy and efficiency.
Generalizability and lack of interference with other office activities were considered important for all steps but were not considered independently for each step and were not specifically evaluated in the practice audits.
Identification and Evaluation of Potential Best Methods for Individual Steps
Surveys were faxed to 65 physicians in the 49 OKPRN member practices. On separate copies of this survey, the physician, a member of the nursing staff, and a key office staff member were asked to independently rate their level of satisfaction with their offices management of each of the 5 steps of the prescription refill process on a 5-point Likert scale with 1 being not satisfied and 5 being completely satisfied. These surveys were returned by fax to the University of Oklahoma Health Sciences Center (OUHSC) where they were evaluated. Physician offices at which a physician did not respond (N = 3) or where only the physician responded (N = 7) were excluded from further evaluation. Physician/staff teams that showed high satisfaction rates (mean rating
4) for at least one step of their prescription management system were queried further about those component(s) of their process with which they were satisfied (N = 17). Five practices were selected for in-depth audits; practices were purposefully chosen from those satisfied with at least one step in the process in such a way as to insure that the full spectrum of different methods for each step was represented in the sample. At least 2 potentially exemplary practices were chosen for each step.
Measures
Outcome measures related to patient satisfaction (steps 1 and 4) were obtained from a mailed survey. This survey was sent to each patient who had requested a refill during the 1-week audited period in each practice. Patients were asked how they notified the physicians office regarding refills, how long the refill process took, how satisfied they were with the way they were notified when the prescription was ready, and how satisfied they were with the process as a whole (each on a 5-point Likert scale).
For step 2, communication with the pharmacy, an error was defined as any event that delayed or distorted communication. These errors were often associated with faxing errors, eg, a fax did not go through, multiple faxes were sent, or an incorrect fax number was used. Errors related to decision-making (step 3) were defined as decisions made by the medical assistant or LPN that were different from those the physician would have made. These were determined by examining all refill decisions made during 1 week, comparing the decision made to the decision the physicians said they would have made for each request. Decisions were made by the physician in 2 clinics, and therefore, no errors were attributed to these clinics for this step. A documentation error (step 5) resulted when the refill was not documented in the chart. Medical records were reviewed to determine whether proper documentation had occurred (step 5). Error rates were calculated using the number of prescription refill requests as the denominator for each of the 5 sites.
Efficiency was operationalized as the cost to the practice. Cost was computed by determining the time involved for each employee to complete the tasks associated with each step and multiplying it by the average hourly salaries of the employees involved. A medical student (CWF) timed each component of the process from request initiation through decision-making and contact with the pharmacy for at least 25 patients at each site. Cost calculations were bundled into communication (including receiving and returning faxes and pulling charts) and decision-making.
Analysis
Data from the audits and from the patient satisfaction responses were entered into an Excel spreadsheet and uploaded into SimStat for analyses. Descriptive statistics were computed for all variables and comparisons across practices for categorical data were made using
2 analyses of cross-tabulated data. For continuous variables, comparisons across practices were made using analysis of variance (ANOVA). For all analyses, the significance level was set at 0.05. For the patient surveys, a power analysis suggested that we would be able to detect a 5% or greater difference in proportions 80% of the time with a sample size of 24 so we decided to survey all patients requesting refills in a given week (N = 31 to 91 in the audited practices). Field notes were kept by the practice auditor (CWF), and these were reviewed with the other authors to identify important themes. This study was reviewed and approved by the universitys Institutional Review Board.
Combining Best Methods
Based on the performance of the methods used in the audited practices for the individual steps, in accordance with our predetermined requirements and criteria, best approaches were identified for each step and then combined into a single best method for managing prescription refills. The cost of the best combined method was estimated by averaging the cost for practices using the best method for each step and then summing those averages.
| Results |
|---|
|
|
|---|
|
|
|
Step 2: Communication with Pharmacies
The critical requirements for communicating with the pharmacy were accuracy and efficiency. In the practices satisfied with their management of this step (clinics C, D, and A), pharmacies communicated with the practice by fax, and decisions of the practice were faxed back to the pharmacy. In clinic E, a voice mail option is available and requests come directly to the medical assistant charged with making the decision. In clinics B and E, an electronic record system makes location and retrieval of the chart more efficient.
Errors associated with these methods differed significantly across the sites (see Table 3). Clinics A and E both had more errors than would be expected by chance compared with the other.
|
Comparing clinic B, which uses an efficient EMR to the average cost of all other clinics ($0.20), and assuming an average of 63 prescription refill requests per week per clinician, an EMR seemed to save the practice approximately $459 per clinician per year for this function alone ($0.14 x 63 x 52 = $458.64).
Step 3: Decision-making by Clinic Staff
The primary requirements for this step were also accuracy and efficiency. Table 4 contains the qualifications of the principal decision-maker, whether he/she uses a written protocol, the error rates, and the cost per refill for this step. A
2 analysis found significant differences in error rates for the clinics. Clinics B and E both had significantly higher error rates than would be expected by chance alone. Clinic E had the highest error rate for this step among the audited practices despite their use of an EMR and a written protocol. The auditor observed that the errors were virtually all errors of omission. That is, the decision-maker refused refills that the physician would have approved. The written protocols were too rigid to accommodate the wide variety of patient circumstances encountered.
Costs varied widely for this step. Much of this had to do with the cost of the decision-maker (physicians time costs more than medical assistants and licensed practical nurses time). However, some persons were simply more efficient than others were as well. Clinic A had both the lowest cost and the lowest error rate for this step. Although clinics C and D also had a 0% error rate, their average costs per request were greater (2 and 4 times, respectively) than clinic A. The medical assistant making the refill decisions at clinic A had worked in that practice with the same physician for a number of years and was very efficient. Although satisfied with their methods, clinics D and E had the highest costs.
Step 4: Notification of Patients
The critical requirements for this step were efficiency and patient satisfaction. All 5 clinics leave this step to the pharmacies. Patients are routinely informed that they are to contact the pharmacy before the physicians office closes so that if an error has occurred between the pharmacy and the physicians office, it can be remedied before the next day. If it is time for the patient to schedule an appointment with the physician, they are typically granted a 1-month supply and it is noted on the faxed request or the pharmacist is informed on the phone that the patient needs to schedule an appointment and that they will receive no more refills until that happens. If the refill is denied, as is often the case with narcotics, a reason is noted on the fax message to the pharmacy. However, with a denial, the physicians office usually calls the patient to explain why the refill was denied. As for step 1, it is much more efficient for the practice to rely on the pharmacy to contact patients when the prescription is ready.
When asked about the total time required to get a prescription refilled, the majority of patients reported the total time as less than 8 hours (see Table 5). However, there was a significant difference among the practices with clinic D having the highest proportion with total refill times less than 8 hours and clinic E having the lowest. There was no significant difference among the 5 sites for patient satisfaction with their notification methods when means were compared. Patient satisfaction was lowest for clinic E and highest for clinic D. Mean practice satisfaction generally followed the same ranking as the proportion of patients reporting total prescription refill time as less than 8 hours. For example, clinic D had the highest mean practice satisfaction level and also the highest percentage of patients reporting less than 8 total hours for the refill process.
|
|
2 = 3.3, df = 4, P > .05). The best methods for each step of the prescription refill process can be found in Table 7.
|
| Discussion |
|---|
|
|
|---|
Some of the principles learned during this study resemble those learned previously.10,11 Single option methods (eg, asking all patients to call the pharmacy first) tend to work better than multiple option methods. Time spent by staff on the telephone is expensive, and physician time is particularly expensive and not always needed for routine tasks. Time spent pulling, transporting, and refiling paper charts is also costly; $459 per clinician per year just for the management of prescription refills. Error rates are generally higher than physicians think they are.
The best method identified for steps 1 (patient access) and 2 (communication with the pharmacy) is to require that the patient contact the pharmacy first and have the pharmacy fax requests to the physicians office. The pharmacy should also be responsible for notifying the patient that the prescription has been approved and is ready to be picked up (step 4, notification of patient). This shifts overhead from physicians offices, which are not reimbursed for refill services, to the pharmacies, which profit from the sale of the medication. Because faxed requests are computer generated, they are legible and therefore likely to reduce errors compared with patient or pharmacy phone calls to the practice in which necessary information such as correct dosage or amount requested are often omitted. It does not, however, reduce the time that it takes for patients to contact the system, and it results in some reduction in patient satisfaction. Decisions regarding the use of this method should be tempered by this reality; however, a majority of patients reported being very or completely satisfied with their physicians method for managing refills. Patients also reported high levels of satisfaction with relying on the pharmacy to let them know when a prescription had been refilled.
Based on our data, medical assistants and licensed practical nurses are capable of making accurate decisions about the vast majority of medication refill requests (step 3). Obviously some training is required, and the default should always be to the physician in questionable cases. An interesting finding was that offices with a written protocol for their decision-makers to follow (clinics B and E) had higher rates of decision-making errors than those who had only verbal instructions. This might have been because of the varied experience levels of the staff in the 5 clinics or it may be a chance finding. However, it is more likely that, because of the wide variety of patients seen in primary care settings, there are many legitimate exceptions to well-intended rules.
Documentation (step 5) should be done by the person making the refill decision. This seems to reduce the rate of errors made during transfer of paperwork. For EMRs, easy and accurate documentation and efficient access to the patients prescription list are essential features not always present in existing programs. Some of the audited practices designated certain times of each day for handling prescription refills. Others handled them as they came in as time permitted. A summary of the best practice steps can be found in Table 7.
The study has several limitations. Audits were conducted only in practices that reported high satisfaction with their methods for at least one of the management steps. Satisfaction may or may not be an indicator of the effectiveness of the method or of an exemplary practice. That there were more similarities among their methods than differences adds support to the validity of our method for identifying exemplars and to our conclusions and recommendations. However, it is possible that better methods existed in practices that failed to respond or had higher thresholds for reporting satisfaction. Only 5 practices were audited, and we did not identify and audit practices with very low satisfaction rates as a basis for comparison. Response rates to the patient satisfaction survey were only approximately 50%. We also have not yet tested the combined best practice method against alternatives. None of the practices were using E-mail to communicate with pharmacies or with patients.
However, we believe that the consistency of methods used by the satisfied practices speaks to the veracity of our results and recommendations. In addition, when we have discussed our findings at both network and national meetings, attendees report that they have significant face validity. All the steps have been field tested in active clinical practices and seem to be feasible and acceptable. The combined best method is broadly generalizable. Whereas an electronic medical record can make the process more efficient depending to some degree on the software, the method is equally effective using paper records.
| Acknowledgments |
|---|
| Notes |
|---|
|
|
|---|
Received for publication April 8, 2005. Revision received September 9, 2005. Accepted for publication September 13, 2005.
| References |
|---|
|
|
|---|
This article has been cited by other articles:
![]() |
C. B. Aspy, M. Enright, L. Halstead, and J. W. Mold Improving Mammography Screening Using Best Practices and Practice Enhancement Assistants: An Oklahoma Physicians Resource/Research Network (OKPRN) Study J Am Board Fam Med, July 1, 2008; 21(4): 326 - 333. [Abstract] [Full Text] [PDF] |
||||
![]() |
A. M. Butz, M. Tsoukleris, M. Donithan, V. D. Hsu, K. Mudd, I. H. Zuckerman, and M. E. Bollinger Patterns of Inhaled Antiinflammatory Medication Use in Young Underserved Children With Asthma Pediatrics, December 1, 2006; 118(6): 2504 - 2513. [Abstract] [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | CONTACT US | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |