Abstract
Objectives: To assess the effects of a tailored, multifaceted intervention in primary care on the level of patients' alcohol consumption and to investigate which patient and organizational factors determine a reduction in alcohol consumption.
Methods: This was a cluster randomized, controlled trial conducted among primary care practices in The Netherlands. Data from 6318 patients were available, of whom 712 patients from 70 practices were hazardous or harmful alcohol users. The improvement (intervention) program combined professional, organizational, and patient-directed activities. The emphasis was on educational training for general practitioners and support visits by a trained facilitator, tailored to the participants' needs and attitudes. The primary outcome was the proportion of patients with hazardous or harmful alcohol consumption, as measured with the Alcohol Use Disorders Identification Test, who reduced their levels of alcohol consumption to low-risk levels after 2 years.
Results: Of the hazardous and harmful alcohol users, a substantial proportion (41.6%) reduced their alcohol consumption to a low-risk level. The trial revealed a significant difference in favor of the control group: 35.5% of the patients with hazardous and harmful alcohol consumption in general practitioners' practices in the intervention group and 47.0% of this patient group in general practitioners' practices in the control group reduced their alcohol consumption to a low-risk level (odds ratio [OR], 0.62; 95% confidence interval [CI], 0.43–0.90). Older age (OR, 1.02; 95% CI, 1.01–1.03), female sex (OR, 2.00; 95% CI, 1.26–3.19), and attitudes toward alcohol use seemed to be the most important predictors for the reduction of alcohol use to a low-risk level. Patients who considered it important to reduce alcohol consumption and patients who believed that less alcohol complicates relaxation were less likely to reduce their alcohol use to a low-risk level (OR, 0.39; 95% CI, 0.19–0.80 and OR, 0.58; 95% CI, 0.37–0.90, respectively). Characteristics of the general practices, however, were not associated with reduced alcohol use.
Conclusions: Our results suggest that the intervention has been counterproductive because the proportion of patients reducing their levels of alcohol consumption to low-risk levels was lower in the intervention group compared with the control group. Furthermore, our study demonstrated that patients' attitudes toward alcohol use are an important determinant of the success of the program. Therefore, future research should focus on the effectiveness of methods to change patients' attitudes.
Excessive alcohol use is a major public health problem. In approximately 55 million adult Europeans (15% of the adult population), alcohol consumption is at least hazardous.1 It is a major risk factor for ill health and premature death and causes a large number of different types of diseases and injuries. Furthermore, alcohol is responsible for widespread social, mental, and emotional harms.2 Excessive alcohol use harms not only the user, but also those surrounding the user, including fetuses, family members, and those who suffer from crime, family violence, and driving accidents.3⇓–5
Intervening in risky drinking patterns through screening and brief interventions (SBIs) at an early stage is a highly effective and cost-effective strategy to prevent drinking problems.6⇓–8 Primary health care has been identified as a suitable setting for such interventions because of the high proportion of the total population seeking primary health care annually9 and because health promotion is a common and essential element of primary care.10
Research has shown that SBIs in primary health care settings are effective in reducing alcohol-related problems among persons with hazardous and harmful alcohol consumption but without alcohol dependence.2 The latter patient category needs to be identified by the primary health care provider and subsequently referred to specialized mental health and addiction care for more intensive and specialized treatment.11 Despite its evidence, SBIs have not yet been integrated into the routine clinical practice of general practitioners (GPs). Primary health care workers often find it difficult to identify and advise patients in relation to alcohol use, most because of a lack of time, inadequate training, concern about antagonizing patients, and doubts about the effectiveness of SBIs.12⇓–14
A systematic review of strategies to engage GPs in health promotion interventions showed that educational and office-based strategies increased GP involvement in SBIs by 13%. Alcohol-specific and multifaceted strategies were the most promising.15 This is consistent with other implementation studies.16⇓–18 However, to date very few studies of acceptable methodological quality with a reasonable follow-up period have tested the effectiveness of implementation strategies to engage GPs in the prevention of hazardous and harmful alcohol consumption.15 Furthermore, most implementation studies did not include outcomes of changes in patients' behavior.15 Therefore, we developed a multifaceted intervention on GPs' behavior toward prevention of hazardous and harmful alcohol consumption, and we conducted a randomized, controlled study to assess its 1-year effects on GPs' screening and advice-giving behavior and its 2-year effects on the level of alcohol consumption of patients.19 As reported in a previous article,19 our program did not result in improvement in rates of screening and giving of advice. In this article, we focus on the effect of our program on the level of alcohol consumption of patients. When considering the results of the previous article,19 a significant effect on patient outcome cannot reasonably be expected from our program. We therefore hypothesized that between GPs involved in the intervention program compared with those in the control group there will be no difference in the proportion of patients with hazardous and harmful alcohol consumption who reduced their levels of alcohol consumption to low-risk levels. In addition to the effect of our program on the level of alcohol consumption, we investigated which factors are associated with the reduction of alcohol consumption to a low-risk level. The current literature shows that the success of improvement programs can be determined by patient, professional, and organizational characteristics.20 To our knowledge, the variables associated with a reduction of alcohol consumption are yet unknown. By understanding these factors, strategies can be identified to adapt and focus future interventions.
Methods
Design and Participants
We performed a cluster randomized, controlled trial with measurements before (T0) and after (T1) the intervention. Patients were blinded to the GPs' participation in the study. Because GPs were aware of the intervention in which they took part, blinding of GPs was impossible. In total, 2758 Dutch general practices were invited to participate. Every GP within a practice individually received an invitation, but practices could only enroll if all GPs in the practice agreed to participate because the intervention contained several practice-directed elements. The enrolled practices were randomized by a computerized scheme such that the intervention and the control group would be of equal size. Randomization was performed before baseline measurement. To avoid possible bias, the GPs were informed about the group (intervention/control) to which they were assigned after obtaining baseline information. The intervention, described in the next section, was offered to the general practices during the period of October 2006 to June 2007 (intervention period). Details of both the randomization procedure and the provision of the intervention have been described in detail elsewhere.19
Intervention
The improvement (intervention) program combined professional, organizational, and patient-directed activities. The emphasis was on educational training and support visits by a trained facilitator and were tailored to the participants' needs and attitudes. Patient awareness was, among other things, raised through personal feedback. A GP was as an advisor involved in the development of this program. For a detailed outline of the program, see the box.21,22
The control group was mailed the guidelines and patient information letters about problematic alcohol consumption (which can be considered usual care) but received no further support or training. For ethical reasons, their patients also received personal feedback on alcohol consumption in June 2007 after closure of the intervention period.
Measures
Dependent Variable
The primary outcome measure was the proportion of patients with hazardous and harmful alcohol consumption who reduced their levels of alcohol consumption to low-risk levels. Alcohol consumption was measured using the Alcohol Use Disorders Identification Test (AUDIT), a validated screening questionnaire developed to detect harmful and hazardous alcohol use.23 Each practice team was asked to hand out a written self-report AUDIT questionnaire to up to 230 consecutive patients who visited the general practice within a 3-month period. The questionnaires were completed and returned to the research team before the start of the intervention. According to the published literature,23 the following cutoff AUDIT scores were used:
Score 0 to 7: Safe to moderate drinker
Score 8 to 15: Hazardous drinker
Score 16 to 19: Harmful drinker
Score ≥20: Possibly dependent drinker
Patients with hazardous and harmful alcohol consumption (7 < AUDIT score < 20) were followed up by the research team 2 years after their first completion of the AUDIT questionnaire and were requested to complete the AUDIT questionnaire once again. Because our intervention aimed to reduce alcohol-related problems among persons with hazardous and harmful alcohol consumption without alcohol dependence, neither safe to moderate drinkers nor possibly dependent drinkers were followed up.
Independent Variables
Patient Characteristics. We collected patient characteristics from the individual self-administered questionnaires, simultaneously offered to patients in combination with the AUDIT questionnaire. Patient characteristics included age, sex, household composition (living alone/living with partner, children, or both); educational level (basic, intermediate, high); smoking status (yes/no); comorbidity; and attitudes toward alcohol use. Comorbidity was defined in terms of presence or absence of certain comorbid conditions, including hypertension, cardiovascular disease, stomach problems, liver disease, colon disease, cancer, stroke, diabetes, respiratory disease, depressive disorder, anxiety disorder, relation problems, substance or drug abuse, insomnia, and other chronic disease or problem. Patients' attitudes toward alcohol use were measured through the use of a self-developed, 4-item questionnaire, initially derived from the Dutch Drinktest (www.drinktest.nl). Answers were recorded on a 5-point scale.
Organizational Characteristics. Each practice was requested to complete a short questionnaire about practice characteristics. This questionnaire could be filled in by one of the GPs or the practice assistant. We obtained information about practice type (solo practice/group practice) and level of urbanization (large city/city/small urban area).
Sample Size
The trial was designed to detect a minimal intervention-induced difference of 13% between the control and intervention groups; it was anticipated that a maximum of 5% of the patients in the usual care/control group and at least 18% of the patients in the intervention group would reduce their alcohol consumption from hazardous and harmful to low-risk levels.24 A total of 64 practices each with at least 10 patients with hazardous and harmful alcohol consumption per practice were needed (α = 0.05; β = 0.80). Anticipating a drop-out rate of 25% of the patients, the aim was to recruit a total of 853 patients with hazardous or harmful alcohol consumption.
Statistical Analyses
First, the prevalence of hazardous and harmful alcohol consumption was determined by calculating the number of patients with an AUDIT score >7 and <20.23 Descriptive statistics were used to outline the characteristics of this study population using SPSS version 16.0 (IBM/SPSS, Inc, Chicago, IL).
Subsequently, we investigated the effect of the intervention on the dichotomous outcome variable (reduction of alcohol consumption to a low-risk level versus maintenance of hazardous or harmful level of alcohol consumption) by performing a logistic multilevel analysis. Using this technique, regression coefficients can be adjusted for the clustering of observations within one practice that leads to dependency of observations of patients within one practice. In the multilevel analysis 2 levels—patient and practice—were defined. We tested for interaction to see whether the association between condition (intervention vs control) and reduction of alcohol consumption to a low-risk level differed between smokers and nonsmokers. A P value <.05 was considered to be statistically significant, except for the interaction analysis, where we used P < .10.
Finally, we investigated which patient and practice characteristics were related to the reduction of alcohol consumption to a low-risk level. Therefore, univariate associations between our dependent variable and all the distinguished independent variables were computed. To examine the influence of the most important patient and practice characteristics, a prediction model was built using a backward stepwise regression procedure, starting with all patient and practice characteristics and then eliminating all variables that did not contribute (P > .10) to the multiple multilevel regression model. The intraclass correlation coefficient (ICC), defined as the higher level variance as a percentage of the total variance, was calculated to examine which part of the total variance in the dataset belongs at the practice level (ie, the percentage of the variance that is not different across individual patients but across the practices). Based on the multiple logistic regression model, the ICC was .0001, indicating that the effect of practice was very small. This low ICC suggested that a multilevel model was suitable but not required, enabling us to evaluate the goodness of fit of the model using the Hosmer-Lemeshow statistic. The multilevel analyses were conducted with the statistical program MLwiN version 2.21 (Centre for Multilevel Modeling, Institute of Education, London, UK). The estimation method was second-order penalized quasi-likelihood. A P value of <.05 was considered significant. Regarding the Hosmer-Lemeshow statistic, a P value of <.05 was interpreted as indicating that the model did not fit the data. All outcomes were analyzed by the intention to treat principle, meaning that patients were analyzed in the group to which their practice was originally randomly assigned (regardless of whether the practice actually participated in the intervention).
Results
Study Population
Practices
Overall, 2758 general practices were invited to participate; 2676 practices declined. The participating 82 practices (3.0%), with 124 active GPs, were randomized. Five practices (one in the intervention group and 4 in the control group) withdrew after randomization but before measurement. This resulted in 37 practices (56 GPs) acting as control group and 40 practices (63 GPs) receiving the intervention. The activities of the program were tailored to the needs and attitudes of the GPs and practices, which resulted in a difference in attendance per GP. Despite several reminders and invitations, 13 GPs did not attend even one educational training or visit by the facilitator. Only half of the intervention practices met the minimal demands made on enrolment (every GP in the practice attend a minimum of one training session and one visit).
Patients
The GPs from the 77 practices distributed on average 137 patient AUDIT questionnaires per practice; 6775 questionnaires were returned (64%) and 457 questionnaires were excluded from analyses because of missing data. The control and intervention groups did not significantly differ in the percentages of patients with a hazardous or harmful level of alcohol consumption (11.6% and 12.7%, respectively; P = .17). Of the 6318 patients whose AUDIT scores were determined, 712 patients scored above 7 and below 20. Our final sample thus included 366 patients from 34 practices in the control group and 346 patients from 36 practices in the intervention group. Patient characteristics are listed in Table 1. A remarkable difference between patients registered in control practices and those registered in intervention practices concerned their smoking status: The control group contained a larger proportion of nonsmokers. Table 2 outlines some characteristics of practices in which patients were registered. Compared with the control group, the intervention group contained a smaller proportion of solo practices and a larger part of this group seemed to be established in a small urban area.
Changes in Level of Alcohol Consumption
A substantial proportion of hazardous or harmful alcohol users (41.6%) reduced their alcohol consumption to a low-risk level at T1 compared with T0. Table 3 shows the changes of level of alcohol consumption between the first and second completion of the AUDIT questionnaire. The proportion of patients with hazardous and harmful alcohol consumption that reduced their alcohol consumption to low-risk levels turned out to be 35.5% in GP practices in the intervention group compared with 47% of the GP practices in the control group (odds ratio [OR], 0.62; 95% confidence interval [CI], 0.43–0.90). There was no interaction between condition (intervention vs control) and smoking status regarding reduction of alcohol consumption to a low-risk level (P = 0.82 for interaction term). Thus, the association between condition and reduction of alcohol consumption to a low-risk level was the same for smokers and nonsmokers.
Factors Associated with Reduction of Alcohol Consumption to a Low-Risk Level
The data in Table 4 summarize the results of the multilevel logistic regression analyses regarding the relationship between the reduction of alcohol consumption to a low-risk level and the various patient and practice characteristics. In separate univariate regression analyses, reduction of alcohol consumption to a low-risk level showed an association with sex, smoking status, attitudes toward alcohol use, and urbanization. Female hazardous and harmful alcohol users more often reduced their alcohol consumption to a low-risk level compared with their male counterparts (OR, 1.69; 95% CI, 1.13–2.55). Smokers, however, less often reduced their alcohol use to a low-risk level compared with nonsmokers (OR, 0.64; 95% CI, 0.42–0.96). In addition, patients who believed that “less alcohol improves health” and “less alcohol complicates relaxing” were less likely to reduce their alcohol use to a low-risk level compared with those who did not agree with these statements (OR, 0.55; 95% CI, 0.32–0.96 and OR, 0.53; 95% CI, 0.35–0.81, respectively). Interestingly, patients answering in the affirmative to the statement that it is “important to reduce alcohol consumption” less often reduced their alcohol use to a low-risk level compared with those who considered it unimportant to change their alcohol use (OR, 0.42; 95% CI, 0.22–0.80). Finally, patients registered in practices in small urban areas more often changed their alcohol consumption to a low-risk level compared with patients registered in practices established in large cities (OR, 1.74; 95% CI, 1.04–2.93).
The multiple analysis showed that older age was positively related with reduction of alcohol consumption to a low-risk level (OR, 1.02; 95% CI, 1.01–1.03). Furthermore, the multiple analysis showed a stronger association between female sex and alcohol consumption to a low-risk level compared with the univariate analysis (OR, 2.00; 95% CI, 1.26–3.19). Finally, attitudes toward alcohol use was related to the reduction of alcohol use to a low-risk level in the multiple model. Patients agreeing with the statement “less alcohol use complicates relaxing” less often reduced their alcohol use to a low-risk level compared with those who denied this statement (OR, 0.58; 95% CI, 0.37–0.90). In addition, patients answering in the affirmative to the statement that it is important for them to reduce their alcohol consumption less often reduced their alcohol use to a low-risk level compared with those who considered it unimportant to change their alcohol use (OR, 0.39; 95% CI, 0.19–0.80). The Hosmer-Lemeshow test revealed that the model based on the remaining 4 predictors fit well (P = .54).
Discussion
Our aim was to assess the effect of implementing a tailored, multifaceted intervention on patients' level of alcohol consumption and to investigate which patient and organizational factors determine reduction of alcohol consumption to a low-risk level. Despite the intensity of the intervention program, the proportion of patients reducing their levels of alcohol consumption to low-risk levels was lower in the intervention group compared with the control group, which was in contrast to our hypothesis. Therefore, we concluded that the intervention did, in fact, increase the odds that patients would continue with hazardous or harmful drinking. This finding is contrary to the evidence that SBIs are effective in reducing alcohol-related problems among persons with hazardous and harmful alcohol consumption in primary health care settings.2,6,8 These studies, however, did not assess long-term effects. A possible explanation for our findings that the intervention did not produce the desired outcome on GP level, as described in an earlier article,19 or on patient level may be the low participation rate of the GPs. Nonetheless, a substantial proportion of patients with hazardous and harmful alcohol consumption (ie, 47.0% in the control group and 35.5% in the intervention group) reduced their alcohol use to a low-risk level. These proportions were 3 to 4 times higher than expected from a systematic review-based number needed to treat analysis regarding SBIs.25
The phenomenon of regression to the mean may have played a role in the substantial decrease of patients with hazardous and harmful alcohol consumption. More specifically, when patients present to health care providers, it could be for routine health maintenance or it could be for reasons in some way related to consequences of alcohol consumption. As such, their recent consumption at the time of the baseline visit might well have been unusually high, and at follow-up it may have decreased. Furthermore, that this proportion was higher than expected in both groups hints that hazardous and harmful alcohol consumption is not a very constant patient characteristic. Another explanation for the unexpectedly high proportions of patients with hazardous and harmful alcohol consumption who reduced their levels of alcohol consumption to low-risk levels is that social desirability (ie, the patients' desire to be seen as “someone following the advice on reducing alcohol consumption as described in the personal feedback letter”) played a role here. Our results also may have been biased by repeated assessment (reactivity): The mere fact of filling out the AUDIT and related measures may have had an effect on patients' drinking behavior. Finally, that this proportion was higher than expected in both groups may imply that the reduction of alcohol consumption to a low-risk level is at least partly attributable to the personal feedback letter, the only patient-directed element in the program that was provided to patients in both groups. Because this feedback letter contained information about only the amount of alcohol consumption and corresponding advice, it may be seen as part of a brief intervention. Therefore, this assumption is consistent with the existing evidence for the efficacy of brief interventions for hazardous and harmful alcohol consumption.2 A substantial number of patients was lost to follow-up, but those lost to follow-up were not found to differ markedly between hazardous and harmful alcohol users. Therefore, bias due to loss to follow-up seemed not to have played a large role in our study. Our program, primarily targeted at the attitudes and competences of GPs to improve their SBI activities, did not result in improvement in screening and advice-giving rates.19 Because our study revealed no difference in SBI rate between intervention practices and control practices, it is realistic to assume that patient-level effects can be attributed to other factors rather than to the intervention alone. In addition to age and sex, patient attitudes toward alcohol use seemed to be an important determinant of the reduction of alcohol consumption to a low-risk level. Interestingly, we found that patients who considered it important to reduce their alcohol consumption less often reduced their alcohol use to a low-risk level compared with those who considered it unimportant to change their alcohol use. We propose the following explanation for this finding: Drinkers who are aware that their alcohol use has gotten out of hand do not perceive enough benefit from SBIs and need to be offered more intensive or specialized treatment options.
Strengths and Limitations
To our knowledge, this is the first study reporting the long-term, patient-level effects of a program to engage GPs more in the prevention of alcohol problems. Prior studies of primary care interventions to reduce alcohol-related problems among persons with hazardous and harmful alcohol consumption particularly focused on outcomes regarding changes in GPs' behavior and did not take into account changes in patients' behavior.
Some limitations of this study should be acknowledged. The AUDIT's psychometric properties in the original English version have been well validated. These properties have, however, not been assessed in the Dutch version. Besides that, the appropriateness of traditional, gender-independent AUDIT cutoff scores (7 < AUDIT score < 20) used to determine hazardous and harmful alcohol consumption may be subject to criticism. A review of studies of the effects of alternative possible cut points for the AUDIT indicated that the standard value of 8 consistently yielded lower sensitivities and higher specificities for women than for men.26 This phenomenon led to the thought that the cut point for female samples should be lowered to a score of 5 or 6. Several recent studies provide further evidence that 5 may be the best cut point for identifying at-risk drinking among women, with sensitivities ranging from 0.73 to 0.82.27,28 Because we did not have follow-up data of female patients with an initial AUDIT score of 6 or 7, we were not able to make use of this relatively new evidence on optimal, sex-specific AUDIT cutoff scores during the analysis of our data. A second limitation of our study is that we were not able to reveal insight into possible associations between characteristics of the professional and the reduction of alcohol use to a low-risk level because we collected information about patient registration at the practice level and not at the GP level.
Conclusions and Implications
Our intervention did not produce the desired outcome at the patient level. Nevertheless, a large proportion of patients with hazardous and harmful alcohol consumption reduced their alcohol use to a low-risk level. The attitude of GPs is a well-known determinant of implementation of SBIs in general practice.29 Our study demonstrated that patients' attitudes toward alcohol use also are important determinants of the success of the program. For reaching optimal efficacy of SBIs, it therefore is important to gain insight into patients' attitudes before the intervention starts. Our intervention did not attempt to change patients' attitudes toward alcohol consumption. Patients' attitudes can be influenced through patient-directed interventions such as mass media campaigns and anonymous online treatments.30⇓⇓–33 E-learning is an upcoming and proven approach to medical education, which has practical advantages.34⇓–36 In future research, more attention should be paid to the effectiveness of the above-mentioned methods instead of intensive implementation strategies aimed at the provider. A stepped approach in which different strategies are used consecutively instead of simultaneously also may be appropriate.
Box 1. Outline of the Intervention.
The tailored intervention offered to the general practices comprised 9 activities, which can be divided into the following 3 levels:
Professional-directed interventions
Distribution of the guideline on problematic alcohol consumption issued by the Dutch college of GPs.22
A reminder card to display on the desk of the GP, with relevant signs, symptoms, and patient characteristics associated with excessive alcohol consumption. Furthermore, the Five Shot Test21 was listed as practical tool to question alcohol consumption.
Educational training sessions: The entire general practice team (including practice assistants and nurses) was invited to participate in the small-scale training sessions (maximum of approximately 10 participants). A minimum of one and maximum of 3 sessions could be attended, tailored to the wishes and needs of the teams. The duration of the sessions was between 2 and 3 hours.
Organization-directed interventions
Feedback report: Each practice received written feedback about the proportion of patients with excessive drinking habits according to the AUDIT. The patients were divided into 4 categories: (1) safe to moderate drinker; (2) hazardous drinker; (3) harmful drinker; and (4) possibly dependent drinker.
Facilitation of the cooperation with local addiction services for support and referral: The local addiction services were invited to join in the first educational training session and to discuss with the GPs both possible treatments and when to refer. Agreements were reached about communication, accessibility, and cooperation.
Outreach visits by a trained facilitator tailored to needs of practice: The entire practice team was invited to a practice visit by an experienced outreach visitor. The content of the visit was tailored to the wishes and needs of the teams. A minimum of one and maximum of 3 visits were offered, depending on the needs of the practice. The visits took place during daytime and lasted approximately 1 hour.
Patient-directed interventions
Patient information letters about alcohol issued by the Dutch College of GPs and leaflets and self-help booklets issued by the National Institute for Health Promotion and Disease Prevention (NIGZ) were offered to the general practices, to be distributed to patients by the GPs.
Poster in the waiting room: The poster drew the attention to alcohol with the advice to contact the GP or look at the websites of the NIGZ (http://www.nigz.nl) or Netherlands Institute of Mental Health and Addiction (http://www.trimbos.nl) for further information.
Personal feedback based on their alcohol consumption: The patients received a letter that cited the category (see above) to which they belonged and the corresponding advice. The advice was to consult their GP or to look at the websites of the NIGZ or Trimbos Institute. This was not necessary for patients in category I, and for patients in category IV, the advice to inquire at the local addiction service was added.
Notes
This article was externally peer reviewed.
Funding: This study was supported by a grant from the Netherlands Organization for Health Research and Development (ZonMw), dossier no. 63000003.
Conflict of interest: none declared.
Ethical approval: The trial was approved by the research ethics committee CMO of the region Arnhem-Nijmegen (letter of 2 January 2006; SE/CMO 0003). The committee concludes in their letter that in compliance with the law on medical-scientific research (WMO), the GPA trial does not need approval. We asked written informed consent which indeed has been provided by all participants.
- Received for publication March 6, 2012.
- Revision received June 12, 2012.
- Accepted for publication June 19, 2012.