Skip to main content

Main menu

  • HOME
  • ARTICLES
    • Current Issue
    • Ahead of Print
    • Archives
    • Abstracts In Press
    • Special Issue Archive
    • Subject Collections
  • INFO FOR
    • Authors
    • Reviewers
    • Call For Papers
    • Subscribers
    • Advertisers
  • SUBMIT
    • Manuscript
    • Peer Review
  • ABOUT
    • The JABFM
    • Editorial Board
    • Indexing
    • Editors' Blog
  • CLASSIFIEDS
  • Other Publications
    • abfm

User menu

Search

  • Advanced search
American Board of Family Medicine
  • Other Publications
    • abfm
American Board of Family Medicine

American Board of Family Medicine

Advanced Search

  • HOME
  • ARTICLES
    • Current Issue
    • Ahead of Print
    • Archives
    • Abstracts In Press
    • Special Issue Archive
    • Subject Collections
  • INFO FOR
    • Authors
    • Reviewers
    • Call For Papers
    • Subscribers
    • Advertisers
  • SUBMIT
    • Manuscript
    • Peer Review
  • ABOUT
    • The JABFM
    • Editorial Board
    • Indexing
    • Editors' Blog
  • CLASSIFIEDS
  • JABFM On Twitter
  • JABFM On YouTube
  • JABFM On Facebook
Research ArticleOriginal Research

Effects of Comorbidity and Clustering upon Referrals in Primary Care

Frederick M. Chen, George E. Fryer and Thomas E. Norris
The Journal of the American Board of Family Practice November 2005, 18 (6) 449-452; DOI: https://doi.org/10.3122/jabfm.18.6.449
Frederick M. Chen
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
George E. Fryer Jr.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Thomas E. Norris
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Article
  • Figures & Data
  • References
  • Info & Metrics
  • PDF
Loading

Abstract

Objective: To examine the effect of patient characteristics and comorbidity on referrals in primary care.

Methods: Cross-sectional analysis of patient encounters and referrals during a 1-year period for a primary care network of 9 clinics. The analysis adjusted for the clustering effect of physicians and clinics on the data.

Results: 23,720 specialty referrals were generated from 251,240 patient encounters, resulting in a total referral rate of 9.4 referrals per 100 encounters. Age, gender, and certain comorbid conditions were significant predictors of referral for any given encounter.

Conclusions: Patient characteristics and comorbidity are predictors of referral. Studies of primary care processes need to account for clustering of physicians and clinics in their research design.

In this era of rising health care costs and increasing emphasis on patient safety, surprisingly little is known about patients’ transition from primary to specialty care. Many explanations have been offered for the documented large variations in referral rates.1–3 Comorbid conditions and patients’ overall health status are clearly associated with the decision to refer,4–6 but there is also evidence that referral rates are also related to patient preferences and demographic factors.7,8 At another level, attributes of health care provider personnel and facilities, and the systems in which they work have been found to be predictors of patient referral.9–13 Utilization review and reimbursement mechanisms are systemic variables that influence referral patterns.14,15 The interplay of these multiple factors in the referral process is complex and continues to defy any simple explanation. We focused our analysis on a few critical predictors—patient characteristics and comorbidity—while introducing the use of multilevel analysis in referral research.

There is growing recognition of the importance of multilevel analysis when analyzing clustered and nested data.16–19 Failing to account for the multilevel structure of patients, providers, and clinics may underestimate standard errors or result in inefficient estimates. Recognizing that the theoretical model of the referral process is complex and multifactorial, we chose to focus on a few significant predictors of referral. These were patient characteristics, comorbidity, and the clustering effect of primary care data. In this study, we sought to examine the contribution of comorbidity, as measured by individual ambulatory diagnostic groups (ADGs), to physician referral tendencies, and to identify characteristics of patients most likely to be referred. We hypothesized that comorbidity, as measured by ADGs, would have a strong influence on referral likelihood, even after adjusting for clustering.

Methods

Setting

The University of Washington Physicians Network (UWPN) is a primary care network of 9 clinics, distributed throughout the Puget Sound region. The UWPN employs over 80 family physicians, internists, pediatricians, and mid-level providers. One unique aspect of the UWPN is the use of a electronic health record system, EPIC (Epic Systems Corporation, Madison, WI). This database captures all patient contacts including office visits, referrals, billing, subsequent visits, laboratory and medication orders, and visit diagnoses. With the approval and cooperation of the UWPN research committee, the UWPN information technology office provided records of all clinic encounters that took place in 1999. Telephone encounters and duplicate encounters that occurred on the same day were excluded. Encounters with providers who had fewer than 100 patient contacts were also excluded. Personal identifiers were removed from the data set. The University of Washington Institutional Review Board reviewed and approved this study.

Subjects

The unit of analysis was an individual patient encounter. Encounters, rather than individual patients, were examined to assess the independent effect of patients’ comorbid conditions on the likelihood of referral.

Measures

Dependent

A referral was defined as an encounter that resulted in a consultation to another physician for specialty care.

Independent

The Andersen-Newman model of access to care, which includes predisposing, enabling, and need factors, was selected as the conceptual basis for our analyses.20,21 Predisposing factors include age, gender, race, and ethnicity. Enabling factors such as income were not available in this secondary data set. In addition, all UWPN patients have health insurance, so they are homogeneous on this enabling factor. The need factor assessed in this study is case mix.

To assess the role of burden of illness in the decision to refer we used the Johns Hopkins ACG (Adjusted Clinical Group) assignment software.22,23 This software was developed in the 1980s to evaluate the relationship of patient morbidity to the cost and utilization of health care services. The package assigns each patient’s ICD-9-CM diagnostic codes to a unique ADG. We used the ADGs because ADGs explain more of the variation in resource use than the ACG indicators.4,10

Analyses

System level factors also influence referral patterns. For example, we observed considerable variance across the 9 study clinics in rates of referral, from 5.8 to 13.6%. In addition, physicians were substantially, although not totally, nested within clinic. Accordingly, SUDAAN software (Research Triangle Institute, Chapel Hill, NC) was used to perform all analyses. Its robust variance estimator accounts implicitly for any number of stages of nesting within the primary clusters (clinics), including in this case, physicians and individual patients. Initially, bivariate tests were done to evaluate the relationship of age, gender, race, and ADG with referral. Then, individual ADGs were examined for their effect on referral likelihood after adjusting for individual patient characteristics in separate logistic regression models. We calculated “design effects” to determine how much of the variance in the estimated effects of the ADGs on referral was because of clustering: both intra-cluster correlation and cluster size. The design effect is a measure of the statistical need to account for nesting.

Results

During 1999, there were 251,240 patient encounters in the 9 clinics. Those encounters resulted in 23,720 specialty referrals, resulting in a total referral rate of 9.4 referrals per 100 encounters. Referral rates varied according to the individual patient characteristics for each encounter (Table 1). Male patient encounters had higher referral rates than female encounters (9.95 vs 9.11, P = .02). Encounters with patients >65 years of age and <18 years of age were less likely to result in a referral (10.82 vs 6.73 and 7.24, respectively, P = .001). Encounters with minority patients were less likely to result in a referral than encounters with white patients (P = .002).

View this table:
  • View inline
  • View popup
Table 1.

Referral Rates by Patient Characteristics

Adjustment for patient characteristics on comorbidity using the ACG software revealed significant predictors of referral. When analyzed independently, 21 of the 32 ADGs were significantly related with referral for any given patient encounter. When the demographic characteristics and ADGs were combined in a logistic regression model, the age and gender characteristics remained significant, and the number of significant ADGs was reduced to 19 (Table 2).

View this table:
  • View inline
  • View popup
Table 2.

Adjusted Diagnostic Group (ADG) Referral Rates and Odds Ratios for Referral Controlling for Age Group, Gender, and Race

Finally, although we were not interested in the role of the clinic beyond statistically controlling for its influence, its design effect was typically large on all predictors, indicating the need for the nested procedures invoked in the analysis. The average design effect for the ADGs that appear in Table 2 was 5.27. Thus, the SUDAAN procedure adjusted for a >5-fold increase in the variance of their estimated regression coefficients because of clustering.

Discussion

This study confirmed the variations in referral rates described by previous work. Identifying and measuring the strength of contributing factors is important in analyzing referral rates and the performance of systems of primary care. This study also demonstrates that data from electronic health records can be used to perform analyses of common primary care processes.

Comorbidity analysis remains an important tool in primary care research. This study shows the value of the ACG system in predicting the effect of patients’ comorbid conditions on referral. One unique aspect of the study was the individual analysis of ADGs and their independent predictive utility. Although most researchers combine ADGs into the ACG system and sum the burden of disease scores, these results suggest that there is value to examining individual ADGs when there are sufficient data to do so.

In examining the results of this study, encounters with ADGs that signified urgent or unstable conditions were more likely to result in referral. Similarly, encounters with ADGs that reflected specialty oriented care were also more likely to be referred. These findings suggest that subsets of ADGs may be used as a means of monitoring trends in referral patterns.

This study also reinforces the value of multilevel analysis and modeling in examining complex processes in primary care. Many primary care research study designs introduce clustering or nesting into the data structure. For primary care, in which research studies are often conducted in multiple clinical sites or practice based research networks, multilevel analysis may prove to be a useful tool.

Acknowledgments

We thank the UWPN information systems staff for help in obtaining the data. Holly Andrilla contributed to preliminary analyses of the data.

Notes

  • Conflict of interest: none declared.

  • Received for publication March 16, 2005.
  • Revision received June 7, 2005.
  • Accepted for publication June 13, 2005.

References

  1. ↵
    Nutting P, Franks P, Clancy C. Referral and consultation in primary care: do we understand what we’re doing? J Fam Pract 1992; 35: 21–3.
    OpenUrlPubMed
  2. Ludke RL. An examination of the factors that influence patient referral decisions. Med Care 1982; 20: 782–96.
    OpenUrlCrossRefPubMed
  3. ↵
    Henley ES. An analysis of referrals and referral rates. Hosp Health Serv Adm 1985; 30: 120–9.
    OpenUrlPubMed
  4. ↵
    Salem-Schatz S, Moore G, Rucker M, Pearson S. The case for case-mix adjustment in practice profiling. JAMA 1994; 272: 871–4.
    OpenUrlCrossRefPubMed
  5. Shea D, Stuart B, Vasey J, Nag S. Medicare physician referral patterns. Health Serv Res 1999; 34: 331–48.
    OpenUrlPubMed
  6. ↵
    Lawler FH. Referral rates of senior family practice residents in an ambulatory care clinic. JMed Educ 1987; 62: 177–82.
    OpenUrl
  7. ↵
    Coulter A, Noone A, Goldacre M. General practitioners’ referrals to specialist outpatient clinics. Br Med J 1989; 299: 304–8.
  8. ↵
    Brock C. Consultation and referral patterns of family physicians. J Fam Pract 1977; 4: 1129–37.
    OpenUrlPubMed
  9. ↵
    Bachman KH, Freeborn DK. HMO physicians’ use of referrals. Soc Sci Med. 1999; 48: 547–57.
  10. ↵
    Franks P, Clancy C. Referrals of adult patients from primary care: demographic disparities and their relationship to HMO insurance. J Fam Pract 1997; 45: 47–53.
    OpenUrlPubMed
  11. Franks P, Zwanziger J, Mooney C, Sorbero M. Variations in primary care physician referral rates. Health Serv Res 1999; 34: 323–9.
    OpenUrlPubMed
  12. Forrest CB, Nutting PA, Starfield B, von Schrader S. Family physicians’ referral decisions: results from the ASPN referral study. J Fam Pract 2002; 51: 215–22.
    OpenUrlPubMed
  13. ↵
    Calman N, Hyman R, Licht W. Variability in consultation rates and practitioner level of diagnostic certainty. J Fam Pract 1992; 35: 31–8.
    OpenUrlPubMed
  14. ↵
    Chan BT, Austin PC. Patient, physician, and community factors affecting referrals to specialists in Ontario, Canada: a population-based, multi-level modelling approach. Med Care 2003; 41: 500–11.
    OpenUrlCrossRefPubMed
  15. ↵
    Forrest CB, Nutting P, Werner JJ, Starfield B, von Schrader S, Rohde C. Managed health plan effects on the specialty referral process: results from the Ambulatory Sentinel Practice Network referral study. Med Care 2003; 41: 242–53.
    OpenUrlCrossRefPubMed
  16. ↵
    Zyzanski SJ, Flocke SA, Dickinson LM. On the nature and analysis of clustered data. Ann Fam Med 2004; 2: 199–200.
    OpenUrlFREE Full Text
  17. Killip S, Mahfoud Z, Pearce K. What is an intracluster correlation coefficient? Crucial concepts for primary care researchers. Ann Fam Med 2004; 2: 204–8.
    OpenUrlAbstract/FREE Full Text
  18. Diez Roux AV. Investigating neighborhood and area effects on health. Am J Public Health. 2001; 91: 1783–9.
    OpenUrlCrossRefPubMed
  19. ↵
    Diez-Roux AV. Bringing context back into epidemiology: variables and fallacies in multilevel analysis. Am J Public Health. 1998; 88: 216–22.
    OpenUrlCrossRefPubMed
  20. ↵
    Andersen R, Newman JF. Societal and individual determinants of medical care utilization in the United States. Milbank Mem Fund Q Health Soc 1973; 51: 95–124.
    OpenUrlCrossRefPubMed
  21. ↵
    Andersen RM. Revisiting the behavioral model and access to medical care: does it matter? J Health Soc Behav 1995; 36: 1–10.
    OpenUrlCrossRefPubMed
  22. ↵
    Johns Hopkins University ACG Case Mix Adjustment System [computer program]. Version 6.0. Baltimore, MD: Johns Hopkins University School of Hygiene and Public Health; 2000.
  23. ↵
    Starfield B, Lemke KW, Herbert R, Pavlovich WD, Anderson G. Comorbidity and the use of primary care and specialist care in the elderly. Ann Fam Med 2005; 3: 215–22.
    OpenUrlAbstract/FREE Full Text
PreviousNext
Back to top

In this issue

The Journal of the American Board of Family Practice: 18 (6)
The Journal of the American Board of Family Practice
Vol. 18, Issue 6
November-December 2005
  • Table of Contents
  • Index by author
Print
Download PDF
Article Alerts
Sign In to Email Alerts with your Email Address
Email Article

Thank you for your interest in spreading the word on American Board of Family Medicine.

NOTE: We only request your email address so that the person you are recommending the page to knows that you wanted them to see it, and that it is not junk mail. We do not capture any email address.

Enter multiple addresses on separate lines or separate them with commas.
Effects of Comorbidity and Clustering upon Referrals in Primary Care
(Your Name) has sent you a message from American Board of Family Medicine
(Your Name) thought you would like to see the American Board of Family Medicine web site.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
9 + 1 =
Solve this simple math problem and enter the result. E.g. for 1+3, enter 4.
Citation Tools
Effects of Comorbidity and Clustering upon Referrals in Primary Care
Frederick M. Chen, George E. Fryer, Thomas E. Norris
The Journal of the American Board of Family Practice Nov 2005, 18 (6) 449-452; DOI: 10.3122/jabfm.18.6.449

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
Share
Effects of Comorbidity and Clustering upon Referrals in Primary Care
Frederick M. Chen, George E. Fryer, Thomas E. Norris
The Journal of the American Board of Family Practice Nov 2005, 18 (6) 449-452; DOI: 10.3122/jabfm.18.6.449
Reddit logo Twitter logo Facebook logo Mendeley logo
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Jump to section

  • Article
    • Abstract
    • Methods
    • Results
    • Discussion
    • Acknowledgments
    • Notes
    • References
  • Figures & Data
  • Info & Metrics
  • References
  • PDF

Related Articles

  • No related articles found.
  • PubMed
  • Google Scholar

Cited By...

  • Multimorbidity as an important issue among women: results of a gender difference investigation in a large population-based cross-sectional study in West Asia
  • Google Scholar

More in this TOC Section

  • Priorities for Artificial Intelligence Applications in Primary Care: A Canadian Deliberative Dialogue with Patients, Providers, and Health System Leaders
  • Increasing Primary Care Utilization of Medication-Assisted Treatment (MAT) for Opioid Use Disorder
  • Perceptions of Artificial Intelligence Use in Primary Care: A Qualitative Study with Providers and Staff of Ontario Community Health Centres
Show more Original Research

Similar Articles

Navigate

  • Home
  • Current Issue
  • Past Issues

Authors & Reviewers

  • Info For Authors
  • Info For Reviewers
  • Submit A Manuscript/Review

Other Services

  • Get Email Alerts
  • Classifieds
  • Reprints and Permissions

Other Resources

  • Forms
  • Contact Us
  • ABFM News

© 2023 American Board of Family Medicine

Powered by HighWire