Abstract
Introduction: Being one of the few existing measures of primary care functions, physician-level continuity of care (Phy-CoC) is measured by the weighted average of patient continuity scores. Compared with the well-researched patient-level continuity, Phy-CoC is a new instrument with limited evidence from Medicare beneficiaries. This study aimed to expand the patient sample to include patients of all ages and all types of insurance and reassess the associations between full panel-based Phy-CoC scores and patient outcomes.
Methods: Cross-sectional analysis at patient-level using Virginia All-Payer Claims Database (VA-APCD). Phy-CoC scores were calculated by averaging patient’s Bice-Boxerman Index scores and weighted by the total number of visits. Patient outcomes included total cost and preventable hospitalization.
Results: In a sample of 1.6 million Virginians, patients who lived in rural areas or had Medicare as primary insurance were more likely to be attributed to physicians with the highest Phy-CoC scores. Across all adult patient populations, we found that being attributed to physicians with higher Phy-CoC was associated with 7%-11.8% higher total costs, but was not associated with the odds of preventable hospitalization. Results from models with interactions revealed nuanced associations between Phy-CoC and total cost with patient’s age and comorbidity, insurance payer, and the specialty of their physician.
Conclusions: In this comprehensive examination of Phy-CoC using all populations from the VA-APCD, we found an overall positive association of higher full panel-based Phy-CoC with total cost, but a non-significant association with the risk of preventable hospitalization. Achieving higher full panel-based Phy-CoC may have unintended cost implications.
Introduction
Primary Care Physician Continuity of Care is one of the few existing measures of primary care functions newly endorsed by the National Quality Forum in 2022.1⇓–3 It is a claims-based process measure that evaluates the proportion of patients on a physician’s panel who achieved high continuity determined by patient Bice-Boxerman Index (BBI) scores.4 This measure is also being considered by the Centers for Medicare and Medicaid Services for acceptance into its Merit-based Incentive Payment System.
However, unlike the large evidence base of patient-level continuity built over the past 2 decades that showed a consistent relationship between higher patient continuity and a host of beneficial outcomes,5⇓⇓⇓–9 physician-level continuity of care (Phy-CoC) is a relatively new research instrument, with just 2 studies that investigated its associations with patient outcomes.10,11 Although both studies found significant associations between patients attributed to physicians with higher Phy-CoC scores and lower total costs and lower odds of hospitalization, the evidence has been limited to older Medicare beneficiaries.
Phy-CoC scores are calculated by weighting individual patient BBI scores by total number of primary care visits. Compared with BBI-based patient continuity scores that are intended to capture the dispersion of visits across a group of physicians for individual patients, Phy-CoC scores summarize the continuity scores of patients as the continuity score of a physician, which by design is influenced by the selection of patients. As a result, a physician’s continuity score determined by older patients only (eg, Medicare beneficiaries) is likely different from the one that accounts for their full patient panel. Moreover, it is unknown whether the associations between Phy-CoC and patient outcomes established in samples of older patients would hold in a sample of patients of all ages.
To expand the evidence base of Phy-CoC to all patients and address the data limitation of previous research, this study used Virginia All-Payer Claims Database (VA-APCD) which includes billing claims of Virginians of all ages and all types of insurance coverage to reassess Phy-CoC scores by accounting for all patients on a physician’s panel. The study was designed to determine how much the inclusion of pediatric patients and younger adults under the aged of 65 together with older patients would change Phy-CoC scores for the same physicians, and whether patients whose primary care physician had higher Phy-CoC scores (full panel-based) would be associated with lower total cost and lower odds of preventable hospitalization.
Methods
Data Source
The VA-APCD includes administrative claims data on state residents insured through fee-for-service Medicare, Medicaid, and private commercial insurers. APCDs have increasingly become a valuable tool to inform policy decisions around health services delivery.12⇓–14 The VA-APCD has been used to evaluate critical issues of health care including unnecessary health care spending and opioid medication prescribing.15⇓–17 Compared with the national Medicare claims, the VA-APCD includes health insurance billing claims of 4-4.5 million Virginia residents regardless of their insurance coverage being Medicare, Medicaid, or commercial.18 Whereas the national Medicare claims are grouped into 7 claim types, the VA-APCD uses a proprietary methodology called the Health Cost Guideline grouper to assign claims to 5 service cost categories, including professional, inpatient, outpatient, prescription, and ancillary. In addition, the VA-APCD has a unique data addition (ie, Evidence-based Measures, EBM) which flags a service claim if it met the definition of an existing quality measure. For example, a hospital inpatient claim will be flagged as preventable hospitalization if the EBM algorithm determines that the claim met the definition of the Agency for Health care Research and Quality’s Preventive Quality Indicator #90.19
Sample Selection
To investigate the associations between Phy-CoC and patient outcomes at patient level, we sampled patients of all ages and all insurance types who made 1 or more primary care visits in Virginia in 2019. We excluded patients with no primary care visits in 2019. In addition, to produce more generalizable estimates of Phy-CoC, we excluded patients attributed to general practitioners or geriatricians due to limited number of physicians in each specialty, as well as patients whose primary care physicians had fewer than 30 patients in 2019.20 We defined a primary care visit as an office-based encounter with a primary care physician. We used the claim category dedicated to ‘Professional office visits’ in the Health Cost Guideline grouper to identify office visits, which we verified to capture nearly all the primary care E&M visit codes.21 We defined clinicians as primary care physicians if their specialty was Family Medicine, Internal Medicine, or Pediatric Medicine.
Independent Variable: Physician-Level Continuity of Care (Phy-CoC) Score
To calculate Phy-CoC scores, we followed the 2-step method applied in previous studies.10,11 First, we calculated the BBI score for each patient using Formula 1 where is the number of visits the patient had with physician i, N is the total number of visits, and k is the number of physicians seen by the patient. Depending on the number of visits to unique physicians, the BBI ranges from 0 to 1 with patients whose visits are with the same primary care physician having a BBI of 1. (1)
Then, for each physician, we computed an average of patient weighted by the total number of visits, , for all p attributed patients to obtain the Phy-CoC score, ranging from 0 to 1 (Formula 2). To compare with prior studies, we categorized scores into quintiles from 1 (bottom quintile, lowest scores) to 5 (top quintile, highest scores). As this study expanded the patient population to include younger patients, we expected our Phy-CoC scores to differ from those based solely on older patients. (2)
Outcome Variables
To determine whether the established associations between Phy-CoC and patient outcomes can be generalized to patients of all ages, we examined 2 cost and utilization outcomes that have been shown to benefit from higher Phy-CoC in older Medicare populations: total cost and preventable hospitalization.
Total cost was calculated by summing total allowed costs for all claim types of a patient including professional, inpatient, outpatient, prescription, and ancillary claims. If a patient had multiple insurance coverage, for example both Medicare and Medicaid, claims of both payers will be included in total cost. We calculated average patient cost in descriptive analysis but used log-transformed cost in regression analysis to account for the right-skewness of the cost distribution.
A preventable hospitalization was identified if the condition for the hospital admission matched 1 of the conditions listed in the specification of PQI-90 composite measure by Agency for Health care Research and Quality.19 In VA-APCD, the determination of preventable hospitalization was readily available by linking to the Evidence-Based Measures data addition. We created a dichotomous variable to indicate patients with any preventable hospitalization.
Other Covariates
To account for potential confounders of the outcomes, we obtained information on patient age, gender, primary insurance payer, rurality using Rural Urban Commuting Areas,22,23 social determinants of health using the Social Deprivation Index (SDI),24 comorbidity using Charlson Comorbidity Index (CCI),25 and risk adjustment for higher future medical expenditure using Milliman Advanced Risk Adjusters (MARA) risk adjustment coefficients.26 In addition, we attributed patients to a single physician with whom they had the most primary care visits in 2019 and included the specialty of the patient’s attributed physician as a covariate.27
Analysis
We first examined the distributions of Phy-CoC score quintiles by patient characteristics, physician specialty, and primary payer. We also calculated sample averages of total cost and rate of preventable hospitalization by Phy-CoC quintiles. To simplify the statistical comparison to lower Phy-CoC scores in adjusted analysis, we kept quintiles 3 to 5 as higher levels of Phy-CoC and combined quintiles 1 and 2 as the reference category. For total cost, we performed linear mixed regression estimating percentage change in total cost associated with Phy-CoC. We chose this model after running into convergence and fit issues with the standard log-linked generalized linear model. For preventable hospitalization, we performed mixed logistic regression modeling of the odds of any preventable hospitalization. To determine whether the adjusted associations would be affected by the inclusion of healthier individuals, that is, patients with 1 primary care visit during the year, we conducted a sensitivity analysis in a restricted sample of patients with 2 or more visits. All models were at patient level and included a random intercept to adjust for clustering at physician level and accounted for patient, physician, and payer covariates. To allow for heterogeneity of effects with Phy-CoC, additional models with interactions between Phy-CoC and select covariates were estimated if Phy-CoC was significant associated with the modeled outcome. This study was approved by the American Academy of Family Physicians Institutional Review Board.
Results
The study sample included more than 1.6 million Virginians with 1 or more office-based primary care visits in 2019 who were attributed to a single physician with whom they had the greatest number of visits (Table 1). Patients in quintile 1 were attributed to physicians with the lowest Phy-CoC scores and patients in quintile 5 the highest. The average age of patients attributed to physicians in the bottom quintile of continuity was 28 years old, much younger that those of physicians with higher Phy-CoC. Rural residents were more likely than urban residents to have an attributed physician with higher Phy-CoC, that is, quintiles 4 or 5. In 2019, Virginia patients attributed to physicians in the top quintile of Phy-CoC were more likely to live in more disadvantaged areas, to have a greater number and/or more severe forms of comorbidities, and increased risks for higher future medical expenditure. The same group of patients also had higher average cost and were more likely to be hospitalized for preventable causes. Only 8.3% of Medicare beneficiaries were attributed to physicians in the bottom quintile of Phy-CoC compared with 26.9% of commercially insured patients and 34.7% of Medicaid enrollees. Compared with patients of family physicians or internists, pediatric patients were much less likely to be attributed pediatricians with higher Phy-CoC.
Table 2 summarized adjusted associations between Phy-CoC and 2 patient outcomes: total cost and odds of preventable hospitalization. Accounting for patient, physician, and payer covariates, patients attributed to physicians with higher Phy-CoC scores (quintile 3 to 5) were associated with 7%-11.8% higher total cost (ie, $368-$574 increase in cost) than patients attributed to physicians with lower Phy-CoC scores (quintiles 1&2). Female patients, patients with higher comorbidities as determined by log-transformed CCI scores, and patients with higher health risk as determined by log-transformed MARA scores were associated with the largest increases in total cost. In contrast, the total cost of Medicare and Medicaid patients was 34.9% and 25.0% lower respectively than commercial patients. Patients of pediatricians had 10.4% lower total cost than patients of family physicians. Compared with the significant associations with the cost outcome, patients with physicians of higher Phy-CoC scores were not significantly different in their odds of experiencing a preventable hospitalization. Patients of female gender, older ages, rural residence, higher CCI or MARA scores (both log-transformed), and who were primarily covered by Medicare or Medicaid had significantly higher odds of preventable hospitalization. As the specification of preventable hospitalization targets patients aged 18 and older,19 patients of pediatricians were excluded from this regression analysis. Restricting to patients with 2 or more primary care visits did not change the main associations between Phy-CoC, total cost and preventable hospitalization despite minor changes in the magnitude of the coefficients. Results of the sensitivity analysis results can be found in Appendix A.
Given the significant associations between Phy-CoC and total cost, we re-estimated the total cost model with 2-way interactions with physician specialty, patient’s primary payer, age, log-transformed CCI and MARA scores to investigate whether the effect on total cost was heterogeneous at distinct levels of these covariates (Table 3). For pediatric patients relative to patients of family physicians within the same quintile, attributed to pediatricians with higher Phy-CoC scores, that is, quintiles 3 to 5, was associated with significantly lower total cost (-12.6% to -26%). These large reductions should be interpreted with caution as they reflected changes in the effect of Phy-CoC resulting from interactions in the model and were relative to patients with family physicians who as a whole had 10% higher total cost than pediatric patients (in Table 2). This pattern largely held true for patients of older ages and with higher CCI scores. On the other hand, for Medicare and Medicaid patients, as well as patients with elevated risks of higher future medical expenditure, being attributed to physicians with higher Phy-CoC scores was overall associated with increases in total cost. Due to the non-significant associations of Phy-CoC with the odds of preventable hospitalization, we did not re-estimate the model with interactions.
To further contextualize the associations between Phy-CoC and total cost, we stratified the sample by patient’s primary insurance payer and specialty of the attributed physician and plotted the estimated effect on total cost (Figure 1). Data used to generate this figure were extracted from the total cost regression model that included 3-way interactions of Phy-CoC, patient age, and patient CCI scores (see Appendix B for full regression results). We simplified the visualization by presenting patients of family physicians and pediatricians, given that the results for patients of internists were comparable to those of family physicians. The x-axis is patient age, and the y-axis is the percentage difference in total cost between patients with the highest (quintile 5) and lowest (quintiles 1&2) Phy-CoC scores. The trend lines were drawn by payer and each color represented patients with a distinct CCI score, demonstrating the changing effect on total cost conditional on patient’s age and comorbidity.
For patients of family physicians, being attributed to physicians with the highest Phy-CoC was associated with significantly higher total cost indicated by the positive percentage values on the y-axis. However, the degree of cost increase was smaller for patients with greater comorbidities and declined dramatically as patients age. In contrast, for pediatric patients, being attributed to pediatricians with the highest Phy-CoC was associated with significantly lower total cost indicated by negative percentage values on the y-axis. The degree of cost reduction was slightly larger for patients with greater comorbidities and shrank as patients grew into adulthood.
Discussion
This study is the first to investigate the association between physician-level continuity of care (Phy-CoC) and common patient outcomes in a state-wide patient sample, expanding the evidence from older Medicare patients to patients of all ages and all types of insurance coverage. Across all adult patient populations, we found that being attributed to physicians with higher Phy-CoC was associated with higher total cost, a finding that was inconsistent with the evidence that higher Phy-CoC was associated with lower total cost in Medicare patients.10,11 We did not find a significant association between higher Phy-CoC and the odds of preventable hospitalization. In the discussion below, we focused on this important albeit unexpected main finding on total cost first. We also discuss the nuanced findings on patient age and comorbidity, payer, and physician specialty, with a goal to offer a more comprehensive picture of the relationship between Phy-CoC and patient cost across all patient populations.
First, the inclusion of pediatric patients and younger adults under the aged of 65, a main contribution of this study and a fundamental change in study design compared with previous studies, lowered Phy-CoC scores and most likely led to the difference in patient cost. To illustrate, In the 2018 study of Phy-CoC among Medicare beneficiaries,10 Phy-CoC scores were <0.6 for quintile 1 (the lowest) and >0.83 for quintile 5 (the highest). In the current study, Phy-CoC scores of quintile 1 and quintile 5 were <0.39 and >=0.73 respectively. The lower scores generated by full patient panels confirmed that Phy-CoC scores which are essentially weighted averages of patient BBI scores are sensitive to the patient base used for calculation. Mathematically speaking, full panel-based Phy-CoC scores are lowered by averaging higher BBI scores from older patients with lower BBI scores from younger patients. Consequently, achieving higher full panel-based Phy-CoC would require younger patients on the panel to have higher patient continuity, which would require greater utilization of primary care and other health services and drive the total cost up. Built on all patient populations, this finding suggests that achieving higher full panel-based Phy-CoC may be associated with unintended cost implications and that careful calibration of the target population is needed to achieve improvement in Phy-CoC while containing cost.
Second, the trend lines revealed nuanced associations between Phy-CoC and total cost with patient’s age and comorbidity, insurance payer, and the specialty of their physician, but also unavoidably made the interpretation less straightforward. The downward trend lines of patients of family physicians and internists captured the increasingly potent effect of having a physician with higher Phy-CoC on lowering cost for patients with advanced age and a greater number of comorbidities, while acknowledging the across-the-board cost elevation associated with higher Phy-CoC. The stratification by physician specialty and insurance payer highlighted the necessity to assess physician continuity by specialty even among primary care physicians and implied that macro factors such as eligibility rules instituted by insurance payers might be responsible for the varying magnitude of the associations. Pediatricians were the only group of physicians for whom achieving higher continuity was associated with lower cost for their patients regardless of age and comorbidity. Thus, efforts to improve Phy-CoC among pediatricians may be a promising way to lower total cost for pediatric patients.
In addition, notably, the use of All-Payer Claims Database, in contrast to previous studies using only Medicare claims, permitted the first comparison of Phy-CoC scores by payer. This led to the disturbing discovery that more than a third (34.7%) of Medicaid patients, highest among all payers studied, were attributed to physicians in the bottom quintile of Phy-CoC. This is concerning given the higher likelihood of social and economic disadvantages among Medicaid beneficiaries. This finding may hint at the need for targeted implementation of continuity measurement in Medicaid value-based payment plans, with incentives tied to higher scores to try and mitigate disparities in care outcomes. Finally, patients living in urban areas were less likely than those in rural to be attributed to physicians in top quintiles of Phy-CoC, a finding likely indicating easier access to specialty service and other clinical alternatives in urban areas. These finding may suggest the need to stratify by rural and urban measures of continuity used in value-based purchasing models.
Limitations
This study has several major limitations. First, despite the advantage of having all-payer claims from Virginia, this study was limited in its ability to generalize the findings to other states. Second, the cross-sectional design of the study produced a snapshot of the associations but did not allow longitudinal investigation which might be required to detect the true effect of higher Phy-CoC especially for younger and healthier adults, for whom multiple years may be needed for any cost savings to be observed. Third, although cost and utilization are commonly studied patient outcomes, the distinct care-seeking behaviors of younger versus older adults may render these outcomes less robust. Future studies are urged to identify outcomes that appeal to both younger and older patients and re-evaluate the associations with Phy-CoC.
Conclusion
We found an overall positive association of higher full panel-based Phy-CoC with total cost, but a nonsignificant association with the risk of preventable hospitalization. This comprehensive examination of Phy-CoC using all populations from the VA-APCD yielded important insights of factors with remarkable influence over the associations between Phy-CoC and patient’s total cost, including patient’s age and comorbidity, insurance payer, and the specialty of attributed physician, allowing more contextualized interpretation. Achieving higher full panel-based Phy-CoC may have unintended cost implications.
Appendix.
Appendix
Notes
This article was externally peer reviewed.
This is the Ahead of Print version of the article.
Funding: This study was funded by the American Board of Family Medicine Foundation.
Conflict of interest: Drs. Dai, Morgan, Peterson, and Bazemore declared no conflict of interest.
Dr. Russel’s declaration: VHI received funding from the ABFM, under contract to the Virginia Center for Health Innovation (VCHI), to provide access to Virginia All Payer Claims Database (APCD) data and related technical support for the submitted study topic.
Dr. Bortz’s declaration: VCHI received funding from the ABFM Foundation to oversee this specific physician-continuity research project, and a portion of the funding was to support staff time dedicated to research findings dissemination.
To see this article online, please go to: http://jabfm.org/content/00/00/000.full.
- Received for publication March 24, 2023.
- Revision received July 5, 2023.
- Accepted for publication July 18, 2023.