Publication
Article
The American Journal of Managed Care
Author(s):
A community-based care management program for high-risk patients reduced hospital readmissions and also likely reduced admissions and Medicare parts A and B spending.
ABSTRACT
Objectives: Medicare, Medicaid, and commercial plans have all explored ways to improve outcomes for patients with high costs and complex medical and social needs. The purpose of this study was to test the effectiveness of a high-intensity care management program that the Rutgers University Center for State Health Policy (CSHP) implemented as an adaptation of a promising model developed by the Camden Coalition of Healthcare Providers.
Study Design: We estimated the impact of the program on 6 utilization and spending outcomes for a subgroup of beneficiaries enrolled in Medicare fee-for-service (n = 149) and a matched comparison group (n = 1130).
Methods: We used Medicare claims for all analyses. We used propensity score matching to construct a comparison group of beneficiaries with baseline characteristics similar to those of program participants. We employed regression models to test the relationship between program enrollment and outcomes over a 12-month period while controlling for baseline characteristics.
Results: A test of joint significance across all outcomes showed that the CSHP program reduced service use and spending in aggregate (P = .012), although estimates for most of the individual measures were not statistically significant. Participants had 37% fewer unplanned readmissions (P = .086) than did comparison beneficiaries. Although we did not find statistically significant results for the other 5 outcomes, the CIs for these outcomes spanned substantively large effects.
Conclusions: Although these findings are mixed, they suggest that adaptations of the Camden model hold promise for reducing short-term service use and spending for Medicare super-utilizers.
Am J Manag Care. 2018;24(11):e365-e370Takeaway Points
An independent evaluation of a high-intensity care management program implemented by provider groups in 4 states shows that the model holds promise for efforts to reduce short-term service use and spending based on an analysis of 149 Medicare patients with complex medical and social needs. These findings may help managed care decision-makers to:
Team-based care models designed to address the needs of super-utilizers—defined as patients with frequent hospital use and complex health issues—are proliferating in response to the cost of caring for such patients using traditional approaches.1 Medicare, Medicaid, and commercial insurers have all explored ways to improve quality and cost outcomes for super-utilizers.2-5 Arguably, the most recognized is the “hotspotting” model pioneered by the Camden Coalition of Healthcare Providers in New Jersey, first brought to national attention by an article in The New Yorker.6 In the Camden model, interdisciplinary mobile care teams provide high-intensity care management and care coordination to individuals with multiple chronic conditions. The model differs from many other care management models in its focus on both medical and social determinants of health among people with high service use.
So far, interest in programs to help super-utilizers has outpaced the available evidence on their effectiveness. Results from an early evaluation of the Camden model were promising: The Camden Coalition reported reductions in emergency department (ED) visits, inpatient admissions, and average charges per month among participants in a pilot program.7,8 However, the study included only 36 participants and used a pre-post design that did not control for regression to the mean or for confounding factors that might influence outcomes. Regression to the mean is particularly important in interventions in which patients are selected because of their recent service use; some decline in service use post enrollment would be expected without any intervention.9 No independent rigorous evaluation of the Camden model has been published to date, although a randomized controlled trial is ongoing.1 Evaluations of similar care management models have yielded mixed findings over time.3,4,10-13
Recognizing the need for evidence, the Center for Medicare & Medicaid Innovation awarded a $14.3-million Health Care Innovation Award to the Rutgers University Center for State Health Policy (CSHP) to support adoption of the Camden model by provider groups in 4 states: (1) an independent physician association in San Diego, California; (2) a nonprofit community health center in Aurora, Colorado; (3) a nonprofit health system with 2 hospitals in Kansas City, Missouri; and (4) a nonprofit operator of 2 federally qualified health centers in Allentown, Pennsylvania. These provider groups targeted super-utilizers living in poor neighborhoods within their service areas.
Researchers affiliated with the Aurora site provided suggestive evidence on the program’s impacts on a group of primarily Medicaid-eligible beneficiaries. They found that it reduced ED visits and hospitalizations and increased primary care use among program participants in Colorado.14 However, the study’s comparison group included patients who declined to participate in the program, potentially biasing results.
In this article, we present evidence from an independent evaluation of the CSHP program across all 4 sites. Our evaluation included prespecified hypotheses that the program would (1) reduce total admissions, particularly readmissions, and (2) reduce Medicare parts A and B spending.15 We used rigorous tests that account for regression to the mean with a well-matched comparison group. This study provides a unique perspective on how the original Camden model can be adapted to a variety of settings and provider groups and adds to the available evidence on care management programs for super-utilizers.
METHODS
Enrollment
The 4 CSHP sites enrolled 1068 participants between January 2013 and June 2015. Initially, all 4 sites used the same utilization-based criteria as the Camden model—2 or more hospital admissions in the past 6 months—to identify potential participants. Two sites amended these thresholds early in the award period to expand the pool of potential participants: One site targeted individuals with 2 or more hospital admissions in the prior 6 months or 3 or more admissions in the prior 12 months, and the other targeted individuals with 3 or more hospital events (admissions or ED visits) in the prior 6 months. Among those who met the utilization-based criteria, the sites excluded patients whose conditions, such as cancer or serious behavioral issues, could not be managed with existing program resources.16
Intervention
All 4 sites received technical assistance from the Camden Coalition to guide implementation of the intervention. The sites implemented the same basic set of activities, including development of individualized care plans, integrated care management services through mobile care teams, and education to improve patients’ ability to manage their medical and social needs. Care teams, which included some combination of nurses, community health workers, social workers, medical assistants, and/or behavioral health providers, provided education about the importance of using primary and specialty care instead of, or as a follow-up to, emergency and hospital care. They also addressed participants’ nonmedical needs, including enrollment in social services (such as housing and Social Security disability benefits) and behavioral health service programs.
On average, teams contacted participants 10 times per month, spending roughly 6 hours with each participant per month. The majority of that time (87%) was spent in person, at the participants’ homes and medical appointments, and the remainder was on the phone. Participants remained in the program for an average of 4.2 months, ideally until their health and social circumstances had stabilized and the program could graduate them. By June 2015, the program had graduated 673 participants, although some continued to receive occasional support from the care teams. Additional detail on the intervention is available in a CMS evaluation report.16
Study Population
Although the program’s 1068 participants had public, private, or no insurance, our study population is limited to 149 participants with Medicare fee-for-service (FFS) coverage for whom we could obtain service use and spending data for a 12-month period prior to program enrollment. At the time that we conducted the evaluation, these data were only available for Medicare FFS beneficiaries. Using Medicare claims, we selected 1130 comparison Medicare FFS beneficiaries who met the health and utilization criteria for CSHP program eligibility and were similar to the treatment group beneficiaries on other characteristics. For each potential comparison beneficiary, we created a pseudo-enrollment date to approximate the date that the beneficiary would have enrolled in the intervention if he or she had been in the treatment group. We used propensity scores to match potential comparison beneficiaries to treatment group beneficiaries using geography, baseline (preintervention) measures of service use and spending, chronic conditions, and other demographic and health-related variables (Table 117-26).27
Data Sources and Measures
We used data from the Medicare enrollment database and claims. We defined outcomes quarterly for the 12 months before and after each beneficiary’s enrollment date, so each beneficiary had outcomes in 4 baseline quarters and up to 4 postenrollment quarters in the analysis sample. We estimated impacts on 6 outcomes that the program was designed to address, which we specified prior to the evaluation: all-cause inpatient admissions, inpatient admissions for ambulatory care—sensitive conditions (ACSCs), 30-day unplanned readmissions, outpatient ED visits, Medicare parts A and B spending, and inpatient spending.
Analytic Strategy
We estimated impacts as the regression-adjusted difference between comparison and treatment group beneficiaries in each of the outcomes during the year after enrollment. We used an intent-to-treat design and thus included some patients who dropped out of the program prior to graduation. The regressions adjusted for the same variables used in matching (Table 117-26). We used 2-sided tests of significance with a P <.10 threshold rather than a P <.05 threshold because we were concerned about both type II and type I errors given the small size of the treatment population. This threshold has been applied in other evaluations of care management programs when policy makers needed to identify promising care models even if additional evidence was necessary before those models could be deemed to have significant impacts at the standard threshold of P <.05.11 To examine the aggregate impact of the program on service use and spending, we also conducted a test of joint significance across all outcomes. We used bootstrapping to estimate standard errors in all tests; this method accounted for clustering of outcomes at the individual level.
RESULTS
Baseline Characteristics
The characteristics of the treatment group were consistent with CSHP’s target population: individuals with multiple chronic conditions (7.7 on average) who were frequent users of hospital care (Table 117-26). Service use and spending were roughly 10 times and 7 times the Medicare FFS average, respectively. The treatment group was also distinct from the average Medicare beneficiary in terms of demographic characteristics and reason for Medicare eligibility. They were younger and more likely to live in high-poverty areas, be entitled to Medicare due to disability or end-stage renal disease, and have dual Medicare and Medicaid coverage.
The observable characteristics of the matched comparison group were very similar to those of the treatment group at the start of the intervention. Groups were well balanced on all variables (Table 117-26) and had similar trends in the outcome variables over the 4 quarters leading up to the intervention (Figure).
Impact Estimates
The treatment group had 0.126 (37%) fewer unplanned readmissions on average per quarter than comparison beneficiaries (P = .086; 90% CI, —0.247 to –0.004]). The point estimates for admissions (–16%), ACSC admissions (–14%), and total spending (–9%) were all large and in the favorable direction, whereas the estimates for ED visits (5%) and inpatient spending (–1%) were close to zero. None of these 5 estimates was individually statistically significant (Table 2). A joint test indicated that, as a group, the estimates for all 6 prespecified outcomes were significantly different from zero (P = .012).
DISCUSSION
CSHP’s intervention contributes to a growing body of evidence on the use of care management programs to improve patient outcomes. Our results indicate that the program substantially reduced readmissions (by an estimated 37%) and suggest that it may have reduced all-cause admissions, ACSC admissions, and Medicare parts A and B spending. Many other care management interventions have not achieved this type of success.11,13,28 However, the CSHP program shares several distinctive features with the relatively few other models that have succeeded in reducing hospital admissions and/or readmissions, including targeting very high-risk patients and providing frequent in-person contact.4,12
Another distinguishing feature of the CSHP program was its attention to social determinants of health. There is a growing understanding that social determinants affect health and service use, but payers and providers need more evidence on interventions that effectively address these issues, as they are particularly difficult to attend to during medical encounters.1 The results of this study suggest that adaptations of the Camden model are promising for these purposes and are feasible to implement in various settings.
Limitations
Similar to other evaluations of comprehensive care management programs, our study’s main limitation was low sample size, in part because we were limited to studying Medicare beneficiaries, who accounted for only 26% of all enrollees in the CSHP program. The low sample size reduced the likelihood of finding a statistically significant impact on outcomes and prevented further investigation into whether effects might have differed for certain subpopulations (eg, by implementation site). Findings by Capp et al of significant reductions in ED visits at the Colorado site, which primarily enrolled Medicaid beneficiaries, suggest that this could be the case.14 There may also be some selection criteria for program enrollment that we could not fully replicate in claims data when selecting the comparison group. Finally, we could not compare program savings with costs because we estimated savings for only a fraction of participants and the costs were spread over all participants. Although it is possible that the costs of the program exceed the short-term savings to Medicare, any future cost-benefit analysis should take into account long-term costs and benefits of the program.
CONCLUSIONS
This study assessed whether, under CMS’s innovation award, the CSHP community-based care management program could improve the outcomes of super-utilizers across 4 implementation sites. Findings on this adaptation of a well-known super-utilizer program provide insight into the ability to replicate program impacts in different settings. In aggregate, there is sufficient evidence to suggest that the CSHP program reduced service use and parts A and B spending among Medicare beneficiaries. Although these results are promising, the Camden model will need further testing at larger scales before it is possible to make stronger conclusions about its impacts. 
Acknowledgments
The authors are grateful for programming and technical support from Mark Ezzo, Andrew McGuirk, Sandi Nelson, and Frank Yoon. They also thank the Center for State Health Policy staff (Margaret Koller, Joel Cantor, Jolene Chou) and staff at all of the implementation sites for giving them detailed program data and valuable perspectives on their implementation experience.Author Affiliations: Mathematica Policy Research, Princeton, NJ (PS, CNS, KK, LM), Ann Arbor, MI (KWVB), Washington, DC (GP, LB), Cambridge, MA (BG), and Chicago, IL (KS); Centers for Medicare & Medicaid Services (TD), Baltimore, MD.
Source of Funding: Evaluation funded by CMS, Center for Medicare & Medicaid Innovation, contract number HHSM-500-2010-000261/HHSM-500-T0015. The contents of this publication are solely the responsibility of the authors and do not necessarily represent the official views of HHS or any of its agencies.
Author Disclosures: The authors report no relationship or financial interest with any entity that would pose a conflict of interest with the subject matter of this article.
Authorship Information: Concept and design (PS, KWVB, TD, GP, BG, LB, KK, KS, LM); acquisition of data (PS, CNS, KWVB, GP, LM); analysis and interpretation of data (PS, CNS, KWVB, GP, BG, LB, KK, KS, LM); drafting of the manuscript (PS, CNS, KWVB, TD, GP); critical revision of the manuscript for important intellectual content (PS, CNS, KWVB, TD, GP, LB, KK, KS, LM); statistical analysis (PS, GP, KK); provision of patients or study materials (GP); obtaining funding (GP, LM); administrative, technical, or logistic support (TD, KS, LM); and supervision (GP, BG, LM).
Address Correspondence to: Purvi Sevak, PhD, Mathematica Policy Research, 600 Alexander Park, Princeton, NJ 08540. Email: psevak@mathematica-mpr.com.REFERENCES
1. Vaida B. For super-utilizers, integrated care offers a new path. Health Aff (Millwood). 2017;36(3):394-397. doi: 10.1377/hlthaff.2017.0112.
2. Mann C. Targeting Medicaid super-utilizers to decrease costs and improve quality. Medicaid website. medicaid.gov/federal-policy-guidance/downloads/cib-07-24-2013.pdf. Published July 24, 2013. Accessed December 13, 2016.
3. Bodenheimer T. Strategies to reduce costs and improve care for high-utilizing Medicaid patients: reflections on pioneering programs. Center for Health Care Strategies, Inc website. chcs.org/media/HighUtilizerReport_102413_Final3.pdf. Published October 2013. Accessed December 13, 2016.
4. Hong CS, Siegel AL, Ferris TG. Caring for high-need, high-cost patients: what makes for a successful care management program? The Commonwealth Fund website. commonwealthfund.org/~/media/files/publications/issue-brief/2014/aug/1764_hong_caring_for_high_need_high_cost_patients_ccm_ib.pdf. Published August 7, 2014. Accessed December 13, 2016.
5. Programs focusing on high-need, high-cost populations. Center for Health Care Strategies, Inc website. chcs.org/resource/programs-focusing-high-need-high-cost-populations. Published April 2016. Accessed December 13, 2016.
6. Gawande A. The hot spotters: can we lower medical costs by giving the neediest patients better care? The New Yorker. January 24, 2011. newyorker.com/magazine/2011/01/24/the-hot-spotters. Accessed October 9, 2018.
7. Brenner J. Reforming Camden’s health care system—one patient at a time. Jefferson School of Population Health website. jdc.jefferson.edu/cgi/viewcontent.cgi?article=1047&context=pehc. Published Summer 2009. Accessed December 13, 2016.
8. Green SR, Singh V, O’Byrne W. Hope for New Jersey’s city hospitals: the Camden initiative. Perspect Health Inf Manag. 2010;7:1d.
9. Johnson TL, Rinehart DJ, Durfee J, et al. For many patients who use large amounts of health care services, the need is intense yet temporary. Health Aff (Millwood). 2015;34(8):1312-1319. doi: 10.1377/hlthaff.2014.1186.
10. Bleich SN, Sherrod C, Chiang A, et al. Systematic review of programs treating high-need and high-cost people with multiple chronic diseases or disabilities in the United States, 2008-2014. Prev Chronic Dis. 2015;12:E197. doi: 10.5888/pcd12.150275.
11. Peikes D, Chen A, Schore J, Brown R. Effects of care coordination on hospitalization, quality of care, and health care expenditures among Medicare beneficiaries: 15 randomized trials. JAMA. 2009;301(6):603-618. doi: 10.1001/jama.2009.126.
12. Brown RS, Peikes D, Peterson G, Schore J, Razafindrakoto CM. Six features of Medicare coordinated care demonstration programs that cut hospital admissions of high-risk patients. Health Aff (Millwood). 2012;31(6):1156-1166. doi: 10.1377/hlthaff.2012.0393.
13. Peterson GG, Zurovac J, Brown RS, et al. Testing the replicability of a successful care management program: results from a randomized trial and likely explanations for why impacts did not replicate. Health Serv Res. 2016;51(6):2115-2139. doi: 10.1111/1475-6773.12595.
14. Capp R, Misky GJ, Lindrooth RC, et al. Coordination program reduced acute care use and increased primary care visits among frequent emergency care users. Health Aff (Millwood). 2017;36(10):1705-1711. doi: 10.1377/hlthaff.2017.0612.
15. Sevak P, Stepanczuk C, Bradley K, et al. Chapter 7: Rutgers Center for State Health Policy. In: Peterson G, Blue L, Moreno L, et al. Evaluation of Health Care Innovation Awards (HCIA): Primary Care Redesign Programs: Third Annual Report. Princeton, NJ: Mathematica Policy Research; 2017:393-443. downloads.cms.gov/files/cmmi/hcia-primarycareredesign-thirdannualrpt.pdf. Accessed May 18, 2018.
16. Moreno L, Gilman B, Peterson G, et al. Evaluation of the Health Care Innovation Awards (HCIAs): Primary Care Redesign Programs: Second Annual Report. Princeton, NJ: Mathematica Policy Research; 2015. downloads.cms.gov/files/cmmi/hcia-primarycareredesignprog-secondannualrpt.pdf. Accessed October 9, 2018.
17. Table IV.1. Medicare short-stay hospital utilization. In: HHS. 2014 CMS Statistics. Washington, DC: HSS; 2014:36. cms.gov/Research-Statistics-Data-and-Systems/Statistics-Trends-and-Reports/CMS-Statistics-Reference-Booklet/Downloads/CMS_Stats_2014_final.pdf. Accessed January 13, 2018.
18. Gerhardt G, Yemane A, Apostle K, Oelschlaeger A, Rollins E, Brennan N. Evaluating whether changes in utilization of hospital outpatient services contributed to lower Medicare readmission rate. Medicare Medicaid Res Rev. 2014;4(1). doi: 10.5600/mmrr2014-004-01-b03.
19. Table V.D1. In: The 2013 Annual Report of the Boards of Trustees of the Federal Hospital Insurance and Federal Supplementary Medical Insurance Trust Funds. Washington, DC: Boards of Trustees of the Federal Hospital Insurance and Federal Supplementary Medical Insurance Trust Funds; 2013:213. downloads.cms.gov/files/TR2013.pdf. Accessed August 13, 2014.
20. DeNavas-Walt C, Proctor BD, Smith JC. Income, poverty, and health insurance coverage in the United States: 2012. US Census Bureau website. census.gov/prod/2013pubs/p60-245.pdf. Published September 2013. Accessed June 1, 2015.
21. Table B.2. Medicare beneficiary prevalence for chronic conditions for 2007 through 2016. Chronic Conditions Data Warehouse website. ccwdata.org/web/guest/medicare-tables-reports. Published 2017. Accessed January 13, 2018.
22. Section 2. Medicare beneficiary demographics. In: Data Book: Health Care Spending and the Medicare Program. medpac.gov/docs/default-source/data-book/jun17_databooksec2_sec.pdf. Published 2017. Accessed January 13, 2018.
23. CMS Chronic Conditions Data Warehouse (CCW). Table A.1. Medicare beneficiary counts for 2007 through 2016. Chronic Conditions Data Warehouse website. ccwdata.org/documents/10280/19096644/ccw-website-table-a1a.pdf. Published 2017. Accessed January 13, 2017.
24. Appendix A: CMS Chronic Conditions Data Warehouse (CCW): CCW condition algorithms. HHS Office of the Assistant Secretary for Planning and Evaluation website. aspe.hhs.gov/system/files/pdf/252376/AppendixA.pdf. Updated July 2016. Accessed October 9, 2018.
25. CMS Chronic Conditions Data Warehouse (CCW): other chronic and potentially disabling condition algorithm references. Chronic Conditions Data Warehouse website. ccwdata.org/documents/10280/19139421/other-condition-algorithms-reference-list.pdf. Published September 2015. Accessed January 13, 2018.
26. Dual eligibles as a percent of total Medicare beneficiaries. Kaiser Family Foundation website. kff.org/medicaid/state-indicator/duals-as-a-of-medicare-beneficiaries. Published 2016. Accessed February 16, 2017.
27. Stuart EA. Matching methods for causal inference: a review and a look forward. Stat Sci. 2010;25(1):1-21. doi: 10.1214/09-STS313.
28. Nelson L. Lessons from Medicare’s demonstration projects on disease management and care coordination. Congressional Budget Office website. cbo.gov/sites/default/files/112th-congress-2011-2012/workingpaper/WP2012-01_Nelson_Medicare_DMCC_Demonstrations_1.pdf. Published January 2012. Accessed January 9, 2018.