Publication
Article
The American Journal of Managed Care
Author(s):
Alternative payment models (APMs) introduce value-based incentives for greater hospital health information exchange (HIE) engagement. We find that APM participation is associated with lower HIE volume and greater HIE diversity, breadth, and depth.
ABSTRACT
Objectives: To assess whether hospital participation in alternative payment models (APMs) is associated with greater engagement in health information exchange (HIE) along 4 dimensions: volume of patients for whom information is exchanged, diversity of information types, breadth of partner types, and depth of technical approach.
Study Design: Pooled, cross-sectional analysis of data on US hospitals from 2014 to 2015.
Methods: APM participation came from Leavitt Partners data, Medicare public use files, and the American Hospital Association (AHA) Annual Survey. We used Medicare data to measure HIE volume for 798 hospitals attesting to stage 2 Meaningful Use and the AHA Information Technology Supplement to measure HIE diversity, breadth, and depth for 1730 hospitals. We used mixed-effects regression to estimate the association between participation in APMs and each dimension of HIE.
Results: Compared with nonparticipating hospitals, full-year APM participation was associated with lower HIE volume (data were sent for 11 percentage points fewer discharges; P = .003), greater HIE diversity (of 4 data types, 0.3 more were transmitted; P <.001), greater HIE breadth (of 3 partner types, data were sent to 0.3 more; P <.001), and greater HIE depth (the odds of using a push and pull approach were 1.68 times greater; P = .004).
Conclusions: Our finding that APM participation was associated with greater HIE diversity, breadth, and depth suggests that value-based payment may be spurring improvements in HIE infrastructure. However, our finding that APM participation is associated with lower HIE volume suggests that there may be an incentive to focus HIE investments on a limited number of partners.
Am J Manag Care. 2019;25(1):e1-e6Takeaway Points
Under alternative payment models (APMs), hospitals are incentivized to improve health information exchange (HIE) engagement in order to facilitate better healthcare quality and reduce cost. However, even under value-based reimbursement, substantial challenges to improving HIE may still remain.
Failures in information sharing between hospitals and postacute care providers following hospital discharge can result in higher-cost, lower-quality care.1-3 Electronic health information exchange (HIE) can improve the accessibility of information during hospital discharges, leading to cost savings and better outcomes.4,5 However, volume-based reimbursement does not create incentives for provider organizations to engage in HIE.4-8 Medicare’s alternative payment models (APMs) are expected to change this dynamic: By rewarding hospitals for improving the quality and cost-efficiency of care received across the care continuum, APMs create financial incentives for hospitals to engage in greater HIE.9 However, even under APMs, significant barriers, such as lack of technical standards across electronic health record (EHR) products, poor usability of HIE solutions, concerns about data security, and potential loss of profitable fee-for-service patients to competitors, may impede hospital pursuit of HIE.4,10
If hospitals participating in APMs are not engaging in greater HIE, it is an ominous sign about the potential for HIE growth, as it suggests that even aligned financial incentives are not strong enough to overcome these barriers. It is therefore important to not only assess whether APM participation is associated with greater hospital HIE, but to do so in a way that reflects the multiple ways that HIE can generate value under APMs. Given that avoiding hospital readmissions is a core performance metric under APMs, improving HIE between hospitals and postacute care providers is likely to be a prioritized use case for HIE.
The extent of hospital HIE engagement with postacute care can be measured along 4 dimensions: volume, diversity, breadth, and depth.11 Volume refers to the proportion of discharged patients for whom data are transmitted electronically. Diversity refers to the types of data that are transmitted electronically. Breadth refers to the types of trading partners to whom data are electronically transmitted. Finally, depth refers to the nature of the technical approach through which data are transmitted (ie, push and/or pull).
Prior research on the association between APMs and HIE suggests that HIE is perceived as valuable to the achievement of financial rewards under APMs.12-14 However, these studies have not systematically examined whether hospitals in APMs engage in greater HIE or whether HIE efforts focus specifically on supporting care coordination following discharges.
To assess whether participation in APMs is associated with greater HIE engagement with postacute care providers along 4 dimensions (volume, diversity, breadth, and depth), we used mixed-effects regression analysis on data on US hospitals from 2014 to 2015. We defined APM participation as the proportion of the calendar year that a hospital participated in at least 1 of the following programs: Medicare or commercial accountable care organizations (ACOs), the Medicare Bundled Payments for Care Improvement (BPCI) initiative, and any type of medical home. Results from this study are critical to informing policy efforts aimed at improving interorganizational care coordination—a national policy priority. In particular, this work sheds light on challenges that may exist in reaching that goal through greater HIE under value-based incentives, such as those initiated under the Medicare Access and CHIP Reauthorization Act of 2015 (MACRA).
METHODS
Setting and Data Sources
The study population includes all nonfederal acute care hospitals in the continental United States with HIE data for at least 1 year of the study period. Data for this study came from the Leavitt Partners ACO database (current as of 2016), 2014-2015 Medicare BPCI public use file, 2014-2015 American Hospital Association (AHA) Annual Survey, 2014-2015 Meaningful Use public use file, and 2017 Area Health Resource File.
Hospital Participation in APMs
Under MACRA, hospitals can participate in APMs that provide value-based incentives for hospitals to engage in HIE. With APM participation, hospitals are held accountable for the cost and quality of care provided by their outpatient partners. APMs include ACOs, the BPCI program, and medical homes. ACOs offer shared savings to participating hospitals if per-patient spending is lower than a targeted amount. The BPCI program bundles inpatient and outpatient services into single episodes of care. Lastly, hospitals can participate in medical homes as part of their hospital-based ambulatory care practices. Medical homes provide performance-based rewards, along with per-member-per-month fees for care management.15
Measures
Independent variable: APM participation. We measured hospital participation in APMs by calculating the portion of the calendar year in which a hospital participated in any APM (a Medicare or commercial ACO, phase 2 of any BPCI model, and/or a medical home). ACO start dates for all ACOs formed as of 2016 were obtained from Leavitt Partners on Medicare or commercial ACO participation. Quarterly participation in BPCI was obtained from the Medicare public use file. Medical home participation was obtained from the AHA survey; because start and end dates were unavailable, we assumed full calendar year participation.
Dependent variables: 4 dimensions of HIE. Drawing on a framework developed by Massetti and Zmud, we measured HIE engagement along 4 dimensions: volume, diversity, breadth, and depth.11
We measured volume as the proportion of discharged patients for whom summary of care records (SCRs) were sent electronically during a hospital’s stage 2 Meaningful Use attestation period. (For more on this measure and methodology, refer to Lin et al.4) Data on this measure came from the Medicare Meaningful Use public use file.
Following prior work,16,17 we measured diversity as the number of data types (ie, structured SCRs, radiology results, laboratory results, and medical history) that are routinely sent electronically by a hospital to ambulatory providers outside its system.
Breadth indicates how successful a hospital is at creating and maintaining connections with a variety of partners. Following prior work,16 we measured breadth as the number of partner types (ie, out-of-system ambulatory care providers, long-term care providers, and behavioral health providers) to which a hospital routinely sends structured SCRs.
We measured depth by assessing whether or not a hospital routinely transmits SCRs using either push or pull, or both approaches. In the push approach, patient data are directly sent to another electronic system, whereas the pull approach aggregates data from multiple sources into a database that a provider can query. Hospitals that used neither push nor pull (eg, eFax, mail, or fax) were dropped from the analysis. Both push and pull approaches are useful for care coordination; however, the availability of both approaches is associated with greater provider satisfaction and higher use.18-20 A hospital was considered as using a push approach if it used secure messaging to routinely transmit SCRs and a pull approach if it used patient portals or Epic’s Care Everywhere HIE platform (ie, the hospital reported using Epic as their primary inpatient EHR vendor and using a third party to routinely transmit SCRs) to routinely transmit SCRs. Data on HIE diversity, breadth, and depth came from the AHA Information Technology Supplement.
Control variables. To control for potential confounding, we included controls that could be associated with both HIE engagement and APM participation: hospital size, urbanicity, teaching status, system membership, network membership, ownership, disproportionate share hospital (DSH) percentage, case mix index, critical access hospital status, and market share from the AHA Annual Survey and the Medicare Impact File.4,5,21,22 To control for confounding that may arise from the number of trading partners, we included the number of skilled nursing facilities (SNFs), hospitals, and primary care providers (PCPs) in the county from the Area Health Resource File. Missing controls for a given year were imputed using forward, then backward, imputation. If no data were available on 1 or more control variables, the hospital was dropped.
Analytic Approach: Design and Statistical Analysis
Using hospital-year data from 2014 to 2015, we used mixed-effects models regressing each dimension of HIE engagement on APM participation and controls; we included hospital mixed effects to control for unobserved heterogeneity over time and across hospitals, year fixed effects to control for temporal effects, and hospital-clustered standard errors to account for serial correlation. For our models of HIE volume, diversity, and breadth, we used linear regression; for our model of HIE depth, we used logistic regression.
Four sensitivity analyses were conducted: (1) To test whether our results were driven by concurrent participation in multiple APM types, we reran our analyses including the number of APM types in which a hospital participated; (2) To test whether participation in different APM types had different associations with HIE, we reran our analyses using a 3-way interaction term interacting participation in each of the 3 APM types in any given year; (3) To test whether using linear regression resulted in overestimated effect sizes, we reran the diversity and breadth models using negative binomial models; and (4) To test the sensitivity of our volume analysis to sample selection bias, we ran a Heckman model.
RESULTS
Of 6101 hospitals in the AHA Annual Survey Database from 2014 to 2015, we dropped 1537 noncontinental federal hospitals. Of the remaining 4564 hospitals, 2233 had data on all control variables. Of those, 798 had at least 1 year of data on HIE volume (397 had 1 year and 401 had 2 years) and were included in our sample for HIE volume analysis. There were 1730 hospitals that had at least 1 year of data on HIE diversity and breadth (550 had 1 year and 1180 had 2 years) and were included in our sample for those analyses. There were 1427 hospitals that had at least 1 year of data on HIE depth and used push and/or pull to transmit SCRs electronically (662 had 1 year and 765 had 2 years); these hospitals were included in our sample for HIE depth analysis (Table).
Hospitals in our samples differed in important ways from hospitals that were missing HIE data (eAppendix Table 1 [eAppendix available at ajmc.com]). Hospitals in all 3 samples were more likely to participate in APMs. They were also more likely to be nonprofit; to be in hospital networks; to be larger, urban, teaching hospitals; to have a higher case mix index and higher market share; and to be in counties with more SNFs and PCPs.
Unadjusted bivariate analyses revealed that, compared with nonparticipating hospitals, hospitals participating in APMs for any portion of the calendar year engaged in greater HIE on all dimensions except volume (eAppendix Figure 1). The average value of HIE volume was 53% among nonparticipating and 48% among participating hospitals. The average value of HIE diversity was 2.4 data types among nonparticipating and 3.1 data types among participating hospitals. The average value of HIE breadth was 1.2 partner types among nonparticipating and 1.8 partner types among participating hospitals. Of the subsample of hospitals that used push and/or pull approaches, the percentage of hospitals that used both push and pull approaches was 54% among nonparticipating and 69% among participating hospitals.
After adjusting for controls and hospital-specific trends, full-year APM participation was associated with a —11 percentage point difference in HIE volume (21% fewer discharges than nonparticipating hospitals; P = .001), a difference of 0.31 data types in HIE diversity (13% more data types than nonparticipating hospitals; P <.001), a difference of 0.29 partner types in HIE breadth (24% more partner types than nonparticipating hospitals; P <.001), and greater HIE depth (the odds of using both push and pull approaches were 1.68 times greater in participating than nonparticipating hospitals; P = .004) (Figure 1 and eAppendix Table 2).
To make these results more interpretable, the adjusted predicted 2015 values for each HIE dimension for a common hospital type (medium-sized, urban, nonteaching, nonsystem, nonnetwork, nonprofit, non—critical access hospital, with DSH percentage, case mix index, and market share held at their population means) are presented in Figure 2. The average predicted HIE volume for nonparticipating hospitals was 62% compared with 51% for hospitals participating for the full calendar year. The average predicted value for HIE diversity for nonparticipating hospitals was 2.8 data types compared with 3.1 data types for hospitals participating for the full calendar year. The adjusted predicted value for HIE breadth for nonparticipating hospitals was 1.4 partner types compared with 1.7 partner types for hospitals participating for the full calendar year. The probability of a nonparticipating hospital using both push and pull approaches versus only 1 approach was 72% compared with 80% among hospitals participating for the full calendar year.
Sensitivity Analysis
Results from our first sensitivity analyses suggest that our main results were not driven by concurrent participation in multiple APM types (eAppendix Table 3). Results from our second sensitivity analysis suggest that the associations between APM participation types and dimensions of HIE access are similar to our main analysis (eAppendix Figure 2). For ease of comparison, we used the model with 3-way interactions to estimate 95% CIs for each dimension of HIE for each pattern of APM participation. We then compared these CIs with that of our main analysis in Figure 2. Each of the CIs overlapped, suggesting that the associations between APM participation and dimensions of HIE did not significantly vary by APM participation type. Results from our third sensitivity analysis suggest that effect sizes from the analyses of HIE diversity and breadth may be slightly overestimated as a result of using linear models. However, because we were unable to run the negative binomial models using hospital mixed effects, we present the results of the negative binomial models in eAppendix Table 4. Results from our final sensitivity analysis revealed evidence of moderate sample selection bias (athrho = —0.42; P ≤.001). However, because results were similar to our main results and we were unable to control for hospital mixed effects in the Heckman model, we present these results in eAppendix Table 5.
DISCUSSION
Using national data on US hospitals from 2014 to 2015, we found that hospital APM participation was associated with greater HIE accessibility along 3 dimensions: diversity (number of transmitted data types), breadth (number of exchange partner types), and depth (number of technical approaches). However, APM participation had a negative association with HIE volume (percent of discharges in which an SCR was transmitted electronically). This finding suggests that challenges exist to increasing utilization of HIE for all patients under value-based reimbursement. There are several possible explanations. First, unlike other dimensions of HIE accessibility, greater HIE volume requires process and workflow changes that depend on clinician involvement. It may be that hospitals that participate in APMs increase the burden on clinicians to engage in multiple quality improvement initiatives at once, resulting in change fatigue and poorer performance on HIE volume. Change fatigue may be exacerbated by modifications to health information technology structures, which may be occurring under APMs.12,13 Another explanation is that, under APMs, hospitals focus HIE efforts on a few partner-specific connections, resulting in overall decreases in HIE, especially if HIE partners are not also those with whom hospitals share the highest volume of patients. On the other hand, APM-participating hospitals may be focusing HIE efforts on high-cost or complex patients to prevent readmissions. Future research should examine how the number of HIE partners changes under APMs, as well as patient-level factors that predict HIE use and the relationship to quality measures such as readmission rates.
Our finding that APM participation is associated with greater HIE diversity, breadth, and depth suggests that value-based payment reform may be spurring investments in HIE infrastructure as hospitals strive to achieve performance-based incentives through information-driven care coordination improvements for discharged patients.23 However, given the limitations of our cross-sectional design, we were unable to say with strong certainty whether these associations reflect a causal relationship. It is possible that instead of APM participation driving changes in HIE, hospitals that choose to join APMs are also those that exchange data for fewer patients and have more mature HIE systems. It will be important to continue monitoring HIE activities in APM-participating organizations in the future.
Our findings have important implications for policy makers. Prior efforts have primarily used direct incentives to promote HIE engagement through the Meaningful Use program. With the passage of the 21st Century Cures Act, efforts have shifted to developing interoperable infrastructures and reducing information blocking. This study suggests that indirect incentives, through the form of value-based payments, may be an effective driver of HIE infrastructure that can overcome competitive forces that drive information blocking, at least among the hospital population included in this study.22,24
Our findings suggest that even under value-based reimbursement, challenges may exist to improving HIE use. We find that APM participation is associated with worse HIE volume, which may be because hospitals restrict HIE efforts to a limited number of affiliated partners. This suggests that policies should focus on promoting HIE connections among all partners, not just those with whom hospitals have a strategic reason to share information. For example, medical home accreditation programs currently require engagement in HIE, but not a specific threshold of engagement. Specifying a threshold based on patient volume may incentivize hospitals to improve overall interoperability rather than focus on partner-specific connections. Future studies should also examine whether APMs are promoting HIE connections with the most appropriate partners. Prior evidence suggests that although hospital HIE infrastructure is improving, these connections may not be serving the highest-volume partnerships.25 On the other hand, APM-participating hospitals may be targeting HIE efforts toward high-cost or complex patients to prevent readmissions. Future research should also examine patient-level factors that predict HIE use.
Limitations
This study has important limitations. First, because measures of HIE were only available for 2014 to 2015, we were unable to use robust approaches to causal inference. Second, our measures of HIE dimensions do not take into account variation in other dimensions. For example, our measure of HIE breadth captures the number of partner types and not the number of partners within a single type with which a hospital shares information. It may be that hospitals only share information with a few partners of a specific type and we would not be able to detect this. Finally, because our analyses were restricted to hospitals with HIE data, hospitals in our sample differed from hospitals out of sample, limiting generalizability. Specifically, our sample for all models had a smaller proportion of smaller, rural, nonteaching, nonsystem, nonnetwork, or for-profit hospitals than hospitals out of sample (eAppendix Table 1). Therefore, our findings that APM participation is associated with lower HIE volume and higher HIE diversity, breadth, and depth may not apply to these hospitals. It will be important to assess whether our findings still hold for hospitals underrepresented in this study population.
CONCLUSIONS
Our study assesses the association between APM participation and HIE engagement along 4 important dimensions: volume of data exchange, diversity of data types, breadth of partner types, and depth of exchange approach. We find that APM participation is associated with lower HIE volume, but greater HIE diversity, breadth, and depth. This finding suggests that under value-based reimbursement, indirect incentives may improve HIE infrastructure, but significant challenges to achieving high HIE volume remain and may require more targeted policy actions.Author Affiliations: School of Public Health (SCL) and Department of Urology (JMH), University of Michigan, Ann Arbor, MI; Department of Medicine, University of California, San Francisco (JA-M), San Francisco, CA.
Source of Funding: This study was supported by the Agency for Healthcare Research and Quality grants 1R01HS024525 01A1 and 1R01HS024728 01 (JMH).
Author Disclosures: The authors report no relationship or financial interest with any entity that would pose a conflict of interest with the subject matter of this article.
Authorship Information: Concept and design (SCL, JA-M); acquisition of data (JMH); analysis and interpretation of data (SCL, JA-M); drafting of the manuscript (SCL, JA-M); critical revision of the manuscript for important intellectual content (SCL, JA-M); statistical analysis (SCL); provision of patients or study materials (JMH); administrative, technical, or logistic support (JMH); and supervision (JMH, JA-M).
Address Correspondence to: Sunny C. Lin, MS, School of Public Health, University of Michigan, 1415 Washington Heights, Ann Arbor, MI 48109. Email: sunnylin@umich.edu.REFERENCES
1. Moore C, Wisnivesky J, Williams S, McGinn T. Medical errors related to discontinuity of care from an inpatient to an outpatient setting. J Gen Intern Med. 2003;18(8):646-651. doi: 10.1046/j.1525-1497.2003.20722.x.
2. Frisse ME, Johnson KB, Nian H, et al. The financial impact of health information exchange on emergency department care. J Am Med Inform Assoc. 2012;19(3):328-333. doi: 10.1136/amiajnl-2011-000394.
3. Kripalani S, LeFevre F, Phillips CO, Williams MV, Basaviah P, Baker DW. Deficits in communication and information transfer between hospital-based and primary care physicians: implications for patient safety and continuity of care. JAMA. 2007;297(8):831-841. doi: 10.1001/jama.297.8.831.
4. Lin SC, Everson J, Adler-Milstein J. Technology, incentives, or both? factors related to level of hospital health information exchange. Health Serv Res. 2018;53(5):3285-3308. doi: 10.1111/1475-6773.12838.
5. Vest JR. More than just a question of technology: factors related to hospitals’ adoption and implementation of health information exchange. Int J Med Inform. 2010;79(12):797-806. doi: 10.1016/j.ijmedinf.2010.09.003.
6. Vest JR, Gamm LD. Health information exchange: persistent challenges and new strategies. J Am Med Inform Assoc. 2010;17(3):288-294. doi: 10.1136/jamia.2010.003673.
7. Adler-Milstein J, Lin SC, Jha AK. The number of health information exchange efforts is declining, leaving the viability of broad clinical data exchange uncertain. Health Aff (Millwood). 2016;35(7):1278-1285. doi: 10.1377/hlthaff.2015.1439.
8. Office of the National Coordinator for Health IT. Report to Congress: Report on Health Information Blocking. Washington, DC: HHS; 2015. healthit.gov/sites/default/files/reports/info_blocking_040915.pdf. Accessed October 22, 2018.
9. Alternative payment model design toolkit. CMS website. cms.gov/Medicare/Quality-Payment-Program/Resource-Library/Alternative-Payment-Model-APM-Design-Toolkit.pdf. Accessed October 22, 2018.
10. Walker DM, Hefner JL, Sova LN, Hilligoss B, Song PH, McAlearney AS. Implementing accountable care organizations: lessons from a qualitative analysis of four private sector organizations. J Healthc Manag. 2017;62(6):419-431. doi: 10.1097/JHM-D-16-00021.
11. Massetti B, Zmud RW. Measuring the extent of EDI usage in complex organizations: strategies and illustrative examples. MIS Q. 1996;20(3):331-345. doi: 10.2307/249659.
12. Berkowitz SA, Ishii L, Schulz J, Poffenroth M. Academic medical centers forming accountable care organizations and partnering with community providers: the experience of the Johns Hopkins Medicine Alliance for Patients. Acad Med. 2016;91(3):328-332. doi: 10.1097/ACM.0000000000000976.
13. Rundall TG, Wu FM, Lewis VA, Schoenherr KE, Shortell SM. Contributions of relational coordination to care management in accountable care organizations: views of managerial and clinical leaders. Health Care Manage Rev. 2016;41(2):88-100. doi: 10.1097/HMR.0000000000000064.
14. Holmgren AJ, Patel V, Adler-Milstein J. Progress in interoperability: measuring US hospitals’ engagement in sharing patient data. Health Aff (Millwood). 2017;36(10):1820-1827. doi: 10.1377/hlthaff.2017.0546.
15. PCMH costs, benefits and incentives. American College of Physicians website. acponline.org/practice-resources/business-resources/payment/delivery-and-payment-models/patient-centered-medical-home/pcmh-costs-benefits-and-incentives. Accessed July 26, 2018.
16. Cho NE, Ke W, Atems B, Chang J. How does electronic health information exchange affect hospital performance efficiency? the effects of breadth and depth of information sharing. J Healthc Manag. 2018;63(3):212-228. doi: 10.1097/JHM-D-16-00041.
17. Liang H, Xue Y, Byrd TA, Rainer RK Jr. Electronic data interchange usage in China’s healthcare organizations: the case of Beijing’s hospitals. Int J Inf Manage. 2004;24(6):507-522. doi: 10.1016/j.ijinfomgt.2004.08.001.
18. Campion TR Jr, Ancker JS, Edwards AM, Patel VN, Kaushal R; HITEC Investigators. Push and pull: physician usage of and satisfaction with health information exchange. AMIA Annu Symp Proc. 2012;2012:77-84.
19. Bates DW, Samal L. Interoperability: what is it, how can we make it work for clinicians, and how should we measure it in the future? Health Serv Res. 2018;53(5):3270-3277. doi: 10.1111/1475-6773.12852.
20. Kuperman GJ. Health-information exchange: why are we doing it, and what are we doing? J Am Med Inform Assoc. 2011;18(5):678-682. doi: 10.1136/amiajnl-2010-000021.
21. Dranove D, Forman C, Goldfarb A, Greenstein S. The trillion dollar conundrum: complementarities and health information technology. Am Econ J Econ Policy. 2014;6(4):239-270. doi: 10.1257/pol.6.4.239.
22. Adler-Milstein J, DesRoches CM, Jha AK. Health information exchange among US hospitals. Am J Manag Care. 2011;17(11):761-768.
23. Menachemi N, Rahurkar S, Harle CA, Vest JR. The benefits of health information exchange: an updated systematic review. J Am Med Inform Assoc. 2018;25(9):1259-1265. doi: 10.1093/jamia/ocy035.
24. Lin SC, Adler-Milstein J. The relationship between hospital and EHR vendor market dynamics on health information organization presence and participation. BMC Med Inform Decis Mak. 2018;18(1):28. doi: 10.1186/s12911-018-0605-y.
25. Everson J, Adler-Milstein J. Gaps in health information exchange between hospitals that treat many shared patients. J Am Med Inform Assoc. 2018;25(9):1114-1121. doi: 10.1093/jamia/ocy089.