Publication
Article
The American Journal of Managed Care
Author(s):
In patients with hypertension, a patient activation intervention increased rates of switching to a thiazide, suggesting that such interventions may address medication optimization challenges.
ABSTRACT
Objectives: To examine the effect of a patient activation intervention with financial incentives to promote switching to a thiazide in patients with controlled hypertension using calcium channel blockers (CCBs).
Study Design: The Veterans Affairs Project to Implement Diuretics, a randomized clinical trial, was conducted at 13 Veterans Affairs primary care clinics.
Methods: Patients (n = 236) with hypertension previously controlled using CCBs were randomized to a control group (n = 90) or 1 of 3 intervention groups designed to activate patients to talk with their primary care providers about switching to thiazides: Group A (n = 53) received an activation letter, group B (n = 42) received a letter plus a financial incentive to discuss switching from a CCB to a thiazide, and group C (n = 51) received a letter, a financial incentive, and a telephone call encouraging patients to speak with their primary care providers. The primary outcome was thiazide prescribing at the index visit.
Results: At the index visit, the rate of switching to a thiazide was 1.1% in the control group and 9.4% (group A), 26.2% (group B), and 31.4% (group C) for the intervention groups (P < .0001). In adjusted analysis, patients randomized to group C were significantly more likely to switch from a CCB to thiazide at the index visit (odds ratio, 4.14; 95% CI, 1.45-11.84; P < .01).
Conclusions: This low-cost, low-intensity patient activation intervention resulted in increased rates of switching to a thiazide in those whose hypertension was controlled using another medication, suggesting that such interventions may be used to overcome medication optimization challenges, including clinical inertia.
Am J Manag Care. 2020;26(9):382-387. https://doi.org/10.37765/ajmc.2020.88488
Takeaway Points
Medication optimization remains difficult to achieve in practice. Patient-centered interventions in this context, which emphasize increased communication and shared decision-making between the patient and provider, have shown promise.
Deprescribing refers to the process of removing, reducing, or switching medications to reduce risks and improve patient outcomes.1 A conceptually overlapping process is that of medication optimization, which seeks to maximize medication benefit through appropriate prescribing; it shares similar strategies with deprescribing and may involve removing, reducing, or switching medications.2 Both concepts are important given the pervasiveness of polypharmacy; half of older adults take 5 or more medications, at least 1 of which may be potentially inappropriate.3 Achieving optimal medication usage thus may improve numerous outcomes in this population, including quality, cost, adherence, and reduction of adverse drug events,4,5 but it remains difficult to achieve in practice.6 Several factors that may inhibit optimal medication usage have been identified, including clinical inertia, provider assumptions about patient treatment preferences, patient beliefs about the appropriateness of the medication in question, and patient fears related to cessation (eg, withdrawal effects).7-10
Such factors underscore the need to employ a patient-centered process to achieve medication optimization, which emphasizes increased communication and shared decision-making between the patient and provider in clinical encounters.5,11,12 Studies in the deprescribing literature employing patient-centered approaches have reported favorable results,13-15 and a review by Ostini and colleagues16 suggests that interventions designed to actively involve the patient are more effective than those that do not (eg, those focused solely on prescribers).
Direct-to-consumer (DTC) marketing has been used by the pharmaceutical industry for some time to motivate discussions between patients and physicians to affect prescribing.17 Fundamentally, DTC marketing seeks to increase patient activation, a term that refers to the patient-centered process of imparting knowledge, skills, and confidence, which may facilitate patients becoming more active and informed participants in health care delivery.18,19 Patient activation interventions have shown benefit in terms of better health outcomes and care experiences,20,21 and interventions that facilitate patient initiation of discussion about medication optimization may be especially beneficial as they provide opportunities for shared communication and decision-making.
The present study examines data from the Veterans Affairs Project to Implement Diuretics, a randomized clinical trial designed to test the efficacy of a patient activation intervention with financial incentives to promote thiazide prescribing (ClinicalTrials.gov identifier: NCT 00265538). When the trial was initiated in 2006,22 the prevailing hypertension (HTN) guidelines from the Joint National Committee (JNC) 7 for the Management of Hypertension in Adults specifically stated that “thiazide-type diuretics should be used in drug treatment for most patients with uncomplicated [HTN].”23 In addition to being recommended for first-line therapy, thiazides were considerably cheaper than many other antihypertensives, with a favorable efficacy and safety profile. The 2014 guidelines (formerly JNC 8) recommend selection among 4 classes, including thiazides.24 The arm of the trial examined in the current study aimed to promote switching to thiazides in a group of patients with controlled blood pressure (BP) using calcium channel blockers (CCBs) due to the recommendations at the time and considerable cost savings, aligning with the concept of medication optimization in which medications that may not pose significant harm—but are suboptimal—are targeted for switching or reduction. Although much of the deprescribing literature focuses on medication discontinuation, switching is also an important principle of deprescribing/medication optimization and deserves further attention.1,9 Thus, our primary interest in this study was to examine whether a low-cost, low-intensity intervention would affect medication switching for those already at their BP goal taking a nonpreferred agent. We hypothesized that patients assigned to the most “active” arm of the intervention would exhibit the greatest degree of medication switching.
METHODS
Participants
Participants were sampled from all patients who received primary care at 13 Veterans Affairs (VA) outpatient clinics affiliated with 2 large VA medical centers (N = 61,019) (Figure). To be eligible for participation, patients must have had a prior diagnosis of HTN, not be taking a thiazide diuretic, have 2 or more VA clinic visits in the past 12 months, not be in a long-term care facility, and have no known thiazide or sulfa allergy or prior adverse drug event. From this, 2 subpopulations were derived: (1) patients not at an appropriate BP goal at the 2 most recent clinic visits, referred to as uncontrolled-HTN, and (2) patients at an appropriate BP goal, but taking a CCB, referred to as controlled-CCB. Attainment of goal BP at baseline was determined using the mean of all clinic-recorded BPs from the 2 clinic visits immediately preceding the initial study clinic appointment (hereafter referred to as the index visit). Complete inclusion and exclusion criteria, as well as primary trial results focusing on those not at an appropriate BP goal, have been reported elsewhere.22 This paper reports findings from the controlled-CCB group only.
Procedure
Participants were recruited following a staged protocol that randomized 168 primary care providers (71 affiliated with the Iowa City VA Medical Center and 97 affiliated with the Minneapolis VA Medical Center) to intervention and control groups and then selected eligible patients within these groups. Upon primary care provider randomization, patients with a primary care appointment within 30 days were identified and screened using the electronic health record. Eligible patients (n = 2853) were mailed a letter describing the study objectives, enrollment process, and data collection. One week later, patients were contacted by telephone to obtain informed consent and administered the Pfeiffer Short Portable Mental Status Questionnaire (SPMSQ) to exclude patients with cognitive impairment (defined as > 2 errors on the SPMSQ).25 Of the 2853 patients who were contacted by mail, 2019 were attempted by phone; 1151 declined to participate, including 86 with no telephone. Enrollment ended when the target number of participants were enrolled. Consenting patients (n = 236) were randomized to an intervention (n = 146) or 1 of 2 usual care control groups (n = 90), one group of approximately 50 who were seen by providers with no intervention patients and another group of approximately 50 seen by providers also with intervention patients. We conducted several analyses that demonstrated that these patient groups were no different from one another and thus collapsed them for this study. Sample sizes were selected to provide sufficient (≥ 80%) power to detect an 18% absolute difference in thiazide use between the control group and a single treatment group. All study procedures were approved by The University of Iowa’s institutional review board (#200506705).
Patients randomized to the intervention were assigned to 1 of 3 intervention groups. Group A (n = 53) received a customized letter 1 to 3 weeks before their scheduled index visit. Information was tailored to the patient’s treatment regimen, BP, and cardiovascular risk factors. The letter requested that the patient initiate a discussion with their primary care provider about switching to a thiazide and provided specific options for doing so. It included a postcard for patients to have providers sign and return, documenting whether thiazides were discussed during the visit.
Group B (n = 42) received the same patient education letter in addition to a financial incentive ($20 by check) to initiate a discussion with their primary care provider (see eAppendix [available at ajmc.com] for an example letter representing group B). The incentive was awarded upon receipt of the signed postcard. For patients with a prescription co-pay (55/93; 59.1% across groups B and C), the letter also indicated that thiazide co-pays for 6 months ($48) would be reimbursed upon receipt of the postcard and confirmation that a thiazide was prescribed.
Group C (n = 51) received the same letter and financial incentives as group B in addition to a brief telephone call within 1 week before their clinic visit. Calls were conducted by a trained health educator who discussed the mailed information, the patient’s role in initiating a discussion with the primary care provider about BP medications, and potential strategies for initiating these conversations. All patients received up to 5 call attempts prior to their scheduled index visit; the mode number of calls was 2. Calls lasted, on average, between 5 and 10 minutes.
The primary outcome was thiazide prescription at the index visit; switching to a thiazide from a CCB was determined by reviewing each patient’s progress note and medication list after the index visit, which included discontinued orders to establish that CCBs were stopped. Intervention and control groups were compared at baseline in terms of sociodemographic characteristics and other clinical variables of importance (eg, baseline BP, smoking, mental status, diabetes) using standard univariate tests including t tests and χ2 tests. Variables showing a (conservative) significant difference between groups at P < .10 were included as covariates in adjusted analyses.
Because of the clustered nature of these data, statistical analyses must account for correlation in order for the observed results to be valid given that traditional regression models assume independence of observations. Therefore, analyses utilized hierarchical logistic regression using the generalized linear mixed model procedure in SPSS version 24.0 (IBM). Models incorporated random physician effects to account for within-physician clustering; clinic sites were included as fixed effects. Analyses tested whether there was a significant difference between the log odds of thiazide prescription for the control group vs the 3 intervention groups at the index visit.
RESULTS
During recruitment, 2853 eligible patients were identified. Of these, 236 who were at an appropriate BP goal and taking a CCB for HTN treatment were consented and enrolled. These patients were randomized to either intervention (n = 146: group A = 53; group B = 42; group C = 51) or control (n = 90) groups. Mean age for the intervention groups was 66.7 years and mean systolic/diastolic BP at baseline was 121.5/74.5 mm Hg (see Table 1, which also includes a breakdown by intervention group assignment). Mean age for the control group was 66.9 years and mean BP at baseline was 122.2/73.2 mm Hg. Only race varied significantly between groups and was added as a covariate in the adjusted model. No differential attrition by group was observed, which includes appointment no-shows and elective study dropouts. Only 2 of 51 (3.9%) group C participants were not reached by phone, making them functionally more like group B participants; these participants were analyzed according to the group they were randomized to.
Rate of thiazide prescribing, representing a switch from a CCB to thiazide, was the primary outcome of interest. At the index visit, the unadjusted thiazide prescription rates were 1.1% (1/90) for the control group and 9.4% (5/53) for group A, 26.2% (11/42) for group B, and 31.4% (16/51) for group C (P < .0001). Adjusted odds ratios (ORs) for the 3 intervention groups relative to control are presented in Table 2. At the index visit, the odds of switching to a thiazide were not significantly greater compared with the control group for group A (OR, 2.37; 95% CI, 0.82-6.82; P = .11) and only marginally so for group B (OR, 2.77; 95% CI, 0.96-8.01; P = .06). Group C (OR, 4.14; 95% CI, 1.45-11.84; P < .01) had significantly greater odds of switching to a thiazide than the control group, the magnitude of which has been suggested to be equivalent to a medium effect size.26
DISCUSSION
This study suggests that a relatively low-cost, low-intensity intervention may affect medication optimization behavior in the context of HTN, even for patients currently controlled on another medication. At the index visit, approximately one-third of patients in group C switched from a CCB to thiazide, which was significantly different from the control group in the adjusted analysis. Perhaps most noteworthy is the fact that these patients had HTN that was controlled at the time of intervention and, presumably, most had no pressing reason to switch other than those primarily tied to financial benefit (ie, nominal monetary incentive, prescription co-pay assistance).
Patients were first activated to engage their primary care providers through a customized letter, which only modestly improved switching compared with control (group A; see unadjusted rates above and adjusted odds ratios in Table 2). Adding financial incentives resulted in a marginally significant increase in the odds of switching for group B and, further, a brief reminder phone call resulted in significantly increased odds for group C. The use of financial incentives to drive behavior change has shown success across multiple health-related contexts, including medication adherence, smoking cessation, and weight loss.27-29 It has, however, notably failed in others.30 In this study, a letter plus modest financial incentives were not enough to achieve statistically significant switching (P = .06), but adding a brief reminder call previsit was enough to reach significant change (P < .01). Although a formal budget impact analysis was not part of the study, the financial incentive was considerably less than the ongoing cost of a CCB and the letters were automatically generated from data in the electronic health record and thus low cost. The phone calls took approximately 5 to 10 minutes but improved the potency of the intervention and served to remind patients about their appointments as well as to bring their medications with them, a frequent part of usual care.
Given that group C participants received a tailored letter encouraging discussion with the provider, modest financial incentives, and a brief phone call, it is likely that successful interventions will require a multifaceted approach to facilitate medication optimization, including active engagement of the patient.5 This is further underscored by calls to implement interventions designed to address patient, provider, and/or systems-level factors.10,31,32 In the present study, the tailored letter not only provided information specific to the patient’s condition but also served as a means of facilitating discussion about medication options. Although, on its own, it was not enough to drive significant change, it does represent a key first step in shared decision-making and presumably resulted in some dialogue about the benefits vs harms of switching. Because a majority of (although not all) patients prefer to be actively involved in the decision-making process,33 which includes being offered choices and the freedom to express opinions, it would seem that simple tools such as a patient-directed letter may hold value as one instrument toward broader medication optimization when combined with additional elements like financial incentives and other means to further engage the patient. Even for those preferring to leave final decisions to the provider, such letters could serve as a prompt for discussion, which itself may combat clinical inertia and misperceptions about patient preferences on the part of the provider.34 Indeed, a companion qualitative study of participating intervention providers found that, in addition to very favorable overall perceptions of the intervention and belief in its suitability for wider use, providers specifically noted that the intervention helped align patient objectives with their own.35
Not all multimodal interventions are equally feasible in practice, however. Many interventions have demonstrated success in improving deprescribing outcomes, but there is often a disconnect between research and practice in that many interventions may be unrealistic for widespread adoption in busy clinic settings.10 Compared with interventions that require the involvement of multiple providers, considerable effort on the part of a lone provider, and/or complex referral or care coordination processes, the present approach may be more logistically practical and demand fewer resources. Future research should be designed with an eye toward what is reasonably attainable in the clinical setting to address this important issue.6
Limitations
This study has several limitations. First, it is reasonable to argue that because some patients did not have a compelling reason to switch other than financial incentives and then-contemporary practice guidelines, there may have been no need to switch at all. However, this study suggests that financial incentives, when coupled with other modest interventional components, can facilitate discussion of the issue, which is an important first step in the deprescribing/medication optimization process. Previous qualitative work from this trial found that patient participants liked being involved because it allowed them the opportunity to initiate discussions with the provider on a topic of importance.36 Such empowerment may carry over to other aspects of the clinical encounter. Second, we do not have information regarding the exact reasons why patients and providers decided to switch from a CCB to a thiazide; it is assumed that the financial incentives and practice guidelines largely influenced this change, but it is possible that at least some patients were candidates for switching irrespective of our intervention, perhaps due to low tolerance of the medication at the time of visit. This concern is alleviated by the presence of a control group, however. Third, we do not have specific race/ethnicity information for a number of patient participants in this study, which is primarily due to issues with reporting and classification in the VA medical record at the time of this trial.37 Fourth, we did not monitor downstream efforts to address the appropriateness of the switch (eg, follow-up laboratory tests, BP monitoring) and thus cannot speak to patients who did not respond well to the new medication. Finally, HTN guidelines evolved over time, making some recommendations obsolete. However, in addition to the clear connections to deprescribing/medication optimization, this study also may have implications specifically for therapeutic substitution (ie, when a lower-cost alternative within the same class is available), particularly when developing methods to inform and engage patients about less expensive options that are otherwise equivalent for the same indication.
CONCLUSIONS
These results suggest that a low-intensity intervention activating patients toward increased communication (in this case, discussion of current HTN medications in clinic) may be relevant to deprescribing and broader medication optimization efforts, helping to overcome clinical inertia. Future work should evaluate the practical barriers of implementing even simple interventions into complex and busy clinical practices and develop ways to overcome those barriers.
Author Affiliations: Center for Access Delivery Research & Evaluation (CADRE), VA Iowa City Healthcare System (MBH, MWVW, PJK), Iowa City, IA; Department of Behavioral Sciences & Social Medicine, College of Medicine, Florida State University (MBH), Tallahassee, FL; Division of Geriatrics, University of California San Francisco (MAS), San Francisco, CA; San Francisco VA Health Care System, San Francisco (MAS), CA; Division of General Internal Medicine, The University of Iowa Carver College of Medicine (BC, MWVW, PJK), Iowa City, IA; Department of Pharmacy Practice and Science, The University of Iowa College of Pharmacy (BC), Iowa City, IA; Department of Psychological & Brain Sciences, The University of Iowa (MWVW), Iowa City, IA.
Source of Funding: The research reported here was supported by the Department of Veterans Affairs, Veterans Health Administration, Health Services Research and Development Service Merit Review Grant (IMV 04-066-1). The views expressed in this article are those of the authors and do not necessarily represent the view of the Department of Veterans Affairs.
Author Disclosures: Dr Steinman has received grants from the National Institutes of Health (NIH) related to appropriate medication use and has received honoraria for talks at universities and participation in programs sponsored by other nonprofit entities around issues related to appropriate medication use. Dr Carter is an investigator on 3 NIH grants and receives honoraria as a member of 2 Data and Safety Monitoring Boards for NIH. The remaining authors report no relationship or financial interest with any entity that would pose a conflict of interest with the subject matter of this article.
Authorship Information: Concept and design (MBH, BC, MWVW, PJK); acquisition of data (BC, PJK); analysis and interpretation of data (MBH, MAS, MWVW, PJK); drafting of the manuscript (MBH, PJK); critical revision of the manuscript for important intellectual content (MBH, MAS, BC, MWVW, PJK); statistical analysis (MBH, PJK); provision of patients or study materials (PJK); obtaining funding (MBH, PJK); administrative, technical, or logistic support (PJK); supervision (BC, PJK); and content expertise (MAS).
Address Correspondence to: M. Bryant Howren, PhD, MPH, Florida State University College of Medicine, 1115 W Call St, Tallahassee, FL 32306. Email: matthew.howren@med.fsu.edu.
REFERENCES
1. Scott IA, Hilmer SN, Reeve E, et al. Reducing inappropriate polypharmacy: the process of deprescribing. JAMA Intern Med. 2015;175(5):827-834. doi:10.1001/jamainternmed.2015.0324
2. Van Boven JFM, Stuurman-Bieze AGG, Hiddink EG, Postma MJ, Vegter S. Medication monitoring and optimization: a targeted pharmacist program for effective and cost-effective improvement of chronic therapy adherence. J Manag Care Spec Pharm. 2014;20(8):786-792. doi:10.18553/jmcp.2014.20.8.786
3. Mangin D, Garfinkel D. Foreword to the first special collection: addressing the invisible iatrogenic epidemic: the role of deprescribing in polypharmacy and inappropriate medication use. Ther Adv Drug Saf. 2019;10:2042098619883156. doi:10.1177/2042098619883156
4. Reeve E, Shakib S, Hendrix I, Roberts MS, Wiese MD. The benefits and harms of deprescribing. Med J Aust.2014;201(7):386-389. doi:10.5694/mja13.00200
5. Reeve E, Thompson W, Farrell B. Deprescribing: a narrative review of the evidence and practical recommendations for recognizing opportunities and taking action. Eur J Intern Med. 2017;38:3-11. doi:10.1016/j.ejim.2016.12.021
6. Ronquillo C, Day J, Warmouth K, Britten N, Stein K, Lang I. An implementation science perspective on deprescribing. Public Policy Aging Rep. 2018;28(4):134-139. doi:10.1093/ppar/pry032
7. Andersen K, Stowasser D, Freeman C, Scott I. Prescriber barriers and enablers to minimizing potentially inappropriate medications in adults: a systematic review and thematic analysis. BMJ Open. 2014;4(12):e006544. doi:10.1136/bmjopen-2014-006544
8. Britten N, Stevenson FA, Barry CA, Barber N, Bradley CP. Misunderstandings in prescribing decisions in general practice: a qualitative study. BMJ. 2000;320(7233):484-488. doi:10.1136/bmj.320.7233.484
9. Reeve E, To J, Hendrix I, Shakib S, Roberts MS, Wiese MD. Patient barriers to and enablers of deprescribing: a systematic review. Drugs Aging. 2013;30(10):793-807. doi:10.1007/s40266-013-0106-8
10. Steinman MA, Landefeld CS. Overcoming inertia to improve medication use and deprescribing. JAMA. 2018;320(18):1867-1869. doi:10.1001/jama.2018.16473
11. Holmes HM, Todd A. The role of patient preferences in deprescribing. Clin Geriatr Med. 2017;33(2):165-175. doi:10.1016/j.cger.2017.01.004
12. Todd A, Jansen J, Colvin J, McLachlan AJ. The deprescribing rainbow: a conceptual framework highlighting the importance of patient context when stopping medication in older people. BMC Geriatr. 2018;18(1):295. doi:10.1186/s12877-018-0978-x
13. Krol N, Wensing M, Haaijer-Ruskamp F, et al. Patient-directed strategy to reduce prescribing for patients with dyspepsia in general practice: a randomized trial. Aliment Pharmacol Ther. 2004;19(8):917-922. doi:10.1111/j.1365-2036.2004.01928.x
14. Peterson AW, Shah AS, Simmons SF, et al. Shed-MEDS: pilot of a patient-centered deprescribing framework reduces medications in hospitalized older adults being transferred to inpatient postacute care. Ther Adv Drug Saf. 2018;9(9):523-533. doi:10.1177/2042098618781524
15. Tannenbaum C, Martin P, Tamblyn R, Benedetti A, Ahmed S. Reduction of inappropriate benzodiazepine prescriptions among older adults through direct patient education: the EMPOWER cluster randomized trial. JAMA Intern Med. 2014;174(6):890-898. doi:10.1001/jamainternmed.2014.949
16. Ostini R, Jackson C, Hegney D, Tett SE. How is medication prescribing ceased? a systematic review. Med Care. 2011;49(1):24-36. doi:10.1097/MLR.0b013e3181ef9a7e
17. Donohue JM, Cevasco M, Rosenthal MB. A decade of direct-to-consumer advertising of prescription drugs. N Engl J Med. 2007;357(7):673-681. doi:10.1056/NEJMsa070502
18. Hibbard JH, Stockard J, Mahoney ER, Tusler M. Development of the Patient Activation Measure (PAM): conceptualizing and measuring activation in patients and consumers. Health Serv Res. 2004;39(4 pt 1):1005-1026. doi:10.1111/j.1475-6773.2004.00269.x
19. Hibbard JH. Patient activation and the use of information to support informed health decisions. Patient Educ Couns. 2017;100(1):5-7. doi:10.1016/j.pec.2016.07.006
20. Greene J, Hibbard JH. Why does patient activation matter? an examination of the relationships between patient activation and health-related outcomes. J Gen Intern Med. 2012;27(5):520-526. doi:10.1007/s11606-011-1931-2
21. Hibbard JH, Greene J. What the evidence shows about patient activation: better health outcomes and care experiences; fewer data on costs. Health Aff (Millwood). 2013;32(2):207-214.doi:10.1377/hlthaff.2012.1061
22. Kaboli PJ, Howren MB, Ishani A, Carter B, Christensen AJ, Vander Weg MW. Efficacy of patient activation interventions with and without financial incentives to promote prescribing of thiazides and hypertension control: a randomized clinical trial. JAMA Netw Open. 2018;1(8):e185017. doi:10.1001/jamanetworkopen.2018.5017
23. Chobanian AV, Bakris GL, Black HR, et al; National Heart, Lung, and Blood Institute Joint National Committee on Prevention, Detection, Evaluation, and Treatment of High Blood Pressure; National High Blood Pressure Education Program Coordinating Committee. The seventh report of the Joint National Committee on Prevention, Detection, Evaluation, and Treatment of High Blood Pressure: the JNC 7 report. JAMA. 2003;289(19):2560-2572. doi:10.1001/jama.289.19.2560
24. James PA, Oparil S, Carter BL, et al. 2014 evidence-based guideline for the management of high blood pressure in adults: report from the panel members appointed to the Eighth Joint National Committee (JNC 8). JAMA. 2014;311(5):507-520. doi:10.1001/jama.2013.284427
25. Pfeiffer E. A short portable mental status questionnaire for the assessment of organic brain deficit in elderly patients. J Am Geriatr Soc. 1975;23(10):433-441. doi:10.1111/j.1532-5415.1975.tb00927.x
26. Chen H, Cohen P, Chen S. How big is a big odds ratio? interpreting the magnitudes of odds ratios in epidemiological studies. Commun Stat Simul Comput. 2010;39(4):860-864. doi:10.1080/03610911003650383
27. Halpern SD, French B, Small DS, et al. Randomized trial of four financial-incentive programs for smoking cessation. N Engl J Med.2015;372(22):2108-2117. doi:10.1056/NEJMoa1414293
28. Volpp KG, John LK, Troxel AB, Norton L, Fassbender J, Loewenstein G. Financial incentive–based approaches for weight loss: a randomized trial. JAMA. 2008;300(22):2631-2637. doi:10.1001/jama.2008.804
29. Volpp KG, Loewenstein G, Troxel AB, et al. A test of financial incentives to improve warfarin adherence. BMC Health Serv Res. 2008;8:272. doi:10.1186/1472-6963-8-272
30. Thirumurthy H, Asch DA, Volpp KG. The uncertain effect of financial incentives to improve health behaviors. JAMA. 2019;321(15):1451-1452. doi:10.1001/jama.2019.2560
31. Kaur S, Mitchell G, Vitetta L, Roberts MS. Interventions that can reduce inappropriate prescribing in the elderly: a systematic review. Drugs Aging. 2009;26(12):1013-1028. doi:10.2165/11318890-000000000-00000
32. Ng BJ, Le Couteur DG, Hilmer SN. Deprescribing benzodiazepines in older patients: impact of interventions targeting physicians, pharmacists, and patients. Drugs Aging. 2018;35(6):493-521. doi:10.1007/s40266-018-0544-4
33. Levinson W, Kao A, Kuby A, Thisted RA. Not all patients want to participate in decision making. a national study of public preferences. J Gen Intern Med. 2005;20(6):531-535. doi:10.1111/j.1525-1497.2005.04101.x
34. Mulley AG, Trimble C, Elwyn G. Stop the silent misdiagnosis: patients’ preferences matter. BMJ. 2012;345:e6572. doi:10.1136/bmj.e6572
35. Buzza CD, Williams MB, Vander Weg MW, Christensen AJ, Kaboli PJ, Reisinger HS. Part II, provider perspectives: should patients be activated to request evidence-based medicine? a qualitative study of the VA Project to Implement Diuretics (VAPID). Implement Sci. 2010;5:24. doi:10.1186/1748-5908-5-24
36. Pilling SA, Williams MB, Brackett RH, et al. Part I, patient perspective: activating patients to engage their providers in the use of evidence-based medicine: a qualitative evaluation of the VA Project to Implement Diuretics (VAPID). Implement Sci. 2010;5:23. doi:10.1186/1748-5908-5-23
37. Sohn MW, Zhang H, Arnold N, et al. Transition to the new race/ethnicity data collection standards in the Department of Veterans Affairs. Popul Health Metr. 2006;4:7. doi:10.1186/1478-7954-4-7