Publication
Article
The American Journal of Managed Care
Author(s):
The willingness of employees to pay to prevent influenza demonstrates a strong preference to protect themselves and their household members; however, modifiable barriers to vaccination persist.
Objectives:
To quantify employees' preferences, as measured by willingness to pay, to prevent influenza in themselves and in their child and adult household members and to examine factors associated with willingness to pay.
Study Design:
Prospective observational cohort study of a convenience sample of employees from 3 large US employers. Participants had at least 1 child (<17 years) living in their household for at least 4 days per week.
Methods:
Each month from November 2007 to April 2008, employees completed Web-based surveys regarding acute respiratory illness in their household. In the final survey, employees were presented with descriptions of influenza and questions regarding their willingness to pay to prevent influenza. Factors associated with willingness to pay were examined using multivariate ordinary least squares regression analysis of the log of willingness to pay.
Results:
Among 2006 employees, 31.3% were female, the mean age was 41.7 years, 85.3% were of white race/ethnicity, and the mean household size was 4.0. Employees' median (mean) willingness to pay to prevent influenza was $25 ($72) for themselves, $25 ($82) for their adult household members, and $50 ($142) (P <.01) for children. However, influenza vaccination rates were approximately equal for children (27.5%), employees (31.5%), and other adult household members (24.5%). This finding may be explained by barriers such as cost, dislike of vaccinations, and disagreement with national influenza vaccination recommendations, which were significantly associated with lower willingness to pay for prevention of influenza (P <.05).
Conclusion:
Employees expressed a stronger preference to prevent influenza in their children than in themselves or other household members; however, modifiable barriers depress vaccination rates.
(Am J Manag Care. 2010;16(8):e205-e214)
These findings are the first willingness-to-pay estimates of employees’ preferences for influenza prevention among child and adult household members.
Every year, about 10% to 20% of individuals in the United States contract influenza.1 With this incidence comes a substantial clinical and economic burden. Approximately 36,000 deaths and 226,000 hospitalizations are associated with influenza epidemics each year.2,3 The total cost of influenza epidemics in the United States has been estimated in the tens of billions of dollars (US) per year, much of which is due to lost productivity.4,5
Yearly seasonal influenza vaccination is recommended by the Centers for Disease Control and Prevention (CDC) as the first and most important step in protecting against contracting and spreading seasonal influenza, as supported by studies.6-12 In the United States, target populations for vaccination include children aged 6 months through 18 years, individuals with underlying medical conditions, pregnant women, adults 50 years and older, and healthcare workers and household contacts of individuals at high risk for influenza complications.13 However, influenza vaccination coverage for the general population and for target groups remains suboptimal.13 Several studies14-16 have examined the role of various factors contributing to vaccination coverage, and findings suggest that facilitators to vaccination include previous vaccination and provider recommendation, while barriers to vaccination include cost, consideration of adverse effects, and fear of contracting influenza from the vaccine.
Although costs are a barrier to vaccination, there is little research regarding how much individuals are generally willing to pay for influenza prevention and particularly for prevention in household members. Existing estimates of willingness to pay for influenza prevention focus on healthcare workers’ or adults’ willingness to pay for influenza prevention in hypothetical children.17,18 The objectives of this study were to quantify employees’ preferences, as measured by willingness to pay, to prevent influenza in themselves and in their child and adult household members and to examine factors associated with willingness to pay.
METHODS
Data and Study Design
Study data were collected as part of the Child and Household Influenza-Illness and Employee Function (CHIEF) study. The CHIEF study was a prospective observational cohort study conducted from November 2007 to April 2008. Participants were employees of 3 large US employers, including a national retail chain, a transportation company, and a durable goods manufacturing company. Further identifying information for employers is restricted because of study confidentiality agreements.
The CHIEF study enrollment goal was 2400 employees. In October 2007, approximately 36,000 employees were mailed a letter offering a small monetary remuneration to participate in the surveys (also offered in Spanish and in paper form) and were provided with a Web address (URL) to a Web-based screener survey. The durable goods manufacturing company also disseminated information about the study through internal efforts. Therefore, the actual number of individuals who were aware of the study is unknown. Eligible employees were required to be covered under their employer’s private health insurance plan and to have at least 1 child (<17 years) who was covered under the same health insurance plan and lived in the employee’s household for at least 4 days per week. This study was approved by the New England Institutional Review Board, and informed consent was obtained from all employees.
The study included a Web-based baseline survey and 6 Web-based monthly surveys. The baseline survey contained questions about household sociodemographics, health behaviors, comorbidities, and employee workplace characteristics. In each monthly survey and for each household member, employees reported the presence of acute respiratory illness and the specific symptoms comprised therein during the previous month. For all surveys, employees responded to all questions regarding themselves and each of their household members.
Table 1
Outcome data used for this analysis came from the final survey. In the final survey, employees were presented with descriptions of influenza based on the actual duration and severity of influenza-like illness symptom constellations that were observed in the study cohort during the prior survey months.19 Separate descriptions of influenza were presented for the employee, his or her child household members, and adult household members. Employees’ preferences to prevent the described influenza for (1) themselves, (2) their child household members, and (3) their adult household members were measured using a previously fielded willingness-to-pay method that included dichotomous-choice double-bounded questions, followed by an open-ended question asking for the respondent’s maximum willingness to pay; this maximum value was used for all analyses (), and the valuation technique is discussed in more detail by Prosser et al.17 Personal and household member influenza vaccination status, reasons for vaccination among the vaccinated, and reasons for nonvaccination among the nonvaccinated were also captured in the final monthly study survey. Only employees who responded to every monthly survey and had nonmissing willingness-to-pay responses were included in this study.
Statistical Analysis
Factors associated with willingness to pay were examined using multivariate ordinary least squares regression analysis with the log of willingness to pay as the dependent variable. Log transforming the willingness-to-pay variable (which was skewed) allowed for approximation of normality of the error term. For each of 3 willingness-topay measures, the following 3 models were estimated: (1) all eligible employees were combined to examine the association between willingness to pay and sociodemographics, prior experience with influenza-like illness (since November 2007), comorbidities, and current vaccination status; (2) the sample was restricted to individuals who were vaccinated (or in the case of children and adults, >1 child and adult, respectively, in the employee’s household were vaccinated) and incorporated additional variables regarding reported reasons for vaccination; and (3) the sample was restricted to individuals who were not vaccinated (or in the case of children and adults, no children and adults, respectively, in the employee’s household were vaccinated) and incorporated additional variables regarding reported reasons for nonvaccination. Models were specified on the basis of a priori assumptions. Model output is presented as cost ratios, including the untransformed β coefficients from which the cost ratios were derived. For binary variables, the cost ratio is interpreted as the ratio of willingness to pay by employees for whom the binary indicator is 1 to willingness to pay by employees for whom the binary indicator is 0. For continuous variables, the cost ratio is interpreted as the incremental relative increase in willingness to pay for a 1-unit (1-U) increase in the variable. Statistical analyses were conducted using STATA release 9 (StataCorp LP, College Station, TX).
RESULTS
Sample Characteristics
During the time-limited enrollment period, 3686 employees completed the Web-based screening questionnaire. Of these employees, 2298 (62.3%) met the inclusion and exclusion criteria and completed the baseline survey. The percentage of employees who completed the survey each month ranged from 95.3% to 97.4% (data not shown). The final sample included 2006 employees (87.3% of 2298 initial responders) who had nonmissing willingness-to-pay responses in the final survey.
Table 2
summarizes the characteristics of employees and their household members. Employees were 31.3% female, their mean age was 41.7 years, 85.3% were of white race/ethnicity, 83.9% had attended at least some college, and the mean household size, including the employee, was 4.0 individuals. The demographics of employees included in the CHIEF study were comparable to US Census Bureau data on heads of households (also known as householders) 18 years or older.20 In 2007, heads of households were 29.9% female, they had a mean age of 49.3 years, and 81.6% were of white race/ethnicity. However, employees in the CHIEF study were more educated than the general US heads of households (83.9% vs 56% had attended at least some college). Overall, 31.5% of employees, 27.5% of child household members, and 24.5% adult household members were vaccinated during the 2007-2008 vaccination season.
Willingness-to-Pay Estimates and Associated Factors
Employees’ median (mean [SD]) willingness to pay for influenza prevention was $25 ($72 [$177]) for themselves (n = 2006) ($0 minimum and $400 maximum; 5th-95th percentiles, $0-$250), $25 ($82 [$280]) for their adult household members (n = 1835) ($0 minimum and $9999 maximum; 5th-95th percentiles, $0-$400), and $50 ($142 [$447]) for children (n = 2003) ($0 minimum and $9999 maximum; 5th-95th percentiles, $0-$500). The difference in willingness to pay for children versus for adults or themselves was significant (P <.01).
Table 3
gives willingness-to-pay estimates by the reported reasons for vaccination or nonvaccination. The most frequently reported reasons for vaccination were healthcare provider recommendations (for children) and a desire to protect family and household members (for employees and adult household members).
In the multivariate models in which all employees were combined to examine the factors associated with willingness to pay, the receipt of a vaccine in the current season was associated with significantly higher willingness to pay for children, adult household members, and employees (P <.01 for all models). The full results of these models are available from the corresponding author.
Table 4
summarizes results for the subset models in which willingness to pay was examined for the aforementioned vaccinated groups listed in the “Methods” section. Of the various reported reasons for vaccination (holding other factors constant), access to free vaccination was associated with significantly lower willingness to pay in all models (P <.01 for all). Neither belief in vaccine efficacy nor experience of an influenza-like illness was significantly associated with willingness to pay.
Table 5
summarizes results for the subset models in which willingness to pay was examined for the aforementioned nonvaccinated groups listed in the “Methods” section. Household income of $50,000 or more was associated in all models with significantly higher willingness to pay (P <.01). Black race/ethnicity was associated with a significantly higher willingness to pay for personal prevention (P <.05). Among various reported reasons for nonvaccination, disagreement with national influenza vaccination recommendations was associated in all models with significantly lower willingness to pay (P <.01). In the model for children, cost and dislike of vaccinations
were associated with significantly lower willingness to pay (P <.05). In the models for adult household members and employees, forgetting to be vaccinated was associated with significantly higher willingness to pay (P <.05). Consistent with the models among the vaccinated, neither belief in vaccine inefficacy nor experience of an influenza-like illness in the prior 6 months was significantly associated with willingness to pay.
DISCUSSION
Employee preferences for preventing influenza, as measured by willingness to pay, can assist decision makers in optimizing vaccine strategies. These findings are the first willingness-to-pay—based estimates of employees’ preferences for influenza prevention among their child and adult household members to date.
As the first and most important step in protecting against seasonal influenza, the CDC recommends that all healthy individuals should be vaccinated against the influenza virus. We found that employees were willing to pay twice as much to prevent influenza in their children than in themselves or other adult household members; however, children were vaccinated against influenza at rates approximately equal to the rates in employees and other adult household members, and each of these rates was below the Healthy People 2010 goals.21 Our findings that employees expressed a higher willingness to pay to prevent influenza in children are consistent with previous evidence that individuals valued reducing health risk in children differently than reducing similar risk in adults.22
Our estimates of willingness to pay for influenza prevention demonstrate that most employees’ willingness to pay for influenza prevention in themselves and in their adult household members was in the range of the combined cost of influenza vaccination and administration. There are additional costs associated with vaccination, including transportation and potential loss of time from work or usual activities.23-25 The approximately equal rates of vaccination across employees, children, and adults suggest that such costs or other barriers to vaccination have an important role in the decision to refrain from vaccination, and employees may face comparatively lower barriers when seeking vaccination for themselves compared with seeking vaccination for their children. A potential strategy to reduce the hidden cost of vaccination and to improve vaccination coverage for children may be to extend employer-based influenza clinics to dependents.
Prior studies have cited several factors that influence such a decision to refrain from vaccination. Mayo and Cobler16 reported that among hospitalized patients the most frequently cited reasons for nonvaccination were consideration of adverse effects and fear of contracting influenza from the vaccine. Logan15 recently examined the role of disparities in nonvaccination and cited cost, insurance, language barriers, underestimation of influenza risks, misperceptions of influenza vaccination, and mistrust of the healthcare system as factors.
Among our employed, insured, and predominantly white sample, employees who reported cost as a reason for nonvaccination among their children had significantly lower willingness to pay for influenza prevention; however, cost was not found to be a factor for personal influenza prevention. This may be due in part to the fact that some employees had access to at-work vaccination programs, which frequently provide coverage to the employee at no charge but not to their dependents. Given employees’ stronger preference to prevent influenza in their child household members, the potential to capture societal benefits and improve influenza vaccine coverage may exist through the extension of employer-based influenza clinics to dependents.
Among the nonvaccinated, disagreement with national influenza vaccination recommendations was associated with significantly lower willingness to pay for influenza prevention in employees and in their child and adult household members. In terms of employees’ willingness to pay for influenza prevention in children, employees who had no vaccinated children and who reported a dislike of vaccinations also had significantly lower willingness to pay for prevention. The association of both of these factors with employees’ willingness to pay for influenza prevention suggests potential misperceptions of influenza vaccination. This finding indicates that targeted educational interventions regarding the benefits of vaccination may be necessary to improve vaccination coverage.
Employees reporting that they or their household members were vaccinated against influenza because it was free expressed a significantly lower willingness to pay than those not reporting such a motivation. One potential explanation for this finding is that free vaccination programs are successful at attracting individuals who otherwise place a low value on influenza prevention, a key goal of such programs.
The findings that influenza-like illness in the previous 6 months, belief in vaccine efficacy, and perception of vaccine inefficacy had nonsignificant associations with willingness to pay are notable and unexplained. Furthermore, among employees who were nonvaccinated, black employees expressed a higher willingness to pay for personal influenza prevention. This also suggests the potential value of targeted educational interventions for certain subgroups.
The influenza vaccination rate found in the CHIEF study is consistent with other self-reported survey studies conducted around this period. During the 2007-2008 vaccination season, vaccination rates for children aged 6 to 59 months ranged between 22% (cohort aged 24-59 months) and 40.8% (cohort aged 6-23 months).26 Recently, a 24% vaccination rate was reported in children aged 6 months to 17 years.27 In adults, the vaccination rate found in the CHIEF study was higher than what is reported by the CDC. For 2007, the CDC estimated that 17% of adults aged 18 to 49 years and 36% of adults aged 50 to 64 years received influenza vaccination.28 The difference between the CHIEF study vaccination rate and other reported vaccination rates may reflect that our study sample represented employed individuals with children, who could differ in their propensity for vaccination compared with the populations from which the CDC and other researchers based their estimates.
Our estimates of willingness to pay differ from estimates previously reported. Prosser and colleagues17 examined adults’ willingness to pay to prevent uncomplicated influenza in a 1-year-old child and in a 14-year-old child. They found that willingness to pay decreased with increasing age, averaging $469 for a 1-year-old child and $288 for a 14-year-old child. Our estimates of willingness to pay for prevention of influenza in children (mean age, 9.7 years) are lower at $142. Lee and colleagues29 estimated that individuals on average were willing to pay $15.49 (2001 US dollars) for a day of relief from influenza symptoms based on a sample of 210 patients seeking primary care at a family practice clinic in North Carolina. Our scenarios presented descriptions of influenza in which the individuals were ill for approximately 7 days; if employees valued each day of symptom relief equally, then our estimates are also somewhat lower than those by Lee and colleagues. Finally, Steiner and colleagues18 conducted a survey of willingness to pay for vaccination among 1718 employees of a healthcare facility and found a mean willingness to pay for vaccination of $10.47. A distinguishing characteristic of that study was that the willingness to pay was elicited for vaccination rather than for prevention of symptoms.
One of the major criticisms of estimating willingness to pay through surveys is that this may result in a poor estimate of the actual willingness to pay.30 Prior research has shown that respondents commonly express a higher willingness to pay in hypothetical situations than in actual practice, a phenomenon referred to as hypothetical bias.31,32 Although there are a limited number of published field studies from the health-related sector, the findings are mixed on the level of overestimation of stated willingness to pay compared with what subjects actually pay. In studies33-36 estimating the value for insecticide-treated nets, disease management services, and bottled water for infant formula, overestimation was reported to be as high as 4-fold. For a pharmacist asthma management program, subjects stated a willingness to pay of $29.23, while actual payments were $8.97, for example.33 In contrast, studies37,38 that examined purchase of blood testing devices and insecticide-treated nets found no evidence of hypothetical bias.
Although there are multiple reasons for overestimation in willingness to pay, a plausible explanation for hypothetical bias is the lack of subjects’ engagement in acquiring the non—market good being tested through surveys.39 To address this, we attempted to decrease the hypothetical nature of the question by using descriptions of influenza that reflected the average influenza-like symptoms as experienced by the cohort under study. While previous estimates of individuals’ willingness to pay for prevention of (uncomplicated) influenza in children have partially relied on reports from respondents without children who valued their willingness to pay in relation to a hypothetical child,17 our study’s estimated willingness to pay for prevention of influenza in children came from a sample of employees in which all respondents had children. Although this unique feature of the design and valuation technique in the present study may theoretically reduce bias, the effect of eliminating these 2 hypothetical elements on potential hypothetical bias is unknown.
This study was subject to limitations. The data came from a nonrandom (convenience) sample and may not be generalizable to all employed individuals in the United States. As with any survey-based study, our data are subject to bias inherent in self-report surveys. Approximately 13% of the eligible study sample had not completed all monthly surveys or had not reported other information required for this analysis. We used 1 of many potential estimation methods, which is reflected in part by the differences between our estimates of willingness to pay and those reported in previous literature.17,18,31,40 We measured willingness to pay for influenza prevention during the 2007-2008 vaccination season, and the elevated public awareness regarding influenza resulting from the influenza (AH1N1) pandemic may have altered individuals’ willingness to pay for influenza prevention; therefore, our estimates may not reflect individuals’ current preferences. As already noted, we cannot eliminate the possibility that our estimates are subject to hypothetical bias; thus, the stated willingness-to-pay values estimated from our study may be an overestimation of the actual amount that parents may be willing to pay to prevent influenza, which is a potential explanation for the incongruence between vaccination rates and the median levels of willingness to pay for influenza prevention.
This study has notable strengths. Although drawn from a convenience sample, respondents came from 3 large diverse US employers of differing industries, providing broad sociodemographic and geographic coverage. Participants had a wide array of educational attainment and income and represented all geographic regions of the United States. Furthermore, with more than 2000 respondents, the study sample was the largest to date that has been used for appraisal of willingness to pay and for examination of vaccination attitudes.
In conclusion, these findings are the first estimates to date based on willingness to pay relative to employees’ preferences for influenza prevention in their child and adult household members. Employees were willing to pay twice as much to prevent influenza in their children than in themselves or other adult household members; however, children were vaccinated against influenza at rates approximately equal to the rates in employees and other adult household members. Modifiable barriers to vaccination persist. Vaccination rates may be improved through targeted educational interventions regarding the benefits of vaccination and through extension of employer-based influenza clinics to dependents.
Acknowledgments
We acknowledge the contributions of Christopher Gregory, who served as the primary SAS programmer for the Child and Household Influenza-Illness and Employee Function (CHIEF) study. We also thank Dr Chris Ambrose and Dr Seth Toback for their critical review of the manuscript.
Author Affiliations: From Thomson Reuters (SSJ, LAP, BC), Washington, DC; MedImmune (MDR, PJM), Gaithersburg, MD; Minneapolis VA Medical Center and University of Minnesota (KLN), Minneapolis, MN.
Funding Source: This study was sponsored by MedImmune.
Author Disclosures: Mr Johnston and Drs Palmer and Chu are employees of Thomson Reuters and are paid by MedImmune for consulting services. Drs Rousculp and Mahadevia are employees of MedImmune, a manufacturer of influenza vaccines, and report owning stock in the company. Dr Nichol reports receiving support for research projects through grants to the Minnesota Veterans Research Institute from Sanofi Pasteur, GlaxoSmithKline, and MedImmune, and has served as a consultant/medical advisory board member to Sanofi Pasteur, GlaxoSmithKline, MedImmune, Novartis, CSL, and Wyeth.
Authorship Information: Concept and design (SSJ, MDR, LAP, BC, PJM, KLN); acquisition of data (SSJ, LAP); analysis and interpretation of data (SSJ, MDR, LAP, BC, PJM, KLN); drafting of the manuscript (SSJ, MDR, LAP, BC); critical revision of the manuscript for important intellectual content (SSJ, MDR, LAP, BC, PJM, KLN); statistical analysis (SSJ, LAP, BC); obtaining funding (MDR); administrative, technical, or logistic support (LAP); and supervision (MDR).
Address correspondence to: Matthew D. Rousculp, PhD, MPH, MedImmune, One MedImmune Way, Gaithersburg, MD 20878. E-mail: rousculpm@ medimmune.com.
1. Sullivan KM, Monto AS, Longini IM Jr. Estimates of the US health impact of influenza. Am J Public Health. 1993;83(12):1712-1716.
2.Thompson WW, Shay DK, Weintraub E, et al. Influenza-associated hospitalizations in the United States. JAMA. 2004;292(11):1333-1340.
3.Thompson WW, Shay DK, Weintraub E, et al. Mortality associated with influenza and respiratory syncytial virus in the United States. JAMA. 2003;289(2):179-186.
4. Fendrick AM, Monto AS, Nightengale B, Sarnes M. The economic burden of non—influenza-related viral respiratory tract infection in the United States. Arch Intern Med. 2003;163(4):487-494.
5. Molinari NA, Ortega-Sanchez IR, Messonnier ML, et al. The annual impact of seasonal influenza in the US: measuring disease burden and costs. Vaccine. 2007;25(27):5086-5096.
6. Bridges CB,Thompson WW, Meltzer MI, et al. Effectiveness and cost-benefit of influenza vaccination of healthy working adults: a random-ized controlled trial. JAMA. 2000;284(13):1655-1663.
7. Centers for Disease Control and Prevention. Guidelines for Large Scale Novel H1N1 Influenza Vaccination Clinics. http://www.cdc.gov/ h1n1flu/vaccination/pdf/D_Wortley_H1N1_guidelines_pandemic.pdf. Accessed August 18, 2009.
8. Davis MM, King JC Jr, Moag L, Cummings G, Magder LS. County-wide school-based influenza immunization: direct and indirect impact on student absenteeism. Pediatrics. 2008;122(1):e260-e265.
9. Hurwitz ES, Haber M, Chang A, et al. Effectiveness of influenza vac-cination of day care children in reducing influenza-related morbidity among household contacts. JAMA. 2000;284(13):1677-1682.
10. King JC Jr, Stoddard JJ, Gaglani MJ, et al. Effectiveness of school-based influenza vaccination. N Engl J Med. 2006;355(24):2523-2532.
11. Pisu M, Meltzer MI, Hurwitz ES, Haber M. Household-based costs and benefits of vaccinating healthy children in daycare against influenza virus: results from a pilot study. Pharmacoeconomics. 2005;23(1):55-67.
12. Schmier J, Li S, King JC Jr, Nichol K, Mahadevia PJ. Benefits and costs of immunizing children against influenza at school: an economic analysis based on a large-cluster controlled clinical trial. Health Aff (Millwood). 2008;27(2):w96-w104.
3. Fiore AE, Shay DK, Broder K, et al; Centers for Disease Control and Prevention. Prevention and control of seasonal influenza with vac-cines: recommendations of the Advisory Committee on Immunization Practices (ACIP), 2009. MMWR Recomm Rep. 2009;58(RR-8):1-52.
14. Burns IT, Zimmerman RK. Immunization barriers and solutions. J Fam Pract. 2005;54(1)(suppl):S58-S62.
15. Logan JL. Disparities in influenza immunization among US adults. J Natl Med Assoc. 2009;101(2):161-166.
16. Mayo AM, Cobler S. Flu vaccines and patient decision making: what we need to know. J Am Acad Nurse Pract. 2004;16(9):402-410.
17. Prosser LA, Bridges CB, Uyeki TM, et al. Values for preventing influenza-related morbidity and vaccine adverse events in children. Health Qual Life Outcomes. 2005;3:e18.
18. Steiner M,Vermeulen LC, Mullahy J, Hayney MS. Factors influenc-ing decisions regarding influenza vaccination and treatment: a survey of healthcare workers. Infect Control Hosp Epidemiol. 2002;23(10): 625-627.
19. Belshe RB, Edwards KM, Vesikari T, et al; CAIV-T Comparative Efficacy Study Group. Live attenuated versus inactivated influenza vaccine in infants and young children [published correction appears in N Engl J Med. 2007;356(12):1283]. N Engl J Med. 2007;356(7):685-696.
20. United States Census Bureau. America’s families and living arrangements: 2007. http://www.census.gov/population/www/socdemo/hh-fam/cps2007.html. Accessed December 7, 2009.
21. Healthy People 2010: Understanding and Improving Health. http://www.healthypeople.gov/Document/pdf/uih/2010uih.pdf. Accessed September 15, 2009.
22. United States Environmental Protection Agency National Center for Environmental Economics. Children’s Health Valuation Handbook. http://yosemite.epa.gov/EE/epa/eed.nsf/cbd494e04061784d85256a2b006c1945/6ed3736d44c87a4a85256dc1004da4ac/$FILE/handbook1030.pdf. Accessed December 7, 2009.
23. Luce BR, Zangwill KM, Palmer CS, et al. Cost-effectiveness analysis of an intranasal influenza vaccine for the prevention of influenza in healthy children. Pediatrics. 2001;108(2):e24.
24. Maciosek MV, Solberg LI, Coffield AB, Edwards NM, Goodman MJ. Influenza vaccination health impact and cost effectiveness among adults aged 50 to 64 and 65 and older. Am J Prev Med. 2006;31(1): 72-79.
25. Meltzer MI, Neuzil KM, Griffin MR, Fukuda K. An economic analysis of annual influenza vaccination of children. Vaccine. 2005;23(8):1004-1014.
26. Centers for Disease Control and Prevention. Influenza vaccination coverage among children aged 6-59 months: eight immunization infor-mation system sentinel sites, United States, 2007-08 influenza season. MMWR Morb Mortal Wkly Rep. 2008;57(38):1043-1046.
27. Centers for Disease Control and Prevention (CDC). Influenza vac-cination coverage among children and adults: United States, 2008-09 influenza season. MMWR Morb Mortal Wkly Rep. 2009;58(39):1091-1095.
28. Centers for Disease Control and Prevention. Table: self-reported influenza vaccination coverage trends 1989-2008 among adults by age group, risk group, race/ethnicity, health-care worker status, and pregnancy status, United States, National Health Interview Sur-vey (NHIS). http://www.cdc.gov/flu/professionals/vaccination/pdf/ NHIS89_08fluvaxtrendtab.pdf. Accessed December 7, 2009.
29. Lee BY, Mehrotra A, Burns RM, Harris KM. Alternative vaccination locations: who uses them and can they increase flu vaccination rates? Vaccine. 2009;27(32):4252-4256.
30. Diamond PA, Hausman JA. Contingent valuation: is some number better than no number? J Econ Perspect. 1994;8(4):45-64.
31. Bateman IJ, Carson RT, Day B, et al. Economic Valuation With Stated Preference Techniques: A Manual. Northampton, MA: Edward Elgar; 2002.
32. Corso PS, Hammitt JK, Graham JD. Valuing mortality-risk reduc-tion: using visual aids to improve the validity of contingent valuation. J Risk Uncertainty. 2001;23:165-184.
33. Blumenschein K, Johannesson M,Yokoyama KK, Freeman PR. Hypothetical versus real willingness to pay in the health care sector: results from a field experiment. J Health Econ. 2001;20(3):441-457.
34. Onwujekwe O, Hanson K, Fox-Rushby J. Do divergences between stated and actual willingness to pay signify the existence of bias in contingent valuation surveys? Soc Sci Med. 2005;60(3):525-536.
35. Loomis J, Asmus C, Cooney H, Bell P. A comparison of actual and hypothetical willingness to pay of parents and non-parents for protect-ing infants’ health: the case of nitrates in drinking water. In: Proceed-ings from the American Agricultural Economics Association Annual Meeting; July 29 to August 1, 2007; Portland, Oregon.
36. Blumenschein K, Blomquist GC, Johannesson M, Horn N, Free-man P. Eliciting willingness to pay without bias: evidence from a field experiment. Economic J. 2008;118(525):114-137.
37. Bryan S, Jowett S. Hypothetical versus real preferences: results from an opportunistic field experiment [published online ahead of print November 27, 2009]. Health Econ. 2009. doi:10.1002/hec.1563. Medline:19946885.
38. Bhatia M, Fox-Rushby J. Validity of willingness to pay: hypothetical versus actual payment. Appl Econ Lett. 2003;10:737-740.
39. Michell R, Carson R. Using Surveys to Value Public Goods: The Contingent Valuation Method. Washington, DC: Resource for the Future Publishing; 1989.
40. Lee PY, Matchar DB, Clements DA, Huber J, Hamilton JD, Peterson ED. Economic analysis of influenza vaccination and antiviral treatment for healthy working adults. Ann Intern Med. 2002;137(4):225-231.