Publication
Article
The American Journal of Managed Care
Author(s):
This study examines the feasibility and utility of using administrative claims from commercial health plans to identify children with chronic conditions in a statewide registry.
Objectives
To demonstrate the feasibility and utility of using administrative claims data from commercial health plans to establish a high-risk indicator in a statewide immunization registry for enrollees with chronic conditions.
Study Design
Retrospective cohort analysis.
Methods
Administrative data were used to identify children with 1 or more chronic conditions enrolled in 2 commercial health plans during the 2008-2009 and 2009-2010 influenza seasons and matched with a statewide immunization registry. The proportion of cases that successfully matched and historical health services utilization, including influenza vaccinations and missed opportunities, were assessed.
Results
A total of 93% of children with chronic conditions identified through administrative claims were successfully matched with the statewide registry. Less than one-third of children received the seasonal influenza vaccine in either the 2008-2009 (29%) or 2009-2010 (32%) seasons; 30% of children received the H1N1 vaccination in 2009-2010. Most children in the 2008-2009 (63%) and 2009-2010 (63%) seasons had at least 1 missed opportunity for seasonal influenza vaccination. Younger children had the highest percentage of missed opportunities while adolescents had the lowest rate of missed opportunities for vaccination. Conclusions It is feasible to identify children with chronic conditions using administrative data and to link them with a statewide immunization registry. Low influenza vaccination rates and high occurrences of missed opportunities among children with chronic conditions suggest the utility of integrating administrative claims data with statewide registries to support various outreach mechanisms, including physician-focused and parent-targeted reminder/recall, based on target age to improve vaccination rates.
Am J Manag Care. 2014;20(5):e166-e174
Administrative data from commercial health plans can be used to identify children with chronic conditions in a statewide immunization registry. Low influenza vaccination rates and high occurrences of missed opportunities among children with chronic conditions in our sample suggest the utility of integrating administrative claims data with statewide registries. This integration can:
Children with chronic conditions are especially vulnerable to complications from influenza.1-5 Annual influenza vaccinations have long been recommended for this group of children.6,7 More recently, the Advisory Committee on Immunization Practices (ACIP) adopted a universal recommendation of yearly influenza vaccination for healthy children aged 6 months to 18 years.6,8 Despite this recommendation, vaccination rates for seasonal influenza remain low for children with chronic conditions.9-15 Missed opportunities, where eligible children are seen by a practitioner but no vaccination dose is administered, have been documented among this population and may contribute to low vaccination rates.9,11
Immunization registries, also known as immunization information systems (IISs), are well established in the United States and provide reminder/recall functions that are effective in increasing vaccination rates.16 However, IISs are not typically designed to track clinical information in addition to vaccinations and consequently cannot target reminder recall notices specifically to those with chronic conditions. Enhancing immunization registries with a high risk indicator may be a mechanism to promote increased vaccination rates among this population through the use of registry-based reminder/ recall capability. In 2006, Michigan’s IIS, known as the Michigan Care Improvement Registry (MCIR), was enhanced with a high risk indicator based on Medicaid administrative data to bolster vaccination rates among children with chronic conditions. This indicator has been demonstrated as being an effective mechanism to target reminder/ recall notices,17 although the benefits of that system have initially been limited to children enrolled in Medicaid.18,19
With that in mind, the objective of this study was to build on the success of the Medicaid-based MCIR high risk indicator by expanding it to include administrative data from 2 commercial health plans. First, we sought to demonstrate the feasibility of using administrative claims data from commercial health plans to establish a high risk indicator in astatewide immunization registry for enrollees with an influenza-sensitive chronic condition (hereafter referred to as a “chronic condition”). We also sought evaluate the potential utility of this expansion of the MCIR high risk indicator by assessing historical influenza vaccination experiences among children with chronic conditions.
METHODS
We assessed the feasibility and utility of using commercial health insurance administrative data to identify children with chronic conditions in the MCIR statewide IIS. Administrative data were obtained from 2 Michiganbased commercial health plans and were matched with corresponding information in the MCIR. This study was approved by the University of Michigan institutional review board.
Study Population
The commercial health plan identified 48,936 children younger than 18 years who were enrolled in either health plan (health plan 1 or health plan 2) for calendar years 2008 and 2009 and had 1 or more claim for at least 1 chronic condition during this period. Chronic conditions were identified using International Classification of Diseases, Ninth Revision, Clinical Modification (ICD-9-CM) diagnosis codes (primary or secondary) reported on claims for conditions indicated as placing individuals at increased risk for influenza disease in the ACIP annual influenza vaccination recommendations.8 Diagnosis codes for the specified conditions were assigned using the same methods as those employed in prior studies (Appendix A).17,18 From this initial cohort, we excluded children who were younger than 6 months, had other insurance, or were not continuously enrolled (8246 [17%] in the 2008-2009 season; 7465 [15%] in the 2009-2010 season). Health plan enrollment and health services utilization were obtained for each subject for the period of 2008 to 2010; information was obtained for demographic characteristics and plan enrollment as well as claims for all outpatient office visits, including vaccine administrations.
Outcomes Measured
Feasibility. Among the commercially insured children 18 years or older who were identified as having 1 or more chronic condition (40,690 in the 2008-2009 season, 41,471 in the 2009-2010 season), we calculated the proportion of cases that could be successfully matched with their corresponding record in the MCIR. A common unique identifier was not available for linking the health plan members with the MCIR, requiring that matching be achieved using the child’s name (first/last), date of birth, and gender. Health services utilization was then evaluated among eligible children who were matched successfully with the MCIR data to determine past influenza vaccination experiences as well as missed opportunities for influenza vaccination.
Utility. Three outcomes were measured for the 2008- 2009 and 2009-2010 influenza seasons, defined to be September to February of each season: (1) primary care office visits (either ≥1 or ≥2 office visits); (2) vaccination for either seasonal or H1N1 influenza; and (3) missed opportunities for either seasonal or H1N1 influenza vaccinations. Primary care office visits were identified based on Current Procedural Terminology (CPT) procedural codes and/or ICD-9-CM diagnosis codes. Office encounters with a physician in a family practice, general practice, internal medicine, or pediatric setting were classified as a primary care visit. Immunization visits and other visits during each influenza season were identified using CPT procedure codes, and well child visits were classified using CPT procedure codes and ICD-9-CM diagnosis codes (Appendix B).
Vaccination records for children with chronic conditions that could be matched with the MCIR were obtained for influenza seasons 2008-2009 and 2009-2010. Healthcare providers are required by Michigan law to input in the MCIR all vaccination doses administered to persons younger than 20 years of age. Seasonal and H1N1 influenza vaccination rates were classified as the receipt of a dose as recorded in the MCIR or through administrative claims. In cases where more than 1 seasonal or H1N1 vaccination dose was administered during an influenza season, we considered the first date of influenza vaccination (from either administrative claims or MCIR data) as the vaccination date for our analysis. Missed opportunities for seasonal influenza vaccination were classified as the initial office visit occurring during the influenza season (September-February) among children who remained unvaccinated throughout the entire influenza season. Since H1N1 influenza vaccine supply was limited from September to October 2009, missed opportunities for H1N1 influenza vaccination were classified as the initial office visit occurring from November 2009 through February 2010 among children who remained unvaccinated throughout the entire influenza season. Subsequent missed opportunities were not counted. The date of the missed opportunity was classified as the date of the initial office visit occurring between September and February for seasonal influenza vaccination and between November and February for H1N1 influenza vaccination in which the child remained unvaccinated. We calculated estimated seasonal and H1N1 influenza vaccination rates that could potentially be achieved if missed opportunities were successfully converted into influenza vaccination events. Seasonal and H1N1 influenza rates for the 2008-2009 and 2009-2010 seasons were contrasted between our cohort of children with a chronic condition identified by the commercial health plan with a matched group not having a chronic condition. We used the MCIR to identify children who were not designated with the system’s high risk indicator as the basis for our comparison group. However, at the time of our study, the MCIR high risk indicator process was limited to children with chronic conditions who were, or had previously been, enrolled in Medicaid. Children with only commercial insurance would not have chronic conditions identified through claims. As a result, the high risk status of children who were commercially insured in plans other than the 2 health plans used in this study was not known with certainty in the MCIR. To control for potential misclassification, we further categorized our comparison group of children without a MCIR high risk indicator into 2 subgroups: (1) children currently enrolled in Medicaid, not identified in the MCIR as having a chronic condition (since these children are or were previously enrolled in Medicaid, their claims were subject to queries to identify chronic conditions and therefore, absence of a high risk indicator in the MCIR is reflective of not having a chronic condition); and (2) children never enrolled in Medicaid, whose status in the MCIR was indicated as not high risk. While this group likely contains primarily children who did not have a chronic condition, it is possible that some may have had a chronic condition that was not detected in claims data queries, since this group had never been enrolled in Medicaid. Using this process, 1 comparison child was randomly selected for each commercially insured high-risk case, matching on birth month and year, gender, and Michigan county of residence. This resulted in a 1:1 matched set of comparison children for each high risk case. Claims data were not available for children who had never been enrolled in Medicaid; as such, seasonal and H1N1 influenza doses were compared in this subanalysis across the 3 groups using doses reported in the MCIR.
Data Analysis
To assess feasibility, we summarized the proportion of cases in the commercial health plans that were successfully matched within MCIR. Primary outcomes measured for the utility of using administrative claims were the receipt of seasonal and H1N1 vaccination and either at least 1 or at least 2 office visits. Health utilization was compared between 1 health plans (health plan 1 and health plan 2) by child characteristics, including age, gender, and rural/urban designation (US Census Metropolitan Statistical Area classification). The proportion of children with a missed opportunity was assessed and compared by influenza season (2008-2009 and 2009-2010) by each child’s age group. In addition, observed rates of seasonal and H1N1 influenza vaccinations as reported in MCIR were calculated and compared among the commercially insured high risk group and the 2 comparison groups described above. Estimated influenza vaccination rates were determined by classifying each child with a missed opportunity as a potential influenza vaccination event, and compared across seasons for the commercially insured children with chronic conditions. All analyses were conducted using SAS version 9.2 (SAS Institute Inc, Cary, North Carolina).
RESULTS
Table 1
Characteristics for our study population are shown in contrasting children enrolled in health plan 1 with those in health plan 2 for the 2008-2009 and 2009-2010 influenza seasons. In 2008-2009, health plan 2 enrollees tended to exclude rural counties of residence (P <.0001) and were skewed toward young age groups (P <.0001); similar results were found for the 2009-2010 season. The sample of children enrolled in health plan 2 included a greater proportion of children under 6 years of age than children enrolled in health plan 1 for both the 2008-2009 (32% vs 24%; P <.0001) and 2009-2010 (29% vs 22%; P <.0001) influenza seasons. We found a high degree of success in matching children with chronic conditions identified through administrative claims data with MCIR. Overall, 93% of the commercially insured children with chronic conditions were successfully matched with their respective MCIR record; this result was consistent across both seasons in our study period. There were no differences between the matched and unmatched groups by age, gender, or county of residence. Children enrolled in health plan 2 had a higher degree of match success than did children enrolled in health plan 1 for the 2008-2009 (98% vs 90%) and 2009-2010 (98% vs 91%) influenza seasons. Match rates were consistent across plans by gender and age, but were substantially lower for children from unknown counties of residence (44% for health plan 2 vs 83% for health plan 1).
Table 2
Less than one-third of children received the seasonal influenza vaccine during either the 2008-2009 (29%) or 2009-2010 (32%) influenza seasons; 30% of children received the H1N1 vaccination in 2009-2010. The proportion of children with influenza vaccination or office visits during the 2008-2009 and 2009-2010 influenza seasons varied within health plans (). For both the seasonal and H1N1 vaccines, younger children were more likely to be vaccinated than older children; this was true for children enrolled in health plan 1 (P <.0001) and health plan 2 (P <.0001) across both influenza seasons. Vaccination rates did not differ by gender. For health plan 1, children residing in rural counties were more likely to receive the seasonal vaccination during both the 2008-2009 and 2009-2010 seasons (P <.0001) and H1N1 vaccination in the 2009-2010 season (P <.0001) compared with children from urban or unknown settings. Vaccination rates did not differ by county of residence for children enrolled in health plan 2.
Overall, 71% of all children were seen by a provider at least once in either season; nearly half had at least 2 provider visits in 2008-2009 (44%) and 2009-2010 (45%). Rates of office visits were highest among younger children across both influenza seasons and plans (P <.0001); adolescents (aged 11-18 years) were the least likely to be seen by a provider in both the 2008-2009 and 2009-2010 influenza seasons. Vaccination rates and office visits differed across health plans (Table 2). Compared with children enrolled in health plan 1, children enrolled in plan 2 had higher seasonal vaccination and office visits across both influenza seasons as well as H1N1 vaccination rates in the 2009-2010 season. Patterns among each plan remained consistent across influenza seasons.
Figure 1
Missed opportunities for influenza vaccination were commonplace among children each season and varied substantially across age groups (). Among all children in our sample, 71% remained unvaccinated for influenza during the 2008-2009 season, 68% remained unvaccinated during the 2009-2010 season, and 70% remained unvaccinated for H1N1 in the 2009-2010 season. Among those who remained unvaccinated, nearly twothirds (63%) of children during both the 2008-2009 and 2009-2010 seasons had at least 1 missed opportunity for seasonal influenza vaccination; 50% of children had a H1N1 missed opportunity in 2009-2010. Children aged 6 to 18 months were most likely to have at least 1 missed opportunity for H1N1 vaccination (81%) and seasonal vaccination in the 2008-2009 (90%) and 2009-2010 (88%) seasons. The proportion of children with chronic conditions having a missed opportunity decreased sharply among older children. Given their lower numbers of office visits, adolescents had the lowest rate of missed opportunities for the seasonal influenza vaccine during 2008-2009 (58%) and 2009-2010 (57%) and the H1N1 vaccine during 2009-2010 (43%). Importantly, Figure 1 also illustrates the population that was unvaccinated for influenza and had no office visit; ranging from a minority of unvaccinated children 18 months or younger (≤10%) to nearly 50% of adolescents.
Figure 2
We estimated maximum vaccination rates potentially achievable if missed opportunities were successfully converted into administered influenza doses for children with chronic conditions enrolled in the commercial health plans (). By converting initial missed opportunities into influenza vaccination events, cumulative gains of 45% (2008-2009) and 44% (2009-2010) were estimated for seasonal influenza vaccinations and 35% for H1N1 influenza vaccinations. If missed opportunities were eliminated, the commercially insured children with chronic conditions could potentially have experienced seasonal influenza vaccination rates that were markedly higher than the observed vaccination rates. If all missed opportunities were converted to vaccination events, seasonal vaccination rates in February would have been 74% versus 29% (2008-2009) and 75% versus 32% (2009-2010). H1N1 vaccination rates could have reached 65% by the end of the influenza season in 2010, versus the rate of 30% that was observed at that time.
Seasonal and H1N1 influenza rates for the 2008-2009 and 2009-2010 seasons as reported in MCIR only were contrasted between our cohort of children with chronic conditions identified by the commercial health plans with 2 matched groups of non—chronic condition children. Less than one-third of the enrollees with chronic conditions identified by the commercial plans received the seasonal influenza vaccine in either the 2008-2009 (26%) or 2009-2010 (29%) influenza seasons; 31% of children received the H1N1 vaccination in 2009-2010. In contrast, children enrolled in Medicaid without a chronic condition had sharply lower vaccination rates for seasonal (17% during 2008-2009 and 19% during 2009-2010) and H1N1 (18%) vaccinations. Similarly, children never enrolled in Medicaid without a chronic condition indication in the MCIR had comparably low seasonal vaccination rates during both seasons (16% in 2008-2009 and 18% in 2009- 2010), and 20% for H1N1.
DISCUSSION
Our findings demonstrate the feasibility of using administrative claims data from commercial health plans to identify children with chronic conditions and subsequently match them within a statewide immunization registry to enable a high risk indicator. This study extends previous findings that document accuracy in using Medicaid administrative data to identify children with chronic conditions in a statewide IIS.18 To our knowledge, this is one of only 2 studies that link billing-based identification data with statewide immunization registries17; however, previous studies have utilized similar approaches to identify chronic conditions from administrative data,18,20-22 including variations of the Healthcare Effectiveness Data and Information Set (HEDIS) methodology.23-26
These findings have important implications for promoting vaccination among children with chronic conditions. Despite the progressive expansion of the influenza vaccination recommendations for all children younger than 18 years during the past decade,6 the ability to quickly identify children with chronic conditions remains important. Although universal influenza vaccination recommendations for children aged 6 months to 18 years have been adopted, this does not equate to universal vaccination. Influenza vaccination rates remain low for children with chronic conditions,9,10,14 even during times of pandemic.27 Integrating administrative claims with a statewide registry could enable a population-based mechanism for the identification of children with chronic conditions as priority cases either during pandemic events or supply shortages.
Although our study found a high degree of success in matching administrative claims with the statewide registry, ample opportunities to improve linkages exist. Establishing a common identifier unique to each child between systems would greatly improve methods of information exchange among registries and electronic health records (EHRs). In order to establish unambiguous linkages without a common identifier, a minimum set of demographic data on each child should be present prior to information sharing between systems as recommended by American Immunization Registry Association (AIRA), an organization that helps establish uniform standards to advance IIS and immunization programs.28
The ability to link administrative claims with statewide registries is only the first step in identification and prioritization of children with chronic conditions. Given the rapid adoption of EHRs by providers, mechanisms to identify individuals with chronic conditions on a population basis will likely continue to evolve. Current federal programs, including the Meaningful Use Incentive Program, will foster mechanisms to identify children with chronic conditions in EHRs. This program, which provides incentives for medical practices to establish EHRs, sets the stage for categorization of children with chronic conditions by tying funding to a practice’s ability to generate a list of patients by specific conditions using an EHR. Ongoing efforts to establish interoperability between EHR and statewide registries will expedite real-time reporting of influenza immunization doses administered by healthcare providers and could enable the exchange of information regarding chronic conditions, if allowed by the registry.29 Ultimately, improved interoperability with EHRs may introduce opportunities to identify chronic conditions from the source, with chronic condition lists being maintained by practices’ clinical and billing systems in conjunction with the Meaningful Use program objectives.
Our study also provides insight into the utility of a high risk indicator. Although the commercially insured children with chronic conditions were more likely to be vaccinated for seasonal influenza and H1N1 than their counterparts without a chronic condition, their observed influenza rates were low and missed opportunities were frequent. Similar to other studies, we found that only a minority of children with chronic conditions received the seasonal influenza or H1N1 vaccination30 and missed opportunities were commonplace among this group of high risk children.11 Low vaccination rates, combined with high rates of missed opportunities, suggest that multiple outreach strategies may be necessary to improve influenza vaccination rates among this group of children. Not surprisingly, adolescents had the lowest rate of vaccination among our sample and were the least likely to have been seen by a provider throughout both influenza seasons. Reminder/recall is one strategy to improve influenza vaccination among children with chronic conditions, where parents are notified by mail, telephone, or other mechanisms to serve as a prompt to vaccinate their children.30,31 For this group, vaccination reminders prompting parents of adolescents to schedule an appointment with vaccination providers, either public or private, may be an effective mechanism to increase office visits and influenza vaccination rates.
In contrast, reminder/recall may have limited impact on increasing vaccination rates among children experiencing missed opportunities since they, by definition, had 1 or more office visit during the flu season, yet remained unvaccinated throughout the season. We found that younger children had greater missed opportunities than older children, suggesting that outreach strategies could differ by age group. Most of the unvaccinated children younger than 3 years in our sample had at least 1 missed opportunity and were seen by a provider throughout the 2008-2009 and 2009-2010 influenza seasons. Consequently, parent reminders alone might not be effective in reducing missed opportunities for this group. Implementing provider-focused reminder systems in combination with mailed reminders for parents of younger children may be 1 strategy to convert missed opportunities to vaccination events.
Our findings should be considered in light of several limitations. We were unable to evaluate the accuracy and completeness of the commercial healthcare claims data used to populate the high risk indicator in MCIR. Consequently, we were therefore unable to verify the accuracy of using the administrative claims data from the commercial health plans in identifying children with chronic conditions. Additionally, although this study examined missed opportunities among children with chronic conditions, we are unable to determine why missed opportunities occur. Furthermore, because our study intended to demonstrate the feasibility of using administrative data to identify children with chronic conditions, children were included in our sample if they had at least 1 claim for a chronic condition regardless of the number of provider encounters, severity, or duration of the condition. Future studies examining the accuracy, feasibility, and utility of using administrative claims data should also take into account the severity of chronic condition by subdividing children with chronic conditions into complexity groups. Finally, it should be noted that substantial time lags were encountered with respect to executing the data-use agreements required for this study. Such delays should be considered in future studies or applications of these methods to public health practice.
In conclusion, our study found that administrative claims data can be used to identify children with chronic conditions in a statewide registry. Low vaccination rates and a high rate of missed opportunities among the children with chronic conditions in our sample suggests the utility of integrating administrative claims data with statewide registries for use of various outreach strategies, including reminder/recall aimed at parents and provider-focused reminders.Author Affiliations: Child Health Evaluation and Research Unit, Division of General Pediatrics, University of Michigan, Ann Arbor, MI (KJD, LC, SD, SJC).
Source of Funding: This study was supported by the Center for Healthcare Research and Transformation.
Author Disclosures: The authors report no relationship or financial interest with any entity that would pose a conflict of interest with the subject matter of this article.
Authorship Information: Concept and design (KJD, SJC); acquisition of data (KJD, SD); analysis and interpretation of data (KJD, LC, SD, SJC); drafting of the manuscript (KJD, LC); critical revision of the manuscript for important intellectual content (LC, SJC); statistical analysis (KJD, SD); obtaining funding (KJD); administrative, technical, or logistic support (SJC); supervision (KJD).
Address correspondence to: Kevin J. Dombkowski, DrPH, MS, University of Michigan, Division of General Pediatrics, 300 N Ingalls, Rm 6D05, Ann Arbor, MI 48109-5456. E-mail: kjd@med.umich.edu.1. Hassan F, Lewis TC, Davis MM, Gebremariam A, Dombkowski K. Hospital utilization and costs among children with influenza, 2003. Am J Prev Med. 2009;36(4):292-296.
2. Erhart LM, Rangel MC, Lu PJ, Singleton JA. Prevalence and characteristics of children at increased risk for complications from influenza, United States, 2000. J Pediatr. 2004;144(2):191-195.
3. Bhat N, Wright JG, Broder KR, et al. Influenza-associated deaths among children in the United States, 2003-2004. N Engl J Med. 2005; 353(24):2559-2567.
4. Neuzil KM, Wright PF, Mitchel EF, Jr., Griffin MR. The burden of influenza illness in children with asthma and other chronic medical conditions. J Pediatr. 2000;137(6):856-864.
5. Glezen WP, Greenberg SB, Atmar RL, Piedra PA, Couch RB. Impact of respiratory virus infections on persons with chronic underlying conditions. JAMA. 2000;283(4):499-505.
6. Smith NM, Bresee JS, Shay DK, Uyeki TM, Cox NJ, Strikas RA. Prevention and Control of Influenza: recommendations of the Advisory Committee on Immunization Practices (ACIP). MMWR Recomm Rep. 2006;55(RR-10):1-42.
7. Surgeon General’s Advisory Committee on Influenza: United States Public Health Service. Recommendations for influenza immunization and control in the civilian population. Washington, DC; 1962.
8. Fiore AE, Shay DK, Broder K, et al. Prevention and control of seasonal influenza with vaccines: recommendations of the Advisory Committee on Immunization Practices (ACIP), 2009. MMWR Recomm Rep. 2009; 58(RR-8):1-52.
9. Daley MF, Beaty BL, Barrow J, et al. Missed opportunities for influenza vaccination in children with chronic medical conditions. Arch Pediatr Adolesc Med. 2005;159(10):986-991.
10. Centers for Disease Control and Prevention. Influenza Vaccination Coverage Among Children With Asthma --- United States, 2005-06 Influenza Season. Morb Mortal Wkly Rep. 2008;57(24):653-657.
11. Dombkowski KJ, Davis MM, Cohn LM, Clark SJ. Effect of missed opportunities on influenza vaccination rates among children with asthma. Arch Pediatr Adolesc Med. 2006;160(9):966-971.
12. Kramarz P, DeStefano F, Gargiullo PM, et al; Vaccine Safety Datalink Team. Influenza vaccination in children with asthma in health maintenance organizations. Vaccine. 2000;18(21):2288-2294.
13. Szilagyi PG, Rodewald LE. Missed opportunities for influenza vaccination among children with asthma. Pediatr Infect Dis J. 1992;11(9): 705-708.
14. Gnanasekaran SK, Finkelstein JA, Lozano P, Farber HJ, Chi FW, Lieu TA. Influenza vaccination among children with asthma in Medicaid managed care. Ambul Pediatr. 2006;6(1):1-7.
15. Chung EK, Casey R, Pinto-Martin JA, Pawlowski NA, Bell LM. Routine and influenza vaccination rates in children with asthma. Ann Allergy Asthma Immunol. 1998;80(4):318-322.
16. Task Force on Community Preventive Services. Guide to Community Preventive Services. Universally recommended vaccinations: client reminder & recall systems. http://www.thecommunityguide.org/ vaccines/universally/clientreminder.html. Published 2010. Accessed December 2, 2010.
17. Daley MF, Barrow J, Pearson K, et al. Identification and recall of children with chronic medical conditions for influenza vaccination. Pediatrics. 2004;113(1, pt 1):e26-e33.
18. Dombkowski KJ, Lamarand K, Dong S, Perng W, Clark SJ. Using Medicaid claims to identify children with asthma. J Public Health Mgmt Pract. 2012;18(3):196-203.
19. Clark SJ, Lamarand K, Dombkowski KJ. Identifying children with chronic conditions for influenza vaccination using a statewide immunization registry: initial experiences of primary care providers. J Public Health Mgmt Pract. 2012;18(3):204-208.
20. Kozyrskyj AL, Mustard CA, Becker AB. Identifying children with persistent asthma from healthcare administrative records. Can Respir J. 2004;11(2):141-145.
21. Buescher PA, Jones-Vessey K. Using Medicaid data to estimate state- and county-level prevalence of asthma among low-income children. Matern Child Health J. 1999;3(4):211-216.
22. Mosen DM, Macy E, Schatz M, et al. How well do the HEDIS asthma inclusion criteria identify persistent asthma? Am J Manag Care. 2005;11(10):650-654.
23. Berger WE, Legorreta AP, Blaiss MS, et al. The utility of the Health Plan Employer Data and Information Set (HEDIS) asthma measure to predict asthma-related outcomes. Ann Allergy Asthma Immunol. 2004;93(6):538-545.
24. Fuhlbrigge AL, Carey VJ, Finkelstein JA, et al. Validity of the HEDIS criteria to identify children with persistent asthma and sustained high utilization. Am J Manag Care. 2005;11(5):325-330.
25. Schatz M, Zeiger RS, Yang SJ, et al. Persistent Asthma Defined Using HEDIS Versus Survey Criteria. Am J Manag Care. 2010;16(11): 281-288.
26. Mosen D, Macy E, Schatz M, et al. How Well Do the HEDIS asthma inclusion criteria identify persistent asthma? Am J Manag Care. 2005; 11:650-654.
27. Boulton ML, Grossman AM, Potter R, Vranesich PA, Clayton J. Assessing the relationship between seasonal and H1N1 influenza vaccination status in Michigan children, 2009-2010. Public Health Rep. 2011; 126(suppl 2):70-77.
28. Lemon HM, Darden PM. Measuring practice immunization rates quickly and accurately in the era of HIPAA: validation of the quick count method in practice settings. J S C Med Assoc. 2008;104(6): 194-197.
29. Dombkowski KJ, Clark SJ. Redefining Meaningful Use: Achieving Interoperability with Immunization Registries. Am J Prev Med. 2012;42(4):e33-e35.
30. Dombkowski KJ, Harrington LB, Dong S, Clark SJ. Seasonal influenza vaccination reminders for children with high risk conditions a registry-based randomized trial. Am J Prev Med. 2012;42(1):71-75.
31. Dombkowski KJ, Costello LE, Harrington LB, Dong S, Kolasa M, Clark SJ. Age-Specific Strategies for Immunization Reminders and Recalls: A Registry-Based Randomized Trial. Am J Prev Med. 2014; S0749-3797(14)00105-6. doi: 10.1016/j.amepre.2014.02.009.