Surveillance snapshot: Challenges of statistical power in high coverage populations: influenza vaccine effectiveness trends among U.S. active component service members, 2016–2025

Image of MSMR 202610 Photo3_ToC_VaccineEffect_Flu_9418979. Annual estimates of military influenza vaccine effectiveness typically demonstrate lower efficacy among active component service members compared to national data.

Influenza vaccines have been used by the U.S. military since the 1940s, and were required annually from the 1950s until 2026 for active component service members (ACSMs),1 but annual estimates of military influenza program vaccine effectiveness (VE), through traditional observational test-negative case control studies, typically demonstrate lower VE among ACSMs when compared to national data. Multiple factors may influence this disparity, including diminished antibody response to multiple vaccinations, waning immunity during the influenza season, and study design limitations including adequate statistical power.2 This Surveillance Snapshot summarizes seasonal influenza VE among ACSMs from 2016 through 2025 compared to U.S. Centers for Disease Control national estimates and describes statistical power challenges in calculating VE in the highly vaccinated U.S. military population.

The Armed Forces Health Surveillance Division (AFHSD) utilizes Defense Medical Surveillance System data to generate seasonal influenza VE estimates for ACSMs. Each season, a test-negative observational case-control design, previously reported,3 is used to calculate influenza VE in the U.S. military. The frequent use of this design is due to key methodological advantages: It simplifies execution by identifying cases and controls concurrently and draws sample cases from a population with similar health care-seeking behaviors (i.e., minimizes confounding). Historically, these strengths have made the test-negative design the preferred method for calculating the seasonal VE for influenza, both within the military and nationally.2 Each year, however, this VE analysis is subject to variance in influenza severity (i.e., case volume) and testing frequency (i.e., number of controls).

‘Power’ is the probability a statistical test will correctly reject a false null hypothesis (e.g., vaccine has no effect). In general, power increases with a larger sample size and more controls matched to cases. A ratio of 1-to-4 (case[s]-to-controls) is generally considered the threshold ratio, when adding more controls provides little additional power, but higher ratios may be beneficial in large studies with small significance levels.4 Sample sizes necessary for adequate power to detect significant VE in highly vaccinated populations can be estimated: For example, the World Health Organization sample size calculator indicates that a VE evaluation employing a case-control test-negative study design with a 1:4 case-to-control ratio, predicted VE of 40%, confidence interval length of 10%, expected vaccine coverage of 90%, and power of 80% requires a sample size of over 5,700 cases and 22,900 controls.5

Table 1 summarizes AFHSD annual (when available) and mid-season influenza adjusted VE estimates from 2016 through 2025 for ACSMs with numbers of cases and controls, percentages vaccinated, and ratios of cases to controls.6-13 Seasonal comparisons demonstrate that years with increased sample sizes, higher case-to-control ratios, and lower vaccination coverage produced VE estimates consistent with the general population (2021-2022, 2022-2023 seasons),14 indicating that this case-control test-negative study design is often under-powered, due to the typically high vaccination coverage of the ACSM population as a result of the historical annual goal of greater than 90% immunization. When interpreting annual VE estimates in a highly immunized population, considering the statistical power and sample size required is important for contextualizing the results and detecting significant VE.

References

  1. Grabenstein JD, Pittman PR, Greenwood JT, Engler RJM. Immunization to protect the US Armed Forces: heritage, current practice, and prospects. Epidemiol Rev. 2006;28(1):3-26. doi:10.1093/epirev/mxj003
  2. Sayers DR, Iskander JK. Influenza vaccine effectiveness and test-negative study design within the Department of Defense. Mil Med. 2023;188(11-12):289-291. doi:10.1093/milmed/usac436
  3. Eick-Cost AA, Hu Z. Mid-season influenza vaccine effectiveness against laboratory-confirmed ambulatory influenza among U.S. active component service members, December 1, 2024–February 8, 2025. MSMR. 2025;32(3):20. Accessed May 18, 2026. https://www.health.mil/news/articles/2025/03/01/msmr-flu-vaccine-effectiveness
  4. Iwagami M, Shinozaki T. Introduction to matching in case-control and cohort studies. Ann Clin Epidemiol. 2022;4(2):33-40. doi:10.37737/ace.22005
  5. World Health Organization. Sample Size Calculator for Evaluation of COVID-19 Vaccine Effectiveness (Excel). Mar. 17, 2021. Accessed Feb. 3, 2026. https://www.who.int/publications/i/item/WHO-2019-nCoV-vaccine_effectiveness-measurement_tool-2021.1
  6. Toure E, Eick-Cost AA, Hawksworth, W, et al. Mid-season influenza vaccine effectiveness estimates for the 2016-2017 influenza season. MSMR. 2017;24(8):17-19. Accessed Feb. 3, 2026. https://www.health.mil/reference-center/reports/2017/01/01/medical-surveillance-monthly-report-volume-24-number-8
  7. Coleman R, Mancuso JD. Department of Defense end-of-season influenza vaccine effectiveness estimates for the 2017-2018 season. MSMR. 2018;25(10):16-20. Accessed Feb. 3, 2026. https://www.health.mil/reference-center/reports/2018/01/01/medical-surveillance-monthly-report-volume-25-number-10
  8. Lynch LC, Coleman R, DeMarcus L, et al. Department of Defense midseason estimates of vaccine effectiveness for the 2018-2019 influenza season. MSMR. 2019;26(7):24-27. Accessed Feb. 3, 2026. https://www.health.mil/reference-center/reports/2019/07/01/medical-surveillance-monthly-report-volume-26-number-7
  9. Thervil JW, Williams VF, Coleman R, et al. Department of Defense mid-season vaccine effectiveness estimates for the 2019-2020 influenza season. MSMR. 2021;28(6):16-19. Accessed Feb. 3, 2026. https://www.health.mil/reference-center/reports/2021/06/01/medical-surveillance-monthly-report-volume-28-number-06
  10. U.S. Food and Drug Administration. Vaccines and Related Biological Products Advisory Committee March 3, 2022 Meeting Announcement. U.S. Dept. of Health and Human Services. Mar. 3, 2022. Accessed Feb. 3, 2026. https://www.fda.gov/advisory-committees/advisory-committee-calendar/vaccines-and-related-biological-products-advisory-committeemarch-3-2022-meeting-announcement
  11. U.S. Food and Drug Administration. Vaccines and Related Biological Products Advisory Committee Mar. 7, 2023 Meeting Announcement. U.S. Dept. of Health and Human Services. Feb. 23, 2023. Accessed Feb. 3, 2026. https://www.fda.gov/advisory-committees/advisory-committee-calendar/vaccines-and-related-biological-products-advisory-committee-march-7-2023-meeting-announcement
  12. Eick-Cost AA, Hu Z. 2023-2024 mid-season influenza vaccine effectiveness against laboratory-confirmed ambulatory influenza: U.S. active component service members. MSMR. 2024;31(3):22. Accessed Feb. 3, 2026. https://www.health.mil/reference-center/reports/2024/03/01/msmr-march-2024-volume-31-number-3
  13. Eick-Cost AA, Hu Z. Mid-season influenza vaccine effectiveness against laboratory-confirmed ambulatory influenza among U.S. active component service members, December 1, 2024–February 8, 2025. MSMR. 2025;32(3):20. Accessed Feb. 3, 2026. https://www.health.mil/news/articles/2025/03/01/msmr-flu-vaccine-effectiveness
  14. Centers for Disease Control and Prevention. How Flu Vaccine Effectiveness and Efficacy Are Measured. U.S. Dept. of Health and Human Services. May 30, 2025. Accessed Feb. 3, 2026. https://www.cdc.gov/flu-vaccines-work/php/effectiveness-studies/index.html

Author Affiliations

Department of Preventive Medicine and Biostatistics, Uniformed Services University of the Health Sciences, Bethesda, MD: Lt Col Sayers; Epidemiology and Analysis Branch, Armed Forces Health Surveillance Division, Public Health Directorate, Defense Health Agency, Silver Spring, MD: Dr. Eick-Cost

Disclaimers

The opinions and assertions expressed herein are those of the authors and do not reflect official policy nor position of the Uniformed Services University of the Health Sciences or the U.S. Department of War. This work was prepared by military and contract employees of the U.S. Government as part of official duties and therefore is in the public domain and does not possess copyright protection. Public domain information may be freely distributed and copied; as a courtesy, it is requested that the Uniformed Services University and authors are appropriately acknowledged.

The authors have no conflicts of interest to declare.

You also may be interested in...

Article
Feb. 1, 2026

Number of tuberculosis tests and diagnoses of latent tuberculosis infection among U.S. Army active component service members, January 2014–December 2023

This report describes the trends of tuberculosis testing and latent tuberculosis infection positivity in U.S. Army active component soldiers during the first decade following the 2013 U.S. Army Medical Command policy revision to a targeted, risk-based tuberculosis testing strategy.

Article
Feb. 1, 2026

Historical perspective: Post-infection symptoms in U.S. soldiers with malaria during the Second World War: major limitation to return to duty

This historical review discusses how the primary challenge presented by malaria infections in the Pacific theater during World War II was an inability to return recovered soldiers quickly to their units, with nearly one percent of malaria patients repatriated for ‘chronic malaria’.

Report
Feb. 1, 2026

MSMR Vol. 33 No. 2 - February 2026

.PDF | 1.29 MB

The February 2026 MSMR features a report on the number of tuberculosis tests and diagnoses of latent tuberculosis infection in the U.S. Army; a historical review on post-infection symptoms in U.S. soldiers with malaria during World War II and its major limitation to return to duty; a Surveillance Snapshot on adherence to disease and injury ...

Article
Jan. 1, 2026

Case report: An atypical Ross River Virus infection in an Australian Army service member

This case report details the process of differential diagnosis of Ross River virus in an individual diagnosed in Queensland, Australia in 2024. The report demonstrates the need for better clinical awareness among medical care providers for U.S. service members presenting with febrile illness or joint pain following deployment to Australia.

Report
Jan. 1, 2026

MSMR Vol. 33 No. 1 - January 2026

.PDF | 3.43 MB

The January 2026 MSMR features a full report on Guillain-Barré syndrome among U.S. active component service members, 2014–2022; and a report on distinct approaches to racial and ethnic classification to the surveillance of obstetric and neonatal outcomes in the U.S. military, 2010–2021; followed by a case report an atypical Ross River virus infection ...

Report
Dec. 1, 2025

MSMR Vol. 32 No. 12 - December 2025

.PDF | 2.86 MB

The December 2025 issue of MSMR features four full reports: the annual update on cold weather injuries among the active and reserve components; a report on trends in the prevalence of obesity among U.S. active component service members and civilians; the annual update on diagnoses of mental health disorders among active component service members; a ...

Article
Dec. 1, 2025

Update: Cold weather injuries among the active and reserve components of the U.S. Armed Forces, July 2020–June 2025

Since 2004, MSMR has published annual updates on the incidence of cold weather injuries affecting U.S. Armed Forces members for the five most recent cold seasons. This 2025 report discusses the occurrence of frostbite, immersion hand and foot injuries, hypothermia, as well as “other specified and unspecified effects of reduced temperature.”

Refine your search