Back to Top Skip to main content Skip to sub-navigation

A new approach to categorization of ocular injury among U.S. Armed Forces

Image of Air Force and Space Force Surgeon General Lt. Gen. Dorothy Hogg receives an eye exam from Air Force Reserve Maj. Leslie Wilderson at Joint Base Anacostia-Bolling, Washington, D.C., March 26, 2021. Photo By: Air Force Staff Sgt. Kayla White. Air Force and Space Force Surgeon General Lt. Gen. Dorothy Hogg receives an eye exam from Air Force Reserve Maj. Leslie Wilderson at Joint Base Anacostia-Bolling, Washington, D.C., March 26, 2021. Photo By: Air Force Staff Sgt. Kayla White

Recommended Content:

Medical Surveillance Monthly Report

Abstract

This report describes a new approach to categorizing ocular injury using Military Health System data, the application of an algorithm to a dataset, and the verification of the results using an audit of clinical data. Based on health care encounter data, an algorithm was developed to systematically document the occurrence of specific complications and medical procedures in the 12 months following initial ocular injuries. The injuries were classified into 1 of 2 groups: "uncomplicated injury" with no complications or medical procedures and "complicated injury" with complications and/or medical procedures. Injuries in the latter group were further classified by severity into low, moderate, and high strata based on a ranking of complications and medical procedures. From 2016 through 2019, 12,664 complicated ocular injuries and 49,016 uncomplicated injuries were identified among active duty U.S. military members. The vast majority (84%) of complications were concurrent or occurred within 30 days following the injury. The 3 most common complications (orbital floor fracture, iridocyclitis and recurrent corneal erosion) accounted for 52% of complications. These findings underscore the importance of accurate classification of complex ocular injuries to inform studies in multiple areas including injury prevention, the development of clinical guidelines, and health services research.

What are the New Findings?

The Vision Center of Excellence (VCE) developed a classification algorithm that uses longitudinal data (including diagnoses of complications and medical procedures related to the initial ocular injury) to more accurately classify ocular injuries sustained by U.S. service members. The results of the algorithm's classification were verified through medical record review.

What is the Impact on Readiness and Force Health Protection?

Ocular injuries present an ongoing threat to readiness and retention of service members. Robust surveillance methods are needed to account for non-specific and often inconsistent diagnosis coding in electronic health records. The increased accuracy of classification of ocular injuries provides critical data to inform prevention and treatment initiatives.

Background

Ocular injuries have the potential to negatively impact the readiness and retention of U.S. service members and incur a significant cost to the Military Health System (MHS).1 The availability of large administrative/billing data sources provides the opportunity to surveil the burden and trend of ocular injuries. It is a challenge, however, to categorize ocular injuries based on electronic health record (EHR) data because coded diagnoses may be non-specific and inconsistent in resource-constrained settings, such as an emergency room or a primary care clinic. Ocular injuries frequently involve more than 1 anatomic structure, and have been described in multiple publications as complex injuries.2–4 Surveillance of ocular injuries in the U.S. Armed Forces is conducted by the Tri-service Vision Conservation and Readiness Program of the Army Public Health Center and the Armed Forces Health Surveillance Division which identifies cases based on initial diagnoses in administrative health records.5

The Vision Center of Excellence (VCE) was established by congressional mandate in 2008 as a center of excellence in the prevention, diagnosis, mitigation, treatment, and rehabilitation of military eye injuries.6 The VCE developed the military ocular injury case definition in support of multiple initiatives, including improved utilization of the Defense and Veterans Eye Injury and Vision Registry (DVEIVR). This registry contains information to track diagnoses, interventions/treatments, and follow-up for each case of significant eye injury sustained by a member of the U.S. Armed Forces while serving on active duty. The DVEIVR permits accurate ocular injury burden reporting and estimation of health care burden across the MHS. To improve the accuracy of classification of ocular injuries in the MHS, the VCE developed a novel approach to characterizing ocular injury that uses information on multiple diagnoses and procedures from MHS administrative data. This approach allows classification of ocular injuries by their severity and can be used for multiple types of initiatives including monitoring trends and targeting significant ocular injuries in the U.S. military members. The objective of this study was to provide accurate information on the type and severity of ocular injuries to inform strategic planning for medical readiness, resource allocation, and prevention programs.

Methods

Ocular injury data were obtained by applying the VCE case definition for ocular injury to the Military Health System Management and Analysis Reporting Tool (M2), a longitudinal administrative data warehouse that contains electronic medical records of hospitalization and ambulatory medical encounters in both military medical treatment facilities (Direct CareDirect care refers to military hospitals and clinics, also known as “military treatment facilities” and “MTFs.”direct care) and civilian facilities (Purchased CareThe TRICARE Health Program is often referred to as purchased care. It is the services we “purchase” through the managed care support contracts.purchased care). Additional data on ocular injuries documented in deployed settings were obtained from the Theater Medical Data Store (TMDS). Health care records of both active component and activated guard/reserve service members were captured based on beneficiary category in the M2 and included in these analyses. Guard and reserve service members receive the same care entitlements as those in the active component if they were on active duty for more than 30 days, or may qualify for Line of Duty Care if injured while on active duty for fewer than 30 days.

The classification algorithm (Figure) developed by the VCE used multiple criteria including 320 International Classification of Diseases, 10th Revision (ICD-10) diagnosis codes for ocular injuries (Table 1), 332 ICD-10 diagnosis codes for potential complications (Table 2), and 1,543 Procedural Classification System (PCS) and ICD Current Procedural Terminology (CPT) codes for outpatient procedures associated with ocular injuries (Table 3) to assess and classify the severity of the injuries.

Of note, the complications include conditions with potential impacts on readiness and retention, such as corneal ulcers, retinal breaks, and orbital fractures. The included list of procedures was based on the results of the ophthalmology knowledge, skills, and abilities (KSA) workgroup. This ad hoc workgroup, consisting of military ophthalmologists with deployment experience, reviewed outpatient ophthalmic procedures and developed a tiered system to determine readiness to deploy based on the number of procedures performed in the military treatment facilities. The VCE mapped CPT codes to ICD-10 PCS codes to ensure capture of procedures conducted in inpatient settings. As a result, individuals with a KSA tier of 1, 2, or 3 were classified by the algorithm as complicated injury if not already identified as such based on complications (Figure).

All encounter data in the M2 and the TMDS that included diagnoses of ocular injuries or complications for active duty members were collected from 2016 through 2020. Data were line-based, and each line represented 1 visit (direct care) or 1 claim (purchased care). Data from different care locations were consolidated into 1 comprehensive dataset to accommodate all variables and visit dates were used to assess temporality of encounters. The algorithm was then applied to identify the presence of the pre-specified injuries, complications, and medical procedures for each individual during the 12 months following the initial injury date. Those injured individuals without complications and no medical procedures corresponding to KSA tier 1 through 3 were classified as having suffered an uncomplicated injury; otherwise, individuals were classified as having a complicated injury. For those individuals with uncomplicated injury, if 60 days passed after the date of the injury without a subsequent health care encounter for an uncomplicated ocular injury, then an encounter for an uncomplicated injury after the 60-day period would be counted as a newly incident uncomplicated injury. For complicated injuries, the severity level was further categorized as low, moderate, or high based on the highest rank of presented complications (Table 2) or prescribed medical procedures (Table 3). Of note, complicated injuries were not subject to an incidence rule like that for uncomplicated injuries; an individual was assumed to sustain only 1 complicated injury during the study period. Complicated injuries with complications only, medical procedures only, or both were counted. For complications, the number of different complication types for each individual was determined; for individuals with more than 1 type of complication, all complications were included (Figure). Based on the incidence rule, individuals may suffer from multiple uncomplicated injuries but only one complicated injury was counted per individual during the study period. Data analysis and case classification were conducted using R, version 4.0.3 (2020, R Core Team).

The results of the classification by the algorithm were verified by the VCE team of medical auditors using clinical data. Study auditors had clinical backgrounds in eye care and were trained on ocular care medical record abstraction and classification of ocular injuries using DVEIVR business rules for data abstraction. Cohen's kappa was used to measure agreement between the outcomes of the VCE algorithmic classification and record review. A total of 1,000 individuals (500 complicated and 500 uncomplicated) with relevant encounter data from 2018 were randomly selected for medical record validation. These data were used to develop and troubleshoot the algorithm. For example, ICD-10 codes S05.70X*, S05.71X, and S05.72X were added to the complication list after this condition (avulsion of eye) was found documented in the medical record following initial injury documentation. The VCE is currently evaluating outcome data of available cases for complicated injury using information in the DVEIVR to further explore the utility of injury severity stratification.

Results

From 2016 through 2019, 12,664 complicated and 49,016 uncomplicated injuries were identified among 59,653 active duty service members using the classification algorithm (Figure). Of the individuals with complicated injuries, 6,119 had complications only, 5,554 had medical procedures only, and 991 had documentation of both complications and medical procedures. Individuals with complicated injuries were further classified as having injuries of low severity (n=1,864), moderate severity (n=8,785), and high severity (n=2,015). A total of 2,834 individuals with uncomplicated injuries had multiple occurrences of such injuries.

Approximately half (52%) of complications were concurrent (diagnosed on the same day as the ocular injury) or immediately following the initial injuries. Eighty five percent and 91% of complications occurred within 30 and 90 days of the documentation of the initial injury, respectively. Of the individuals (n=7,089) with complicated injuries, 1,184 had more than one complication.

Among the types of complications (n=12,365), the top 3 complications included orbital floor fracture (20%), iridocyclitis (19%), and recurrent corneal erosion (13%). The top 10 complications accounted for 85% of total complications (Table 4).

Of the 1,000 individuals selected for verification of the algorithm, 844 records were available for chart review using the Armed Forces Health Longitudinal Technology Application (AHLTA) or the Joint Legacy Viewer. Of the 445 cases classified as complicated by the algorithm, 443 (99.6%) were found to be correctly categorized based on medical record review. Of the 399 cases classified as uncomplicated by the algorithm, 392 (98.2%) were found to be correctly categorized based on record review. Agreement of classifications between the algorithm and chart review was high (kappa=0.96).

Editorial Comment

Through the application of the described algorithm which assesses multiple diagnoses and/or prescribed surgical procedures, ocular injuries were categorized and stratified into groups that more accurately reflect the complexity and severity of these injuries to improve classification of ocular injury. The resulting categorizations were verified using an audit of clinical data with a high degree of agreement. The clinical reality of the complex nature of ocular injuries is especially difficult to capture by conventional surveillance which relies on a single diagnostic code in administrative records. Categorizing using a single code may produce inaccurate data that are difficult to interpret from a public health, clinical, or operational perspective. The implications for accurate case definitions by systematical evaluation of associated complications and procedures for surveillance and research are significant.

Furthermore, the results of this analysis show that 85% of complicated injuries had the first documented complication within the first 30 days of the initial injury. This approach can be adapted to surveillance systems which require update at an interval less than 12 months; for example, a quarterly update can capture and categorize the vast majority (90%) of cases. The potential miscategorization due to limited length-of-care episodes is likely minimal due to the frequency of concurrent complications and procedures. Annual analysis would enable further evaluation of all associated complications and procedures, allowing for refinement of public health interventions targeting primary prevention, detailed outcome analysis to inform tertiary prevention efforts, and quantitation of health care burden. In addition, identification of cases for review in conjunction with detailed clinical information available in the DVEIVR could identify best practices in clinical treatment of military ocular injuries.

An ocular injury frequently involves multiple anatomic structures with multiple complications. For example, contusion might be associated with hyphema (an accumulation of blood in the anterior chamber of the eye), vitreous hemorrhage, orbital floor fracture, traumatic cataract, and optic nerve injury which cannot be captured by conventional surveillance methods relying on first-recorded ICD code. Data from the application of the algorithm showed that 15.6% of complicated injuries had multiple complications (ranging from 2 to 6 unique complications).

There are limitations to this approach. It is known that EHR data are mainly for administrative uses and have no guarantee for accuracy of coded diagnoses for surveillance and research.7,8 The limitations of administrative/claims data for secondary use have been described previously, specifically in regards to ophthalmic care. For example, it has been noted that patients may be misclassified due to misdiagnosis, miscoding, as well as coding practices of multiple providers with varying coding experience.9 Furthermore ocular injuries can be complex and involve multiple anatomic regions which cannot be appropriately captured by the conventional surveillance approaches. It is necessary to utilize multiple medical data points, e.g., diagnoses, prescribed procedures and medications, to increase accuracy of case identification based on electronic health record.10

In addition, ocular burns and corrosion were not included in this analysis; these injuries will need to be explored separately with modifications to the case definition with special consideration given to expected complications more likely in these injuries (for example, ocular surface complications such as dry eye syndrome or exposure keratopathy, and lid complications such as entropion or ectropion).

It was assumed that the new case definition captured all ocular injuries without considering the possibility of missing true cases of ocular injury in M2. It is, however, extremely unlikely that there were ocular injuries which leave no trace of clinical information to be captured by this case definition. This study did not select samples of uncaptured cases as negative controls for validation because it would have needed a large sample to identify false negatives given the extremely rare likelihood. Therefore, no estimation was made of sensitivity, specificity, positive predictive value, and negative predictive value for the case definition.

The main purpose of injury surveillance efforts is to inform the development, prioritization, and execution of injury prevention initiatives. The results of this study demonstrated that categorization of ocular injuries could be obtained by evaluation of episodes of care recorded in administrative records for the secondary uses of surveillance and research. The longitudinal approach ensures more reliable characterization of injuries which offers several advantages: 1) it removes reliance on single ICD-10 codes for categorization of ocular injuries, 2) it increases the sensitivity and specificity of the case definition of ocular injury, 3) it provides a measure of severity of ocular injuries, and 4) it provides increased granularity of data for ocular injuries categorized as complicated, with capture of multiple associated complications and procedures. The resultant outcome provides a rich, clinically-relevant dataset for outcome and health system analysis.

Author affiliations: Department of Defense/Veterans Affairs Vision Center of Excellence, Defense Health Agency Research and Development Directorate (COL Reynolds, Dr. Gu).

Disclaimer: The contents, views, or opinions expressed in this publication are those of the author(s) and do not necessarily reflect the official policy or position of the Defense Health Agency, Department of Defense, or the U.S. Government.

Disclosure: Utilization of data and development of the case definition methodology was completed under the DHA Office of Research Protection #935913.

References

1. Frick KD, Singman EL. Cost of military eye injury and vision impairment related to traumatic brain injury: 2001-2017. Mil Med. 2019;184(5–6):e338–e343.

2. Colyer MH, Mazzoli RA. Complex ocular trauma outcomes and system capabilities: lessons from a combat zone and implications for national eye trauma care. Eye (Lond). 2021;35(8):2069-2070.

3. Gonnering RS. Is oculofacial surgery complex or merely complicated? Curr Opin Ophthalmol. 2018;29(5):434–439.

4. Harvey MM, Justin GA, Brooks DI, Ryan DS, Weichel ED, Colyer MH. Ocular trauma in Operation Iraqi Freedom and Operation Enduring Freedom from 2001 to 2011: A Bayesian network analysis. Ophthalmic Epidemiol. 2021;28(4):312–321.

5. Hilber DJ. Eye injuries, active component, U.S. Armed Forces, 2000–2010. MSMR. 2011;18(5):2–7.

6. National Defense Authorization Act for Fiscal Year 2008, Public Law 110–181, section 1623. 2008.

7. Horsky J, Drucker EA, Ramelson HZ. Accuracy and completeness of clinical coding using ICD-10 for ambulatory visits. AMIA Annu Symp Proc. 2017;2017:912–920.

8. Nicholson A, Tate AR, Koeling R, Cassell JA. What does validation of cases in electronic record databases mean? The potential contribution of free text. Pharmacoepidemiol Drug Saf. 2011;20(3):321–324.

9. Stein JD, Lum F, Lee PP, Rich WL, 3rd, Coleman AL. Use of health care claims data to study patients with ophthalmologic conditions. Ophthalmology. 2014;121(5):1134-1141.

10. Herrett E, Thomas SL, Schoonen WM, Smeeth L, Hall AJ. Validation and validity of diagnoses in the General Practice Research Database: A systematic review. Br J Clin Pharmacol. 2010;69(1):4–14.

FIGURE. Vision Center of Excellence algorithm for classifying ocular injuries

TABLE 1. ICD-10 diagnosis codes for ocular injuries

TABLE 2. ICD-10 diagnosis codes for occular injury complications

TABLE 3. CPT and PCS codes used to classify ocular injury severity

TABLE 3 (cont). CPT and PCS codes used to classify ocular injury severity

TABLE 4. Counts of the 10 most commonly documented complications of ocular injuries (n=12,365)

You also may be interested in...

Brief Report: Relationships between Self-reported Psychological Conditions and Aggressive Behaviors Among Crew Members of a U.S. Navy Aircraft Carrier, January 2021

Article
9/1/2021
A U.S. Marine Corps drill instructor with Golf Company, 2nd Recruit Training Battalion, motivates a recruit during a Marine Corps Martial Arts Program (MCMAP) training session at Marine Corps Recruit Depot, San Diego, Aug. 2, 2021.

Recommended Content:

Medical Surveillance Monthly Report

Surveillance Snapshot: A Simple Model Estimating the Impact of COVID-19 on Lost Duty Days Among U.S. Service Members

Article
9/1/2021
U.S. Navy Hospital Corpsman 2nd Class Julian Gordon administers a COVID-19 test to a U.S. Marine

Recommended Content:

Medical Surveillance Monthly Report

Cross-Sectional Analysis of the Association between Perceived Barriers to Behavioral Health Care and Intentions to Leave the U.S. Army

Article
9/1/2021
U.S. Army Central Reserve component Soldiers swear the oath of enlistment during a mass reenlistment ceremony in celebration of the U.S. Army Reserve 113th birthday at Camp Arifjan, Kuwait, April 23, 2021.

Recommended Content:

Medical Surveillance Monthly Report

Surveillance of Mental and Behavioral Health Care Utilization and Use of Telehealth, Active Component, U.S. Armed Forces, 1 January 2019–30 September 2020

Article
8/1/2021
U.S. Air Force Lt. Col. Eric Oglesbee, the PACAF Pediatric Psychological Developmental Team child psychologist with the 18th Healthcare Operations Squadron, demonstrates how a telehealth appointment would operate at Kadena Air Base, Japan, April 19, 2021. Providing pediatric mental health support to five overseas Air Force bases, P3DT uses both virtual and in-person. (U.S. Air Force photo by Airman 1st Class Anna Nolte)

Recommended Content:

Medical Surveillance Monthly Report

Brief Report: Prevalence of Screening Positive for Post-Traumatic Stress Disorder Among Service Members Following Combat-Related Injury

Article
8/1/2021
Two army men standing next to a military vehicle

Recommended Content:

Medical Surveillance Monthly Report

Mental Health Disorders, Behavioral Health Problems, Fatigue and Sleep Outcomes in Remotely Piloted Aircraft/Manned Aircraft Pilots, and Remotely Piloted Aircraft Crew, U.S. Air Force, 1 October 2003–30 June 2019

Article
8/1/2021
U.S. Air Force Capt. Danielle ‘Dani’ Pavone, an MQ-9 pilot with the 110th Wing, speaks during a training scenario through a plexiglass barrier to Staff Sgt. Justin Brandt, an MQ-9 sensor operator at the Battle Creek Air National Guard Base, Battle Creek, Michigan. The plexiglass mitigates risk of coronavirus transmission during the pandemic. (U.S. Air National Guard photo by Staff Sgt. Bethany Rizor)

Recommended Content:

Medical Surveillance Monthly Report

Update: Mental Health Disorders and Mental Health Problems, Active Component, U.S. Armed Forces, 2016–2020

Article
8/1/2021
 Capt. Elrico Hernandez, battalion physician assistant for 2nd Battalion, 3rd Infantry Regiment, 3rd Stryker Brigade Combat Team, 2nd Infantry Division, discusses a training scenario that is part of the first Primary Care Behavioral Health seminar.

Update: Mental Health Disorders and Mental Health Problems, Active Component, U.S. Armed Forces, 2016–2020

Recommended Content:

Medical Surveillance Monthly Report

Oral Cavity and Pharynx Cancers, Active Component, U.S. Armed Forces, 2007–2019

Article
7/1/2021
Two hands holding chewing tobacco

Oral Cavity and Pharynx Cancers, Active Component, U.S. Armed Forces, 2007–2019

Recommended Content:

Medical Surveillance Monthly Report

Long-Acting Reversible Contraceptive Use, Active Component Service Women, U.S. Armed Forces, 2016–2020

Article
7/1/2021
Hands holding an intrauterine device

Long-Acting Reversible Contraceptive Use, Active Component Service Women, U.S. Armed Forces, 2016–2020

Recommended Content:

Medical Surveillance Monthly Report

The Evolution of Military Health Surveillance Reporting: A Historical Review

Article
7/1/2021
Screenshot of the inaugural issue of the Medical Surveillance Monthly Report

The Evolution of Military Health Surveillance Reporting: A Historical Review

Recommended Content:

Medical Surveillance Monthly Report

Department of Defense Mid-Season Vaccine Effectiveness Estimates for the 2019– 2020 Influenza Season

Article
6/1/2021
201019-N-PC065-1062 NORFOLK (Oct. 19, 2020) Hospital Corpsman 2nd Class Sashee Robinson, assigned to amphibious transport dock ship USS Arlington (LPD 24), administers an influenza vaccine to Machinery Repairman 2nd Class Hannah Swearingen in medical aboard the Arlington. Influenza vaccines are an annual medical readiness requirement throughout the Department of Defense. (U.S. Navy photo by Mass Communication Specialist 2nd Class John Bellino/Released)

Department of Defense Mid-Season Vaccine Effectiveness Estimates for the 2019– 2020 Influenza Season

Recommended Content:

Medical Surveillance Monthly Report

The Cost of Lower Extremity Fractures Among Active Duty U.S. Army Soldiers, 2017

Article
6/1/2021
X-ray image of a fractured tibia.

Recommended Content:

Medical Surveillance Monthly Report

Early Identification of SARS-CoV-2 Emergence in the Department of Defense via Retrospective Analysis of 2019–2020 Upper Respiratory Illness Samples

Article
6/1/2021
Army Maj. Raymond Nagley, S-3 officer assigned to the 50th Regional Support Group (RSG), receives a nasal swab to screen for COVID-19 at Fort Hood, Texas, on Feb. 5, 2021, from Spc. Yoali Muniz, a lab tech assigned to the 7406th Troop Medical Clinic, based in Columbia, Missouri. The 50th RSG, a Florida Guard unit based in Homestead, Florida, is preparing for deployment to Poland. (U.S. Army Guard photo by Sgt. 1st Class Shane Klestinski)

Early Identification of SARS-CoV-2 Emergence in the Department of Defense via Retrospective Analysis of 2019–2020 Upper Respiratory Illness Samples

Recommended Content:

Medical Surveillance Monthly Report

Brief Report: Medical Encounters for Snakebite Envenomation, Active and Reserve Components, U.S. Armed Forces, 2016–2020

Article
6/1/2021
Masters of camouflage, the Sidewinder Rattlesnakes are out and about aboard Marine Corps Logistics Base Barstow, California, May 11. Watch where you put your hands and feet, and observe children and pets at all times, as this is the natural habitat for these venomous snakes and a bite can cause serious medical problems. Notice the sharp arrow-shaped head with pronounced jaws, and the raised eye sockets, as well as the telltale rattles. Keep in mind, however, that rattles can be broken or lost, so you may or may not hear a rattle before they strike to protect themselves.

Brief Report: Medical Encounters for Snakebite Envenomation, Active and Reserve Components, U.S. Armed Forces, 2016–2020

Recommended Content:

Medical Surveillance Monthly Report

Morbidity Burdens Attributable to Various Illnesses and Injuries, Deployed Active and Reserve Component Service Members, U.S. Armed Forces, 2020

Article
5/1/2021
Navy Lt. James E. Lamb, left, and Sgt. Ryan Eskandary exercise aboard USS Pearl Harbor

Morbidity Burdens Attributable to Various Illnesses and Injuries, Deployed Active and Reserve Component Service Members, U.S. Armed Forces, 2020

Recommended Content:

Medical Surveillance Monthly Report
<< < 1 2 3 4 5  ... > >> 
Showing results 31 - 45 Page 3 of 12
Refine your search
Last Updated: May 10, 2022

DHA Address: 7700 Arlington Boulevard | Suite 5101 | Falls Church, VA | 22042-5101

Some documents are presented in Portable Document Format (PDF). A PDF reader is required for viewing. Download a PDF Reader or learn more about PDFs.