Army Develops Face Recognition Technology That Works in the Dark

Thermal to Visible Synthesis of Face Images using Multiple Regions

A conceptual illustration for thermal-to-visible synthesis for interoperability with existing visible-based facial recognition systems (credit: William Parks and Benjamin S. Riggan).

November 5, 2018 | Source: U.S. Army, arl.army.mil, ARL Public Affairs, 16 Apr 2018,

Army researchers have developed an artificial intelligence and machine learning technique that produces a visible face image from a thermal image of a person's face captured in low-light or nighttime conditions. This development could lead to enhanced real-time biometrics and post-mission forensic analysis for covert nighttime operations.

Thermal cameras like FLIR, or Forward Looking Infrared, are actively deployed on aerial and ground vehicles, in watch towers and at check points for surveillance purposes. More recently, thermal cameras are becoming available for use as body-worn cameras. The ability to perform automatic face recognition at nighttime using such thermal cameras is beneficial for informing a Soldier that an individual is someone of interest, like someone who may be on a watch list.

The motivations for this technology - developed by Drs. Benjamin S. Riggan, Nathaniel J. Short and Shuowen "Sean" Hu, from the U.S. Army Research Laboratory - are to enhance both automatic and human-matching capabilities.

"This technology enables matching between thermal face images and existing biometric face databases/watch lists that only contain visible face imagery," said Riggan, a research scientist. "The technology provides a way for humans to visually compare visible and thermal facial imagery through thermal-to-visible face synthesis."