Kitware to develop new algorithms to help detect and defeat disinformation from falsified media reports
ARLINGTON, Va. – Intelligence experts at Kitware Inc. in Clifton Park, N.Y., will help U.S. military researchers detect and defeat automated enemy disinformation campaigns launched by manipulating the Internet, news, and entertainment media.
Officials of the U.S. Defense Advanced Research Projects Agency (DARPA) in Arlington, Va., have announced an $11.9 million contract to Kitware for the Semantic Forensics (SemaFor) project.
SemaFor will develop technologies to detect, attribute, and characterize multi-modal falsified media like text, audio, images, and video automatically to defend against large-scale automated disinformation attacks.Kitware joins PAR Government Systems Corp. in Rome, N.Y., which won an $11.9 million SemaFor contract from DARPA last June.
Statistical detection techniques have been successful, yet media generation and manipulation technology is advancing rapidly. Purely statistical detection methods quickly are becoming insufficient for detecting falsified media.
Detection techniques that rely on statistical fingerprints, moreover, often can be fooled with limited additional resources like algorithm development, data, or computers.
Yet existing automated media manipulation and generation algorithms rely heavily on purely data driven approaches and are prone to making semantic errors. Faces generated by the Generative Adversarial Network (GAN), for example, may have semantic inconsistencies such as mismatched earrings, which provide an opportunity for defenders to gain an asymmetric advantage.
A suite of semantic inconsistency detectors would increase the burden on media falsifiers by requiring the creators of falsified media to get every semantic detail correct, while defenders only need to find one, or a very few, inconsistencies.
Related: Electronic warfare technology heading-up the battlefield
SemaFor seeks to develop semantic technologies for analyzing media. Semantic detection algorithms will determine if media is generated or manipulated. Attribution algorithms will infer if media originates from a particular organization or individual. Characterization algorithms will reason about whether media was generated or manipulated for malicious purposes.
The results of detection, attribution, and characterization algorithms can help develop explanations for system decisions, and rank assets for analyst review. These SemaFor technologies will help identify, deter, and understand adversary disinformation campaigns.
On this contract Kitware will do the work in Clifton Park, New York, and Albany, N.Y.; Corvallis, Ore.; Tempe, Ariz.; Urbana, Ill.; and Ann Arbor, Mich., and should be finished by July 2024.
For more information contact Kitware online at www.kitware.com, or DARPA at www.darpa.mil.
John Keller | Editor-in-Chief
John Keller is the Editor-in-Chief, Military & Aerospace Electronics Magazine--provides extensive coverage and analysis of enabling electronics and optoelectronic technologies in military, space and commercial aviation applications. John has been a member of the Military & Aerospace Electronics staff since 1989 and chief editor since 1995.
