screenshots of deepfake videos

Ghazal Mazaheri & Amit K. Roy-Chowdhury / Computer Vision Foundation

Researchers say new deepfake detection tool is 99% accurate

Researchers say the new method they've developed is highly accurate.

 

Mikael Thalen

Tech

Posted on May 4, 2022   Updated on May 9, 2022, 9:32 am CDT

Computer scientists have developed a new way of detecting deepfake videos that they claim is more accurate than all other methods.

In a paper titled “Detection and Localization of Facial Expression Manipulations,” researchers at the University of California, Riverside outlined how the new technique can not only detect face swaps but media in which only the subject’s facial expressions had been digitally altered.

“Facial manipulations can be created by Identity swap (DeepFake) or Expression swap,” the paper states. “Contrary to the identity swap, which can easily be detected with novel deepfake detection methods, expression swap detection has not yet been addressed extensively.”

While even the best deepfakes can often still be discerned by the naked eye, readily available filters and tools designed simply to add a smile or scowl to an individual’s face can be much more difficult to detect.

The framework, known as Expression Manipulation Detection (EMD), is even designed to identify the specific areas of the face that have been manipulated. Lead researcher Ghazal Mazaheri told UC Riverside News that “facial expression recognition systems” were paramount in aiding the new method in recognizing alterations.

“Multi-task learning can leverage prominent features learned by facial expression recognition systems to benefit the training of conventional manipulation detection systems,” Mazaheri said. “Such an approach achieves impressive performance in facial expression manipulation detection.”

After testing the method against two facial manipulation datasets, researchers concluded that EMD was able to accurately detect manipulated videos 99% of the time.

“Experiments on two challenging datasets demonstrate our method has better classification and segmentation performance in facial expression manipulation detection in comparison to state-of-the-art results,” the paper concludes. “Also, our method is close to the state-of-the-art methods for other kinds of manipulation (identity swap) detection, thus ensuring generalizability.”

While the research undoubtedly signals a step forward in detecting manipulated media, the balance will almost certainly continue to shift back and forth as the arms race between deepfake creators and detectors advances.


Read more of the Daily Dot’s tech and politics coverage

Nevada’s GOP secretary of state candidate follows QAnon, neo-Nazi accounts on Gab, Telegram
Court filing in Bored Apes lawsuit revives claims founders built NFT empire on Nazi ideology
EXCLUSIVE: ‘Say hi to the Donald for us’: Florida police briefed armed right-wing group before they went to Jan. 6 protest
Inside the Proud Boys’ ties to ghost gun sales
‘Judas’: Gab users are furious its founder handed over data to the FBI without a subpoena
EXCLUSIVE: Anti-vax dating site that let people advertise ‘mRNA FREE’ semen left all its user data exposed
Sign up to receive the Daily Dot’s Internet Insider newsletter for urgent news from the frontline of online.
Share this article
*First Published: May 4, 2022, 1:04 pm CDT