Article Lead Image

We put Microsoft’s emotion-guessing photo tool to the test, and so can you

Poker face, no more.

 

Jam Kotenko

Tech

Posted on Nov 11, 2015   Updated on May 27, 2021, 4:14 pm CDT

Trying to tell how a person feels by simply looking at their face can be hit-or-miss, but now an artificial intelligence project claims to be able to do just that.

The team behind Microsoft’s Project Oxford—an initiative that aims to arm developers with easy-to-use machine learning tools that’ll enable their app projects to identify words, sounds, and images—recently announced its plans to make beta versions of their entire portfolio available to the public, including a tool that can recognize emotions from photographs.

The emotion tool can be used to create an app or a project that has the ability to “recognize eight core emotional states—anger, contempt, fear, disgust, happiness, neutral, sadness or surprise—based on universal facial expressions that reflect those feelings.”

For us everyday, non-developer folk, it can be used to evaluate the selfies you and your friends have shared online. While Project Oxford made sure to clarify that “recognition is experimental, and not always accurate,” we find the tool’s results rather enlightening and useful for much needed self-reflection.

Here’s what happened when the Daily Dot’s tech team ran their photos through the tool’s demo portal:

"Microsoft is way off here. This is the face I make after I've eaten overpriced, cold calamari. The disappointment was real."

“Microsoft is way off here. This is the face I make after I’ve eaten overpriced, cold calamari. The disappointment was real.”

Mike Wehner, Tech Editor

"I'm surprised 'fear' didn't register higher in this photo, because just seconds earlier I realized I had once again forgotten to take a photo for the masthead."

“I’m surprised ‘fear’ didn’t register higher in this photo, because just seconds earlier I realized I had once again forgotten to take a photo for the masthead.”

Mike Wehner, Tech Editor


"Dammit, Mike out-neutraled me."

“Dammit, Mike out-neutraled me.”

AJ Dellinger, Staff Writer

"This sounds about right for me. I’m just a layer of skin and then all feelings underneath."

“This sounds about right for me. I’m just a layer of skin and then all feelings underneath.”

AJ Dellinger, Staff Writer

"Selena, it's probably because your selfies are all taken at a tilted angle." "No, it's because I have 0 feelings."

“Selena, it’s probably because your selfies are all taken at a tilted angle.” “No, it’s because I have 0 feelings.”

Selena Larson, Staff Writer

"It should’ve detected way more disgust because I took that selfie in the rain."

“It should’ve detected way more disgust because I took that selfie in the rain.”

Selena Larson, Staff Writer

"There's nothing neutral about desperately needing to poop and not having a restroom nearby."

“There’s nothing neutral about desperately needing to poop and not having a restroom nearby.”

Jam Kotenko, Contributor

"Wrong, Microsoft. This is my 'Five vodka Sprites is enough, thank you' face."

“Wrong, Microsoft. This is my ‘Five vodka Sprites is enough, thank you’ face.”

Jam Kotenko, Contributor

You can run your own photos through the emotion tool demo beginning today. Make sure your images are in JPEG, PNG, GIF (first frame), or BMP formats, are more than 36 x 36 pixels and are less than 4MB. Beta versions of other tools will be made available by the end of the year for a limited free trial.

H/T Microsoft Blog / Photos via The Daily Dot 

Share this article
*First Published: Nov 11, 2015, 7:17 pm CST