AI Memes Stanford

Researchers made AI memes—and humans couldn’t tell the difference

People thought these AI memes were kind of funny!


Tiffany Kelly

Internet Culture

Published Jun 16, 2018   Updated May 21, 2021, 1:25 pm CDT

We’ve seen AI create paintings and fake celebrity porn. Now researchers at Stanford have trained a neural network to generate memes that are (nearly) indistinguishable from the ones humans create and post on the internet every day.

Featured Video Hide

Abel L. Peirson V and E. Meltem Tolunay, the authors of a paper published on June 8, only used the photo-with-caption style of memes to keep the project simple. They used an Inception-v3 network “to return an image embedding which is passed to an attention-based deep-layer LSTM model producing the caption—inspired by the widely recognized Show and Tell Model.” Show and Tell is a machine learning system that produces captions for photos.

Advertisement Hide

“We evaluate the quality of our model using perplexity and human assessment on both the quality of memes generated and whether they can be differentiated from real ones,” they wrote. “Our model produces original memes that cannot on the whole be differentiated from real ones.”

How do the researchers know that people can’t tell if the memes were generated by a computer or a teen on Reddit? Well, they actually polled real humans:

For our final test we show 20 different memes to 5 people from diverse backgrounds and note if they can differentiate them from real (training set) memes of the same format and random text generated memes. The same people also ranked the memes being shown on how funny they found them on a scale of 0-10.

The real memes scored around a 7.0 on the humor scale, while the AI-created memes weren’t far behind with scores between 5.5 and 6.8 (tough crowd).

Advertisement Hide

Here are some examples of memes generated using their models:

AI Memes Stanford

Whether anyone would share any of these AI memes—or if they would get any traction online—is a whole other topic. But it’s impressive (and a little bit scary) that a neural network can generate a mass quantity of memes and trick people into thinking that they are real. Just last month, another study on memes was released, but it focused on toxic and “weaponized” memes that are used for propaganda. That study looked at how people created and shared memes on four websites. And, not surprisingly, many of the popular memes on two of the sites were racist and political memes.

Advertisement Hide

The paper on the AI-generated memes ended on this grim conclusion: “Lastly we note that there was a bias in the dataset towards expletive, racist and sexist memes, so yet another possibility for future work would be to address this bias.”

Hopefully, people who create memes can work on addressing that issue as well.


Advertisement Hide

H/T: The Next Web

Share this article
*First Published: Jun 16, 2018, 6:30 am CDT