- Pete Buttigieg’s denial of fixing bread prices becomes its own meme 1 Year Ago
- Houston Astros get torched with buzzer memes after new revelation Today 10:41 AM
- Teens are eating cereal out of each other’s mouths for clout Today 10:34 AM
- Did Martha McSally plan her ‘liberal hack’ viral moment? Today 10:32 AM
- Trump adds Jeffrey Epstein’s old attorney to impeachment team Today 10:03 AM
- YouTube star Cameron Dallas gets scathing reviews for his Broadway debut Today 9:58 AM
- How to watch ‘Curb Your Enthusiasm’ season 10 Today 9:55 AM
- George Lucas met Baby Yoda, and we can’t handle it Today 8:45 AM
- Apple TV+’s ‘Little America’ shines a light on immigrant stories Today 8:00 AM
- Eminem drops surprise album—and Ariana Grande fans are furious Today 7:53 AM
- The first photos from the Discworld TV series are not what you’d expect Today 7:33 AM
- Vox Day, ‘alt-right’ racist, is absolutely thriving online Today 7:30 AM
- Why women are getting mysterious greeting cards from ‘Jenny B.’ Today 6:22 AM
- Gwyneth Paltrow peddles pseudoscience in ‘Goop Lab’ Netflix series Today 6:18 AM
- ‘Avenue 5’ packs in laughs and unevenness in a shaky launch into space Today 6:00 AM
The burst shot has become a mainstay of smartphone photography. When you’re trying to capture someone playing a sport, pets playing, or a portrait of a family with kids, burst mode can be a lifesaver. It’s unfortunate, though, that so many burst shots end up being blurry and unusable. Luckily, a pair of researchers at MIT are working on a way to fix that problem.
In the paper “Burst Image Deblurring Using Permutation Invariant Convolutional Neural Networks,” published at ECCV 2018, Miika Aittila and Frédo Durand describe a way to reduce the blur in a burst shot using a neural network.
“Motion blur and noise remain a significant problem in photography despite advances in light efficiency of digital imaging devices,” the research paper explains. “Mobile phone cameras are particularly suspect to handshake and noise due to the small optics and the typical unsupported free-hand shooting position.”
This is particularly problematic when trying to capture the action, like with a burst shot. To fix this, the team decided to treat a series of burst mode images differently. Normally, the first and last shot play a disproportionately important role in selecting the most important image of the set (and cleaning up those images). Instead, their method treats the burst images as an unordered set, treating each shot with equal importance. They then use a neural network to clean up the images.
#ECCV2018 Oral: Burst Image Deblurring Using Permutation Invariant Convolutional Neural Networks. By using max pooling across frames at every layer, the network is invariant to permutations. Thus it achieves better results than state of art. https://t.co/RrexRkk4oQ pic.twitter.com/lCn4pwn8rX— Wenzhe Shi 🐕🐈🐎 (@trustswz) September 11, 2018
They trained this network with a wide variety of synthetic data of common imaging defects such as noise and camera shake. Once treated with this algorithm, a blurry burst shot is transformed into “a sharp and noise-free image,” according to the paper. The method can even extract “accurate detail that is not discernible from any of the individual frames in isolation”—so even if every single photo in the burst sequence were blurry, it would be able to accurately sharpen it to the image it should have captured.
Aittila and Durand’s findings could help influence how our phones handle blurry photos and burst shots in the future, making it increasingly difficult for even the worst photographers to take a bad photo.
Christina Bonnington is a tech reporter who specializes in consumer gadgets, apps, and the trends shaping the technology industry. Her work has also appeared in Gizmodo, Wired, Refinery29, Slate, Bicycling, and Outside Magazine. She is based in the San Francisco Bay Area and has a background in electrical engineering.