- Rihanna defends Vogue writer who received backlash for ‘winging’ interview 1 Year Ago
- Here are the best PC games to add to your list 1 Year Ago
- How to stream ‘Power’ season 6, episode 8 Today 6:00 AM
- How to stream Steelers vs. Chargers on Sunday Night Football Saturday 7:20 PM
- Popular TikTok teens accused of pretending to be gay for clout Saturday 6:38 PM
- Scott Walker’s ‘$26 haircut’ dig at Alexandria Ocasio-Cortez backfires Saturday 4:46 PM
- Halle synagogue shooter allegedly posted manifesto on anime message board Saturday 4:06 PM
- How to stream Cowboys vs. Jets in NFL Week 6 Saturday 3:25 PM
- How to stream Rams vs. 49ers in NFL Week 6 action Saturday 3:05 PM
- Kamala Harris’ ‘lover’ says Jacob Wohl hired him off Craigslist Saturday 2:03 PM
- Korean hair salon dragged for turning straight hair into Afro-textured hair Saturday 1:00 PM
- How to stream Chiefs vs. Texans in NFL Week 6 Saturday 12:00 PM
- How to stream Seahawks vs. Browns in Week 6 NFL action Saturday 12:00 PM
- How to stream Eagles vs. Vikings in Week 6 Saturday 12:00 PM
- How to stream Saints vs. Jaguars in Week 6 Saturday 12:00 PM
The burst shot has become a mainstay of smartphone photography. When you’re trying to capture someone playing a sport, pets playing, or a portrait of a family with kids, burst mode can be a lifesaver. It’s unfortunate, though, that so many burst shots end up being blurry and unusable. Luckily, a pair of researchers at MIT are working on a way to fix that problem.
In the paper “Burst Image Deblurring Using Permutation Invariant Convolutional Neural Networks,” published at ECCV 2018, Miika Aittila and Frédo Durand describe a way to reduce the blur in a burst shot using a neural network.
“Motion blur and noise remain a significant problem in photography despite advances in light efficiency of digital imaging devices,” the research paper explains. “Mobile phone cameras are particularly suspect to handshake and noise due to the small optics and the typical unsupported free-hand shooting position.”
This is particularly problematic when trying to capture the action, like with a burst shot. To fix this, the team decided to treat a series of burst mode images differently. Normally, the first and last shot play a disproportionately important role in selecting the most important image of the set (and cleaning up those images). Instead, their method treats the burst images as an unordered set, treating each shot with equal importance. They then use a neural network to clean up the images.
#ECCV2018 Oral: Burst Image Deblurring Using Permutation Invariant Convolutional Neural Networks. By using max pooling across frames at every layer, the network is invariant to permutations. Thus it achieves better results than state of art. https://t.co/RrexRkk4oQ pic.twitter.com/lCn4pwn8rX— Wenzhe Shi 🐕🐈🐎 (@trustswz) September 11, 2018
They trained this network with a wide variety of synthetic data of common imaging defects such as noise and camera shake. Once treated with this algorithm, a blurry burst shot is transformed into “a sharp and noise-free image,” according to the paper. The method can even extract “accurate detail that is not discernible from any of the individual frames in isolation”—so even if every single photo in the burst sequence were blurry, it would be able to accurately sharpen it to the image it should have captured.
Aittila and Durand’s findings could help influence how our phones handle blurry photos and burst shots in the future, making it increasingly difficult for even the worst photographers to take a bad photo.
Christina Bonnington is a tech reporter who specializes in consumer gadgets, apps, and the trends shaping the technology industry. Her work has also appeared in Gizmodo, Wired, Refinery29, Slate, Bicycling, and Outside Magazine. She is based in the San Francisco Bay Area and has a background in electrical engineering.