- Here’s why you shouldn’t buy a Nintendo Switch until mid-August Monday 5:11 PM
- Man blasted for making his coworkers babysit his child Monday 5:07 PM
- Pete Buttigieg’s country radio interview was blocked from the air Monday 4:35 PM
- 15-year-old Smash Bros. prodigy caught using racist slur in private Discord server Monday 3:47 PM
- Instagram users who post pet pictures more likely to get hacked Monday 3:45 PM
- Post-Prime Day recap: Shipping delays, more sales, and a scam Monday 3:08 PM
- Jacob Wohl returns to Twitter … for now Monday 1:56 PM
- How to stream WWE Raw Reunion Monday 1:35 PM
- ‘I hope Trump deports you’: Woman goes on racist rant to Spanish speakers at a store Monday 1:24 PM
- Emoji Mashup Bot gives life to unidentifiable emotions Monday 1:15 PM
- Notorious grifter Anna Sorokin reportedly blocked from profiting off Netflix series Monday 12:45 PM
- Charlottesville attacker’s Twitter account included praise for Hitler Monday 12:10 PM
- ‘Short Treks’ trailer: Spock, Pike, and Number One return Monday 11:57 AM
- Everything we know about ‘Star Trek: Lower Decks,’ the new animated show Monday 11:55 AM
- Cole Carrigan says he left Team 10 after being called homophobic slur Monday 11:32 AM
Blurry photos may soon be a thing of the past.
The burst shot has become a mainstay of smartphone photography. When you’re trying to capture someone playing a sport, pets playing, or a portrait of a family with kids, burst mode can be a lifesaver. It’s unfortunate, though, that so many burst shots end up being blurry and unusable. Luckily, a pair of researchers at MIT are working on a way to fix that problem.
In the paper “Burst Image Deblurring Using Permutation Invariant Convolutional Neural Networks,” published at ECCV 2018, Miika Aittila and Frédo Durand describe a way to reduce the blur in a burst shot using a neural network.
“Motion blur and noise remain a significant problem in photography despite advances in light efficiency of digital imaging devices,” the research paper explains. “Mobile phone cameras are particularly suspect to handshake and noise due to the small optics and the typical unsupported free-hand shooting position.”
This is particularly problematic when trying to capture the action, like with a burst shot. To fix this, the team decided to treat a series of burst mode images differently. Normally, the first and last shot play a disproportionately important role in selecting the most important image of the set (and cleaning up those images). Instead, their method treats the burst images as an unordered set, treating each shot with equal importance. They then use a neural network to clean up the images.
#ECCV2018 Oral: Burst Image Deblurring Using Permutation Invariant Convolutional Neural Networks. By using max pooling across frames at every layer, the network is invariant to permutations. Thus it achieves better results than state of art. https://t.co/RrexRkk4oQ pic.twitter.com/lCn4pwn8rX— Wenzhe Shi 🐕🐈🐎 (@trustswz) September 11, 2018
They trained this network with a wide variety of synthetic data of common imaging defects such as noise and camera shake. Once treated with this algorithm, a blurry burst shot is transformed into “a sharp and noise-free image,” according to the paper. The method can even extract “accurate detail that is not discernible from any of the individual frames in isolation”—so even if every single photo in the burst sequence were blurry, it would be able to accurately sharpen it to the image it should have captured.
Aittila and Durand’s findings could help influence how our phones handle blurry photos and burst shots in the future, making it increasingly difficult for even the worst photographers to take a bad photo.
Christina Bonnington is a tech reporter who specializes in consumer gadgets, apps, and the trends shaping the technology industry. Her work has also appeared in Gizmodo, Wired, Refinery29, Slate, Bicycling, and Outside Magazine. She is based in the San Francisco Bay Area and has a background in electrical engineering.