NVIDIA, Aalto University and MIT developed an Artificial Intelligence model to fix grainy photos! By using 50,000 images as their training data and using the model to identify of noise and grains, the AI can effectively optimize and improve the quality of grainy photos!
This solution can be applied to real-world situations where obtaining clear images is difficult. E.g. low-light photography and magnetic resonance imaging.
The team will present their work in an oral presentation with a poster at the ICML conference. You can meet the team on Thursday, July 12 at the Supervised Learning oral session (2:20 pm) and poster session is at 6:15 pm.
AI Can Now Fix Your Grainy Photos by Only Looking at Grainy Photos
SINGAPORE — July 10, 2018 — What if you could take your photos that were originally taken in low light and automatically remove the noise and artifacts? Have grainy or pixelated images in your photo library and want to fix them? This deep learning-based approach has learned to fix photos by simply looking at examples of corrupted photos only.
The work was developed by researchers from NVIDIA, Aalto University and MIT, and is being presented at the International Conference on Machine Learning in Stockholm, Sweden this week.
Recent deep learning work in the field has focused on training a neural network to restore images by showing example pairs of noisy and clean images. The AI then learns how to make up the difference. This method differs because it only requires two input images with the noise or grain.
Without ever being shown what a noise-free image looks like, this AI can remove artifacts, noise, grain, and automatically enhance your photos.
“It is possible to learn to restore signals without ever observing clean ones, at performance sometimes exceeding training using clean exemplars,” the researchers stated in their paper.“[The neural network] is on par with state-of-the-art methods that make use of clean examples — using precisely the same training methodology, and often without appreciable drawbacks in training time or performance.”
Using NVIDIA Tesla P100 GPUs with the cuDNN-accelerated TensorFlow deep learning framework, the team trained their system on 50,000 images in the ImageNet validation set.
To test the system, the team validated the neural network on three different datasets.
The method can even be used to enhance MRI images, perhaps paving the way to drastically improve medical imaging.
“There are several real-world situations where obtaining clean training data is difficult: low-light photography (eg astronomical imaging), physically-based rendering, and magnetic resonance imaging,” the team said. “Our proof-of-concept demonstrations point the way to significant potential benefits in these applications by removing the need for potentially strenuous collection of clean data. Of course, there is no free lunch – we cannot learn to pick up features that are not there in the input data – but this applies equally to training with clean targets.”
The team will present their work in an oral presentation and a poster at the ICML conference. You can meet the team on Thursday, July 12 at the Supervised Learning oral session (2:20 pm) and 6:15 pm poster session.
About NVIDIA
NVIDIA‘s (NASDAQ: NVDA) invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined modern computer graphics and revolutionised parallel computing. More recently, GPU deep learning ignited modern AI — the next era of computing — with the GPU acting as the brain of computers, robots and self-driving cars that can perceive and understand the world. More information at http://nvidianews.nvidia.com/.
