Google - We Have Ways Of Making You Smile
Written by David Conrad   
Thursday, 18 April 2013

It might even be that Google Research has found a way to stop you from looking silly in group photos. We all know that taking a group photo is hard. Just try to keep everyone's attention while you compose the shot! And you can be sure that in any group photo at least one person has their eyes shut at the moment you hit the button.

The solution to the problem is computational photography. Take more than one group picture and use the set to create one good photo. Sounds easy but getting it right needs a lot of attention to detail. This is what Rajvi Shah and Vivek Kwatra at Google Research have been working on. 

 

smile4

 

Given a set of group pictures the first task is to score each one by applying face detection and then working out a score based on how many of the faces are oriented correctly, smiling and have their eyes open. Using this, the images can be ranked and the best, but possibly still flawed, group picture can be selected. 

The next stage goes back to the set of rejected pictures and attempts to find any faces that have high scores that could be used to replace faces that have low score in the best photo. 

The real difficulties here are in selecting faces that are actually better then the original and a lot of work has been put into selection criteria. Learning algorithms were used to tell the difference between smiling and non-smiling and eyes open and close faces. 

What can one say about the results?

As the authors of the paper say:

We have demonstrated the effectiveness of our approach through a variety of examples that bring a smile on people’s faces.

When you look at the before and after photos there is a slight spookiness in imagining a world where everyone smiles all of the time and perhaps the loss of the amusing and memorable group photo might be something to mourn but... do you want to be the one with your eyes closed or looking like a wet weekend?

 

smile1

 

smile2

 

The final comment gives you an indication of where things might be going:

In future, we would like to optimize our implementation for real-time performance, making it an attractive utility for computational cameras. We would also like to learn and incorporate more subtle facial attributes for goodness evaluation.

 

smile3

 

More Information

All Smiles : Automatic Photo Enhancement by Facial Expression Analysis

 

Related Articles

New Algorithm Takes Spoilers Out of Pics

Super Seeing Software Ready To Download

Super Seeing - Eulerian Magnification

Blink If You Don't Want To Miss it

Halide - New Language For Image Processing

 

To be informed about new articles on I Programmer, install the I Programmer Toolbar, subscribe to the RSS feed, follow us on, Twitter, FacebookGoogle+ or Linkedin,  or sign up for our weekly newsletter.

 

blog comments powered by Disqus

 

Banner


Free Windows On Devices Development System
09/07/2014

One of Microsoft's new moves to make inroads into territories it previously missed out on is Windows On Devices. Now you can sign up and possible get a free Galileo development board.



Self Assessment For Programmers
21/07/2014

A useful proficiency matrix has been produced that could be used to track your own progress when learning to program or to advertise your skillset to prospective employers.


More News

Last Updated ( Thursday, 18 April 2013 )
 
 

   
RSS feed of news items only
I Programmer News
Copyright © 2014 i-programmer.info. All Rights Reserved.
Joomla! is Free Software released under the GNU/GPL License.