Google - We Have Ways Of Making You Smile
Written by David Conrad   
Thursday, 18 April 2013

It might even be that Google Research has found a way to stop you from looking silly in group photos. We all know that taking a group photo is hard. Just try to keep everyone's attention while you compose the shot! And you can be sure that in any group photo at least one person has their eyes shut at the moment you hit the button.

The solution to the problem is computational photography. Take more than one group picture and use the set to create one good photo. Sounds easy but getting it right needs a lot of attention to detail. This is what Rajvi Shah and Vivek Kwatra at Google Research have been working on. 

 

smile4

 

Given a set of group pictures the first task is to score each one by applying face detection and then working out a score based on how many of the faces are oriented correctly, smiling and have their eyes open. Using this, the images can be ranked and the best, but possibly still flawed, group picture can be selected. 

The next stage goes back to the set of rejected pictures and attempts to find any faces that have high scores that could be used to replace faces that have low score in the best photo. 

The real difficulties here are in selecting faces that are actually better then the original and a lot of work has been put into selection criteria. Learning algorithms were used to tell the difference between smiling and non-smiling and eyes open and close faces. 

What can one say about the results?

As the authors of the paper say:

We have demonstrated the effectiveness of our approach through a variety of examples that bring a smile on people’s faces.

When you look at the before and after photos there is a slight spookiness in imagining a world where everyone smiles all of the time and perhaps the loss of the amusing and memorable group photo might be something to mourn but... do you want to be the one with your eyes closed or looking like a wet weekend?

 

smile1

 

smile2

 

The final comment gives you an indication of where things might be going:

In future, we would like to optimize our implementation for real-time performance, making it an attractive utility for computational cameras. We would also like to learn and incorporate more subtle facial attributes for goodness evaluation.

 

smile3

Banner


EF7 Drops XML Modeling Favors Code First
27/10/2014

Microsoft is dropping some ways of modeling data in the next version of Entity Framework (EF) to make the database tool more lightweight.



Fear And Loathing In the App Store 8 - Apple Takes Down Innovative App
08/10/2014

Programming into the unknown - it is what keeps us all going. The idea that with nothing but some code we can do something that hasn't been done before. In the old days what you did was between you an [ ... ]


More News

Last Updated ( Thursday, 18 April 2013 )
 
 

   
RSS feed of news items only
I Programmer News
Copyright © 2014 i-programmer.info. All Rights Reserved.
Joomla! is Free Software released under the GNU/GPL License.