Music video crowd sourced training data
Music video crowd sourced training data
Written by Kay Ewbank   
Saturday, 21 May 2011

What do you get if you put together a team of researchers, a music video from a progressive electro band and tens of thousands of its fans?

If you’re trying to teach a computer how to recognize that an object is a person, you have to overcome the problem that changes in the light level, background clutter or strange clothing will all confuse the situation. This is a tough and time consuming task.

Using a music video might not spring to mind as a way around this problem, but a team of researchers at New York University's Courant Institute of Mathematical Sciences has done just that.

Progressive-electro band C-Mon & Kypski’s music video for the song “More or Less” uses single frames from thousands of fans (over 32000 so far) all imitating the band with a capture from their webcam. The band’s video crowd-sourcing project One Frame of Fame shows fans a single frame from the video, and asks them to imitate the pose, capture it on their webcam and upload it to the site. The contribution is then spliced into the video, and an updated version is shown each hour.

 

cloudfaces

This means the video shows thousands of different people posing in the same way under many different lighting and background conditions, just what the researchers at the Courant Institute were looking for.

Graham Taylor, a post-doctoral fellow at the Courant Institute, explained:

"If we had many examples of people in similar pose, but under differing conditions, we could construct an algorithm that matches based on pose and ignores the distracting information - lighting, clothing, and background."

The researchers realised that the video would be ideal for their needs:

"This turned out to be the perfect data source for developing an algorithm that learns to compute similarity based on pose."

The research team, which includes Courant Professors Chris Bregler and Rob Fergus along with doctoral student Ian Spiro, will present its findings in at the 24th IEEE Conference on Computer Vision and Pattern Recognition (June 21-23) in Colorado Springs. The paper is available here: http://movement.nyu.edu/imitation.

 

Banner


Amazon Glacier Select Analyzes Archived Data
01/12/2017

Amazon has released a tool that can query archived data held in Amazon Glacier, its low cost storage for data archiving. Glacier Select improves the attractiveness of Glacier because it makes the data [ ... ]



Top 10 From Around the Web: More About Rails
12/12/2017

This round up of interesting posts from external sites has hints, tips and recommendations for working with the Rails framework. We've also slipped in one on writing a command-line app in Ruby.


More News

Last Updated ( Saturday, 21 May 2011 )
 
 

   
Banner
RSS feed of news items only
I Programmer News
Copyright © 2017 i-programmer.info. All Rights Reserved.
Joomla! is Free Software released under the GNU/GPL License.