Open Source Kinect Skeleton Tracking
Written by Mike James   
Sunday, 25 March 2012

If you have been frustrated with the lack of an open source skeleton tracking system for the Kinect your wait is over.

Currently there is an open source driver available for the Kinect, or you can use Microsoft's Kinect SDK for Windows, which is free to use commercially as long as you buy a Windows Kinect to work with it. The Microsoft SDK includes a high quality skeleton tracker and there is also a similar free-to-use skeleton tracker in the OpenNI framework. However, if you wanted to get inside the code and modify it, you were out of luck.

Skeltrack is the first alternative open source alternative. It has been implemented by a Spanish company Igalia based on the ideas described in this paper by Andreas Baak. The new skeleton tracker, however, doesn't make use of a pose database. Instead it is just a set of heuristic features. This approach means that the user doesn't have to start of with a special initialization position for the tracker to lock on to. The features are simply computed and the location of the joints returned.

Microsoft spent a large amount of computing time using machine learning to derive its joint detection features, so it is likely to be difficult to construct good features heuristically.

 

skeltrack

 

The resulting program provides an asynchronous tracking API using GLib and supports single user tracking with up to 7 joints - head, shoulders, elbows and hands. It uses the same company's open source wrapper for the Open Frameworks.

The big drawback of the system at the moment is that it only works if the user is the only object in the scene. That is, it requires a background subtraction to work properly. As the creators say in a  recent blog post:

Skeltrack is in its early beginnings and we want to detect more skeleton joints and work on stabilizing the results so, its features and API might change in the future.

You can see the Skeltrack in action in the demo video below:

          


Creating such technically difficult software without the resources of a company like Microsoft is a tough task  for the open source movement. Let's hope that it can be fine tuned and made as efficient as the Microsoft machine learning version.

If you know of any other attempts to build a skeleton tracker let us know.

More Information

A Data-Driven Approach for Real-Time Full Body Pose Reconstruction from a Depth Camera

Announcing Skeltrack

Igalia

Related Articles

Practical Windows Kinect in C# - ebook

Avatar Kinect - a holodeck replacement

A Kinect Princess Leia hologram in realtime

Kinect augmented reality x-ray (video)

Kinect flies

Kinect plus a glass wedge gives ...

Kinect makes you Superman

Kinect goes self aware - a warning

Kinect for Microsoft Robots

Kinect knows what you are doing...

 

square

 



 

Comments




or email your comment to: comments@i-programmer.info

 

To be informed about new articles on I Programmer, subscribe to the RSS feed, follow us on Google+, Twitter, Linkedin or Facebook or sign up for our weekly newsletter.

Banner


Angular 11 Released With Byelog Goal Complete
17/11/2020

Angular 11 has been released with updates across the platform including the framework, the CLI and components. More specifically, the new version enforces stricter types and has automatic inlining of  [ ... ]



Servo Rehomed With Linux Foundation
19/11/2020

Servo, the open source project initiated at Mozilla to create a high-performance browser engine designed for both application and embedded use, is joining the Linux Foundation.


More News

 

<ASIN:B006UIS53K@COM>

<ASIN:B0078LMS72@UK>

<ASIN:B002BSA298@COM>

<ASIN:B0036DDW2G@UK>

<ASIN:B0036DDW2G@FR>

<ASIN:B002BSA298@CA>

<ASIN:B003H4QT7Y@DE>

<ASIN:B00499DBCW@IT>

Last Updated ( Sunday, 25 March 2012 )