LightGuide: Kinect Teaches Movement
Written by Harry Fairhead   
Friday, 11 May 2012

The latest job for a Kinect is to teach you how to move. In principle, it could teach you how to play the cello, perform martial arts or dance. But my guess is that you still need talent.

There have been a number of Kinect-related announcements from Microsoft Research recently but LightGuide if perhaps the most innovative in terms of what you can use a Kinect for.

In most cases the body tracking that the Kinect provides is simply used to find out where the body parts are and react to this in an appropriate way, e.g. by moving a ball. In this case the body tracking is used to locate the body part and project a helpful symbol onto it that indicates how the body part should move to complete the task correctly.

For example, if you are learning how to bow a cello then LightGuide will project a symbol showing how you should move your hand to best complete the task. The same applies if you are trying to learn a martial art or dance.

The big problem for the research team was to find a set of symbols that could be easily understood in terms of which direction in 3D the hand or arm should move, watch the video to find out more:

 

This is another of those ideas that probably could be applied in situations that the research team hasn't thought of as yet. The whole idea of training for "muscle memory" is a fairly new subject area and this approach has a lot of potential.

There are some obvious problems to solve. For example, suppose you wanted to teach how to play the guitar or piano, then you would need to detect the location of individual fingers - something that the current Kinect would find difficult to do reliably. The same problem occurs in all sorts of similar situations - painting, sculpting and so on.

A second problem is being able to see the visual hints. For example, how do you indicate where a user should put their feet while learning to dance? Perhaps what is needed in these situations is some sort of localized feedback - say a wall projection showing actual feet and target feet positions.

Clearly there is a lot of scope for further work and it would make a really good project for the experimenter.

 

 lightguide1

Related Articles

Kinect 3D Full Body "Hologram"

The Perfect Fit - thanks to Kinect-technology

Shake n Sense Makes Kinects Work Together!

All About Kinect

Introduction To Kinect

 

espbook

 

Comments




or email your comment to: comments@i-programmer.info

 

To be informed about new articles on I Programmer, subscribe to the RSS feed, follow us on Google+, Twitter, Linkedin or Facebook or sign up for our weekly newsletter.

Banner


Windows 11 Adoption Takes A Downturn
11/12/2024

With Windows 10 End of Life only ten months away, Microsoft is stepping up its campaign to get Windows users to upgrade to Windows 11. But while Windows 11 had been gaining users at a steady rate at t [ ... ]



JetBrains Improves Kubernetes Support In IDE Upgrades
12/11/2024

JetBrains has improved its IDEs with features to suggest the logical structure of code, to streamline the debugging experience for Kubernetes applications, and provide comprehensive cluster-wide Kuber [ ... ]


More News

 

 

 

 

Last Updated ( Friday, 11 May 2012 )