LEAP Skeletal Tracking API
Written by David Conrad   
Monday, 02 June 2014

The LEAP motion controller made a big hit until it actually came to market when the excitement seemed to dissipate without any real explanation other than it just didn't quite live up to the promise. Now there's a new API the could make the splash the device initially promised. 



The new skeletal tracking API provides a much better robust hand tracking with full degrees of freedom for all moving parts. The new Bone API allows you to extract data from tracked hands corresponding to the positions and measurements of the bones making up the hand. You can retrieve joint positions and bone lengths so that you can easily create an on-screen representation of the user's hand positions.

The idea is that you can allow the virtual hands to interact with virtual objects created by physics engines.  This plus the original skeletal tracking features such as the pinch, grab and other gestures can work together to provide natural interaction 



The LEAP hardware is simple enough - three infrared LEDs create a pattern of dots which are viewed by two IR cameras in the box. The parallax data generated is sent back to the PC over the USB connection where it is processed by the controller software. The point is that the simple hardware relies on the software to do the 3D extraction and there is probably a lot more that can be done to improve it. 

The most important part of the API, however, is that it is getting feedback from early adopters that sounds more like the sort of thing the original LEAP launch should have generated. It seems to work much better than the original tracking API and it seems to be easy to use. The main problem seems to be how the system handles occlusions of a finger by a hand or other fingers. This does seem to be a hardware problem and it could be solved by using two sensors. 



The real question is - is it good enough to give the LEAP a better chance in the market?

You can't beat it on cost at around $80.

All it needs is the software to make it attractive 



Apache Updates Geronimo Arthur

Apache Geronimo Arthur has been updated with support for Common-compress, XBean, and ensures the default options are compatible with last GraalVM release.

Azure AI And Pgvector Run Generative AI Directly On Postgres

It's a match made in heaven. The Azure AI extension enables the database to call into various Azure AI services like Azure OpenAI. Combined with pgvector you can go far beyond full text search. Let's  [ ... ]

More News


raspberry pi books



or email your comment to: comments@i-programmer.info


Last Updated ( Monday, 02 June 2014 )