WOW - Open Kinect

[elbows]

For Windows 7 users, Microsoft version of SDK is out. Non-commercial use, but the skeletal tracking probably has some advantages, eg no calibration pose required.

Not tried it myself yet, may get the opportunity to do so this evening.

http://research.microsoft.com/en-us/...k/default.aspx

[Intrinsic]

Ok this is a free download from the updated article on VJFX.com with updated tutorial/instructions: FF DepthCam plugins at VJFX.com

Vimeo Videos

Vimeo Videos
Vimeo Clip 34031141

The new FF1.0 (PC Only) plugin which I called NIUserKey1, is based on OpenNI libs and avin2 modded primesense drivers for Kinect (I suppose it would support other OpenNI supported devices too), it has 4 parameters:
- one controls foreground (detected user) transparency
- one controls background transparency
- the other two controls saturation of either

..no skeletal detection or anything more yet, but maybe I'll look into that too, any ideas for hybrid/depth FX are welcome. I'll admit I haven't been so frequent in VJForums lately, a bit much with all at once, anyway I'll try drop in more often..

and, merry xmas!

Cheers,
Thomas / Intrinsic

[elbows]

Cheers for that, and a merry christmas to you too! Im not on a PC and Im doing skeletal stuff so I can't really comment on your stuff, but I would think some should find it useful. If only this tech had arrived at a time in the past when VJForums & associated meetings were more alive, would have been a lot of fun.

Anyway recent versions of OpenNI/NITE have removed the need for calibration pose for skeletal tracking, which is nice, although I've not had a chance to try this yet.

[elbows]

Highly polished and rich Kinect applications remain rather elusive, but in most other senses there has been quite some progress in the year+ since this stuff became a reality. There is now quite a lot more choice, and certainty for those looking to develop stuff commercially.

Hardware options:
PrimeSense sensor for developers (has been hard to get hold of)
Asus Xtion (for use with OpenNI rather than Microsofts flavour of SDK)
XBox360 Kinect sensor (need to buy standalone version to get the USB adaptor)
Kinect for Windows (From 1st Feb, more expensive than 360 version but includes support for recognition at a closer range)

Software options:
OpenNI (cross-platform, skeletal tracking improved recently, no calibration pose required)
Kinect SDK (Windows 7 or 8, new version due on Feb 1, supports microphone array and speech recognition API)
One of the completely open alternatives that came from the original Kinect hacking (No skeletal tracking but good for getting depth map to do more basic tracking with)

Since Microsoft announced the Kinect for Windows hardware and made clear that the software side of things will remain free for developers, I can now press on with exploring commercial possibilities.

[elbows]

Well the Microsoft official SDK version 1.0 is out today. I cannot comment on it in detail as it requires the Windows version of the hardware, and I think that Microsoft have failed to actually make the hardware available in many countries today. Im not even sure if many in the US have managed to get hold of the hardware.

Looking at the release notes I don't see any stunning new developments anyway. A few things that could be handy for certain applications but for many the unofficial stuff or OpenNI/NITE stuff from PrimeSense may well continue to be the better option for a number of scenarios.

[elbows]

I stand corrected, for it seems the latest MS SDK does still work with the 360 Sensor. The way Microsoft word it is that developers can do this if they install the SDK, but end users will need the windows kinect hardware. In this sense its more of a licensing issue for developers, although there are technical issues too as certain capabilities will only work on the windows version of the hardware.

Anyway I gave it a quick go and although I cannot evaluate the near-field mode due to not having the windows version of the hardware, I could try the rest ok. It didn't impress me more than previous releases, so I'll be sticking with OpenNI instead for now.

Or in other words, wake me if Microsoft get round to putting the facial expression & head rotation detection stuff they recently released as part of Avatar Kinect for the Xbox, into their Windows SDK.

[nosuchtim]

See http://spacepalette.com for an interesting use of the Kinect to create an instrument for visuals and music. I use the libfreenect library created by the Open Kinect community. I used to do the visuals with Processing, but I now do it with a C/C++ plugin (FreeFrame 1.5 FFGL) running inside Resolume.

...Tim...