Kinect + VRML, is it possible?

5 posts / 0 new
Log in or register to post comments
Last post
2012, February 16 - 00:17
#1
artur
artur's picture
Kinect + VRML, is it possible?

There is a lot of interactive/mixed reality fun stuff created using Processing and Kinect's SDK. a nice idea would be to integrate Kinect and BS Contact for some novel ways to interact in vrml/x3d worlds. Imagine a installation where your avatar is controlled with the physical movements of your body... alas, my coding abilities are non-existent, but i would love to be able to help to implement this idea!

Top
2012, February 16 - 11:20
vcard
vcard's picture
It is done.

It is being done.

A mention here:

http://www.perivision.net/wordpress/2011/06/microsoft-kinect-gives-a-face-to-a-3d-avatar/

With two avatars. Another example of ongoing work with live 3D avatars using Microsoft Kinect by Bitmanagement Software and IVN.

http://vimeo.com/27439099

Look at this other video here

http://www.youtube.com/watch?v=XP-celeobvQ

Links to technical info here:

http://web3d.org/pipermail/www-vrml_web3d.org/2011-September/000085.html

Top
2012, February 16 - 13:06
(Reply to #2)
artur
artur's picture
Amazing, particularly the

Amazing, particularly the overlaying of a real person over an avatar in real time. Of course, had to be those curious M17 design guys...

Top
2012, August 28 - 13:56
(Reply to #3)
wildpeaks
 

 

Glad you like the video :)

 
However I need to point out that m17's example has nothing to do with IVN: he reads the skeleton information to animate bones while the IVN version uses the camera textures to make its realistic 3d avatars.
 
Bitmanagement made an extension that forwards the diffuse and depth maps as image texture while I did the displacement shader that produces the mesh, recording system to be able to optionally record & play back avatars and put together the video that's now on ivn's demo page.
 
 
OpenNI (and now the official MS SDK) make it easy to retrieve the diffuse and depth maps, for example AIRKinect for flash can get you the textures and skeleton information for free: http://www.as3nui.com
 
There are also Kinesis if you prefer Javascript: http://kinesis.io
 
Or Motion Nexus: http://motionnexus.com
 
And overall, there are tons of cool demos at: http://www.kinecthacks.com
Top
2012, May 20 - 02:47
sdcraigo
Check this out:

http://ivn.net/demo.html

Top