Wednesday, March 23, 2016

Improving the Virtual Muppet Test!



I've been playing with the Leap Motion for a few days now, and today I had some pretty successful results!!  This is just the head motion and rotation, with some limited jaw rotation incorporated.

What is exciting is even at this early stage, I can get some expressive results!  It's so much fun to play with, and so responsive!  It's a joy!

I want to get his body in there, and perhaps some arm/hand control.  Also, introducing his eye shapes will go along way.

More soon.

Monday, March 21, 2016

Using the LeapMotion with PTS to drive Unity - First Test


Today Grifu was kind enough to share his latest build of PTS with me, which incorporates LeapMotion into it!

After talking with him, and our testing with the Kinect, it makes sense that perhaps the LeapMotion offers us a bit better control for a 'Virtual Muppet' setup.   Using this early version, I am able to read in various rotation and position channels directly from the leap itself.  Rescale them, and output them to Unity using 'Remote-Control'.

First tests show that using one channel of rotation or position works great!  However, when they are combined as seen here.. the rotation channel takes a performance hit.   It's exciting to see it working at this stage, as it's a huge step forward for me.   I have XYZ position data in Unity driven by my hand!  The rotation data is being read but seems to be steppy.

Grifu has opened up all the joints of the both the Left and Right hand, offering a range of potential control!  It's super exciting!

Very successful first test!

Edit: Here it is with just the Rotation channel isolated.  Much more responsive!

Wednesday, March 9, 2016

Leap Motion Dexterity Test

I got my hands on a Leap Motion today, and wanted to see how it stacked up against the Kinect as far as dexterity, and responsiveness for a muppet-input device.

Seen here is the Leap, running on my 2010 MacbookPro, inside of Unity 5.  I must say, overall I'm impressed. It was quick to setup, and rather responsive.  Best results so far I've tested.

The next test will be to drive my virtual muppet rig with this setup, and see some results!

Wakka wakka wakka!

 

First Pull-The-Strings Test!

Seen here is real-time capture of my arm using the Kinect, remapped/rescaled to work with the temporary IK chain within Unity, on the fly!!

So Grifu has been so kind to release his "Pull-The-Strings" OSC Middleware software in alpha, and I was able to get to play with it.

So I got I/O's "ArmTracker" software, and piped it into "PTS". Then using Grifu's "Stringless" remote control script for Unity, I as able to read in the data and remap it to my own temporary IK chain.

The performance is a bit sluggish, and I'm sure it'll improve over time. That, and the fact we're running off an old mac laptop.

Next step will be to incorporate a real Virtual Muppet Character test, to this proof-of-concept workflow.