Monday, November 3, 2014

Kinect V2 working within Unreal 4.5

Testing out the Kinect V2 in Unreal 4. Pretty cool. #nerd #realtime

A video posted by Jeffrey Dates (@kung_fu_koi) on

So the above shows a demo scene of the Kinect v2, feeding data into Unreal 4.5. Leon Rosengarten has been so kind as to offer the source code to his plug-in to be used in personal projects. HERE is the thread with all the updates.

So now I'm learning Visual Studio 2013, in an attempt to get it to work so that I can compile this plug-in for use in my own projects.

I'll keep you posted.

As it is now, I'm running into errors simply running Visual Studio. grrr.

Saturday, October 18, 2014

First tests with Unreal 4.5


Successfully got this rigged Guy into unreal4. Now to hook him to the #kinect. #realtime #vfx

View on Instagram


Some obvious issues associated with weighting and cleanup, but pretty happy with this first test of #kinect mocap into unreal4. #realtime #vfx

View on Instagram

So In my quest for a real-time digital puppets, I'm always testing out workflows that might be feasable to bring stories to life quickly. Lately, I've been dabbling with Unreal 4.5. Seen here are my first attempts and bringing in a Rigged Character and motion captured by the Kinect v1.

Currently, the motion is pre-captured, and cleaned up, then applied to the rig in Unreal. There are obvious issues with the motion capture data cleanup itself, as well as the shoddy envelope weights. This was done quickly, so I could test out the whole process.

I'll continue to familiarize myself with Unreal and this process to streamline it a bit. Already, I'm looking into just capturing the kinect v2 data straight into Unreal with this guy's work.

Stay tuned.

Processing with Kinect_v1


Accessing the Kinect with processing. My first pointcloud test! #nerd

View on Instagram

I've been tooling around with Processing over the last month, and have managed to get it to interface with the Kinect V1. ( V2 coming...) Here is a simple pointcloud test I did... Pretty fun. This opens a lot of doors as to what I might be able to do. Sorry the quality is such crap, I literally filmed my screen with an iphone to post on Instagram. Yes, I'm a hack. Enjoy.

Wednesday, October 1, 2014

Processing in 3D!


The minds eye 'sgot nothin' on me. #gfxNerd

View on Instagram

Just an example of 3D with Processing. Continuing to learn.

Saturday, September 27, 2014

Hello World - Processing!

I never seem to find the time for all the projects I have on the burners. However, work being slow I was able to focus on one. To get into real-time graphic programming with Processing. The end-goal will be to incorporate interactive user experiences in a real-time environment. Also, integrating the Kinect.

All of this has been slow going, but I've made a breakthrough and have started to achieve some successful tests. I've managed to get the Kinect working, with pointclouds, IK, and depth info. So that's huge. It'll still take me a bit to study how to use that info.. but it's all talking together.

Seen here, is basically my level of understanding currently. I was able to take principals and logic from other examples, mainly Amnon Owed, and hack together this little seizure ring. Anyway, more to come.

Friday, August 8, 2014

Filmmakers Bucket List

One time on set, Rubert Sanders was saying one didn't need to go to film school, but only to study certain movies to learn everything they'd need to be a Filmmaker.   Then at lunch, he rattled out the list.  Here it is below.

Thursday, July 17, 2014

Kinect Selfies


Playing around at work with the #Kinect @millchannel #vfx

View on Instagram

Just playing around with the Kinect today....
This is the result of reading the channels into Houdini on Linux...   cheers!

Wednesday, April 16, 2014

Started Sketch Comedy Classes with UCB NY!

I'm pretty excited.  Pay $400 and the Guarantee I'll write funny!  Guarantee it!
Stay tuned.  

Tuesday, March 11, 2014

#Cinder "Hello World" Epic Fail

So with all the kinect development and hacking I've been looking into, I've taken interest in Cinder
However due to the fact that Cinder is not on Linux, I've moved on to Processing and P5.js.

So look for tests in the coming weeks/months.