j.doodles

Search This Blog

Dog Run

December 13, 2012

Get link
Facebook
X
Pinterest
Email
Other Apps

Get link
Facebook
X
Pinterest
Email
Other Apps

Comments

My Realtime-Puppet Setup is Reborn!

For the last few years I've been wanting to get into Unreal's Blueprints indepth enough to build my own 'puppet' animation system. I've always had a team of Technical Artists building the system in the earlier iterations, so I never had to get in and learn the specifics of Blueprint programming myself. Well, that's changed! I set out to learn what I needed to build a home setup that'll allow me to take any CG character and control them in realtime as you would a vTuber! So here is version 1! It uses an iPhone to control the facial tracking and animation, and the Leap Motion to control the arms and fingers. It's pretty basic setup, but for me it's an acomplishment that has taught me the ins and outs of basic Blueprint programming. Neat! So I hope to be creating animated content with this setup in the weeks to come. Stay tuned.

Metahuman Face Rig onto Dead Bob

Today's experiments are to see how to apply the Metahuman Rig Setup to a custom character, in my case Dead Bob. My results are spotty, but I'm making progress. Here is an example with the Mouth and forehead controls transferred ( admittedly pretty roughly ) but I think will work. Just wanted to show how it's going. Next up is eyes. I'm pretty impressed with the transferred deformations

We Were Emergencies ( AI Short Film )

For almost a year now I've been playing with various applications of Image Synthesizing workflows. At the start of 2023, I wanted to create something positive and encouraging. So I thought what a great opportunity to combine the two? That's where this idea originated from. The process was something like this: I reached out and reconnected with a friend I've known for a long long time who is a successful spoken word poet. Buddy Wakefield . Told him my plan, and asked if he had any inspiring work that I could build visuals to. "We Were Emergencies" is part of a longer piece Buddy performs when he tours, and I thought it was great for what I had planned. So first, I feed Buddy's audio performance into " Video Killed the Radio Star " Colab, which uses A.I. to parse out lines from audio with a 'whisper' model and then uses each line as a prompt for a frame. Then it takes those frames and builds and edit to the audio in sort of a 'boar

Powered by Blogger

Dog Run

Comments

Post a Comment