Skip to main content

j.doodles

Search This Blog

Kinect used to create some real-time facial capture

Get link
Facebook
Twitter
Pinterest
Email
Other Apps

EUE 'Meekon' (Markerless Facial Mocap) Raw Capture from Wayne Robson on Vimeo.

Here is a link to Wayne's blog. Pretty good stuff.

Get link
Facebook
Twitter
Pinterest
Email
Other Apps

Comments

Post a Comment

Popular Posts

Metahuman Face Rig onto Dead Bob

Today's experiments are to see how to apply the Metahuman Rig Setup to a custom character, in my case Dead Bob. My results are spotty, but I'm making progress. Here is an example with the Mouth and forehead controls transferred ( admittedly pretty roughly ) but I think will work. Just wanted to show how it's going. Next up is eyes. I'm pretty impressed with the transferred deformations

Text-to-Video is the new thing with Gen2!

I've been playing with image synthesis for a year now, mostly around text-to-image. I've created worlds with Midjourney, Dalle, Stable Diffusion, and anything else I could get my hands on. However, recently I was accepted into the RunwayML Gen-2 beta which is a Midjourney style ( discord interface ) prompt-to-video system. It's really exciting to get into and play around, but I tell you it's near impossible to control or get anything that doesn't look contorted and warped. Artifacts of the current iterations of the medium. If early Midjourney had distorted hands.. Gen2 turns that distortion to 11! LOL. Regardless, I love it. I am embracing the artifacts, as I did in the early days of Disco Diffusion and Midjourney. I'm using them as trademarks to the style. It's still very challenging to control composition, cameras, or pretty much anything currently. But with patience and LOTS of iterations you can eek out some useable synthesized footage. To

We Were Emergencies ( AI Short Film )

For almost a year now I've been playing with various applications of Image Synthesizing workflows. At the start of 2023, I wanted to create something positive and encouraging. So I thought what a great opportunity to combine the two? That's where this idea originated from. The process was something like this: I reached out and reconnected with a friend I've known for a long long time who is a successful spoken word poet. Buddy Wakefield . Told him my plan, and asked if he had any inspiring work that I could build visuals to. "We Were Emergencies" is part of a longer piece Buddy performs when he tours, and I thought it was great for what I had planned. So first, I feed Buddy's audio performance into " Video Killed the Radio Star " Colab, which uses A.I. to parse out lines from audio with a 'whisper' model and then uses each line as a prompt for a frame. Then it takes those frames and builds and edit to the audio in sort of a 'boar

Powered by Blogger