j.doodles

Search This Blog

Playing with Digital Minatures

April 26, 2020

Get link
Facebook
Twitter
Pinterest
Email
Other Apps

Playing around with photogrammetry assets.

Get link
Facebook
Twitter
Pinterest
Email
Other Apps

Comments

My Realtime-Puppet Setup is Reborn!

For the last few years I've been wanting to get into Unreal's Blueprints indepth enough to build my own 'puppet' animation system. I've always had a team of Technical Artists building the system in the earlier iterations, so I never had to get in and learn the specifics of Blueprint programming myself. Well, that's changed! I set out to learn what I needed to build a home setup that'll allow me to take any CG character and control them in realtime as you would a vTuber! So here is version 1! It uses an iPhone to control the facial tracking and animation, and the Leap Motion to control the arms and fingers. It's pretty basic setup, but for me it's an acomplishment that has taught me the ins and outs of basic Blueprint programming. Neat! So I hope to be creating animated content with this setup in the weeks to come. Stay tuned.

Researching AI systems for production

Over the last few weeks I've been exploring synthetic Avatars. Avatars that are synthetic in almost every way. They are AI controlled, and offer various capabilities. Here are some of the byproducts of that testing: This is a Text2Speach applied to a still image generated out of Midjourney. It can take any audio file and will animate lipsync, and apply some synthetic expression. It's extremely limited in movement, but it only took 20 minutes to create. I think as a chatbot or web-avatar there is an appeal to this very uncanny and synthetic approach. It's creepy, but in a neat way!? This is a test I did awhile back with very similar tech. Wav2Lip offers the ability to change what someone is saying on an exsiting video. Not many frills, and the output quality needs some refinement after the generation. But, it's just an impressive demo none-the-less. Finally, this one I'm very excited about. Motorica.ai is a platform that generates AI motion for your

Metahuman Face Rig onto Dead Bob

Today's experiments are to see how to apply the Metahuman Rig Setup to a custom character, in my case Dead Bob. My results are spotty, but I'm making progress. Here is an example with the Mouth and forehead controls transferred ( admittedly pretty roughly ) but I think will work. Just wanted to show how it's going. Next up is eyes. I'm pretty impressed with the transferred deformations

Powered by Blogger

Playing with Digital Minatures

Comments

Post a Comment