oh where am i
what's happening to my face
[Music]
oh no
you have been chosen by the mothership
to be transformed what but why me
but how you have received the video
message you sent us our great mural
brain analyzed it and turned your face's
deepest motions into an animated 3d
avatar embrace your new digital future
yes
only that you don't have to be chosen by
the aliens to have your motion capture
done automatically this is dj from
garage from the net academy and in this
video i will show you exactly how to get
this from this in just a few clicks
using deep motion service and we'll find
out how the new facial motion capture
feature works now also give you some
tips on how to optimize the not so
perfect animation that you might get
from this let's get right into it let's
have a look at the tip motion service
let's log in let's go to animate 3d
cloud and choose create animation we
have two options here using the default
dummy character we'll be using the
custom 3d avatar i will show you exactly
how you can create this one in the next
section of the video or you can use your
own characters so if you're interested
in that let me know in the comments i
might prepare a future video about how
to do that
now let me show you how you can create
the 3d avatar you can change glasses all
the props clothing and stuff pretty fun
just like playing a video game and
creating your own character you can
create different types of bodies so
masculine feminine or not specified let
me create a lady here the fun thing that
you can use here you can use a photo so
let me just use a photo from the
internet and this character will be kind
of similar to the photo that we provided
pretty cool of course you can do the
hairdo
color of the skin facial makeup
different kind of fashion a more
medieval thing and more modern clothing
or something like a fortnite character
let's make her with pink hair
a little bit of makeup and here you go
now let's name our character and save it
so we have a library of different
avatars and now you can use the
character to create animations from your
videos
i'll pick a dj cowboy i prepared before
and use a pre-recorded video of myself
acting the intro sequence let's pick the
physics filter and the face tracking
feature which is in alpha and this is
the core of the video and let's press
create animations
right now my video is limited to 720
resolution because i'm using the free
tier of the service you can get higher
resolutions to get better quality
animations but you have to have a paid
account for that we'll be just going
right now with a free version and see
how it works so let's start the job and
you can wait a bit make yourself some
coffee just imagine how long it would
take to just create those animations by
hand and boom press ok and see how the
magic ai algorithm created an animated
character out of your video that's my 3d
character behaving the way i was well
not really exactly the same you can see
that there are some weird issues the
hands twisting weirdly and other stuff
some of this might be because of the
lower quality of the video i'm using and
some of it is just like the service is
not perfect it's being developed and
it's getting better with it release so
hopefully in the future the results will
be much more accurate but right now it's
just like a new feature let's take it as
it is some of these uh in accuracies we
can take care of them manually in our 3d
dcc for me it's blender so i'll show you
a few tips on how to
smooth out all the rough edges of the
animation in the next part of the video
we can also use this timestamp now we
can just download our animation as an
fbx or a bvh file
[Music]
once you download the animation how to
import it very easy we have an fbx and
let's import the file that we downloaded
from the surface you can see it's
already rigged with an armature and the
armature is taking care for the
movements of the whole body but the
facial animations are driven by shape
keys
[Music]
there's a whole lot of keyframes here
and the movement is a little bit wonky
so we'll take care of how to modify some
things like for example hands crossing
each other let's modify the interface a
bit to animation workflow let's have a
graph editor here so we can see the
curves and you can see the curves are
quite crazy if we pick any bone or all
the armature you can see there's just
too much of these keyframes so you can
either just take it as it is and modify
it using for example proportional
editing scroll the mouse wheel and we
have a
smoother transition right now but if i
want to just simplify this curves
there's a cool trick to do that so let's
select all of the curves here and let's
go to key
and decimate ratio or decimate allowed
change now we can just pick a value and
that will simplify this according to
these values right now i think i've
overdone it a little bit it's a little
bit too smooth so it might take out too
much information from the animation so
let's pick a lower value 0.2 for example
a little bit more of the animation is
preserved right now and i can see the
facial movements are quite okay you can
also emphasize some things if you want
just changing a specific keyframe
here or there for example here
i'm trying to make the mouth open a
little bit more so you can see this way
you can tweak strange things happening
or just emphasize some movements more
you have already got your reference
footage that was used for creating the
animations so you can easily make it
match the desired effect that's how to
patience focus and hard work sorry dudes
no shortcuts here
for this whole intro animation i just
used this animated avatar put it inside
a 3d scene in blender i created a simple
spaceship abducting my character set up
a simple grass field i've used grass
wall to add on for creating the grass
it's doing a great job hdr lighting so
nothing fancy here the animation is used
in the scene i'm just checking every
render setting that needs to be checked
i'm going to render this with the gpu
1000 samples let me check if i enabled
all the passes that i will need for
compositing later and i'll render this
out to a sequence of open exrs to have
an option of compositing later on let's
save it and place run the render beamer
plugin which will upload the scene
straight to the farm and it already
takes care for all the linked assets and
stuff like for example grassworld grass
it works smoothly it's pretty much
automated and right now i'll just make
sure i'm logged in in my web browser and
i can submit the uploaded job to be
rendered on farm but just to be safe and
not to lose my credits i'll first run a
test render with a step so i can render
just every 70th frame from the whole
sequence and if the frames render
correctly i can then render out all the
sequence with a step of one so each
frame will be rendered and i'm sure that
everything will work fine so it's a good
habit to always run a test render on a
paid render from service and the render
went pretty blazingly fast the frames
are already automatically downloading to
my drive and i'll drop them into blender
and see if they rendered all right i can
see everything randomly fine the grass
and all so i can run the job again with
a step of one and the whole sequence is
done
once i have it i can just do a quick
compositing i'll just do a small color
correction and a glare for the
spaceship's lights and mix it with the
image here and there we go we have this
nice glowing effect the compositing is
pretty simple and i'll just run it on my
local pc and that's how the animation
turned out i hope you found this
entertaining and useful so if you liked
it don't hesitate to give it a thumbs up
and leave your comments below if you
want to see more of this kind of
material or something in it to be
explained more in depth and see you in
another galaxy i mean tutorials from
garage from academy
[Music]
you