marvel's spider-man has been hailed as
one of the best superhero games of all
time
back in 2020 it was remastered for the
ps5 and while the remaster brought some
really cool features like better
performance graphics and ray tracing it
also made one controversial change and
that's peter parker looking like this to
this
that got me thinking could i
using technology become miles morales
deep face lab requires the use of a
relatively powerful computer
if you're using an older system with
weaker hardware it may still work but it
will probably shorten the lifespan of
your hardware and or cause some damage
if that's the case continue at your own
risk or consider trying out a gpu form
like cesstop if you want to follow along
with that out of the way the workflow is
pretty straightforward first you start
with gathering two pieces of data the
source footage and the destination
footage you extract the frames from the
videos extract the faces from each frame
plug that into the software train it and
then you'll end up with your final
result now while it sounds simple i ran
into a lot of problems and i'll be
sharing the things that you shouldn't do
so that you don't make the same mistakes
that i did tip number one is to make
sure that your footage is as clear as
possible face data for movies usually
work pretty well because there's a lot
of high definition footage of the actor
that you want to use but when you're
recording your own face try to make sure
that you have pretty good lighting to
start with if you're using a dslr use a
fast shutter speed so that your footage
won't have any motion blur since it can
really mess up your face during training
tip number two is to spend the time to
clean up your face data it's a really
tedious task but having weird faces like
this or having blurred faces can cause
weird issues especially when it comes to
your skin and eyes
speaking of eyes that's definitely one
of the hardest parts about making a good
deep fake even big companies like disney
have struggled with getting the eyes to
look right
as they say the eyes are the window to
the soul that's why for tip number three
spend the time to fix the face markers
on the mask deep face lab already comes
with a generic train mask that you can
apply to your footage but your mileage
may vary it's great for rendering out a
quick test but in my case you can
clearly see that the eyes aren't exactly
aligned with the destination footage
tip number four is to use a pre-trained
model while you can most definitely just
click on the button and start training
the ai to draw your face it doesn't
actually know what the face is because
of that it starts off as a gray square
and kind of builds up from there if you
use a pre-trained model however you can
skip that process since it already knows
how to draw face all you're doing now is
teaching it how to draw your face and
because it already knows what the face
is you spend significantly less time in
order to get a decent result you can
find a lot of models posted online and
in forums however if those models don't
fit the faces that you're working on you
can gather faces for your own data set
and train your own model and finally for
tip number five make sure you plan out
your shots in advance the biggest
problem that i ran into is the fact that
the lighting in my destination footage
is all over the place it's a lot easier
to make a decent default if the
destination footage has uniform lighting
or the face doesn't move around as much
a great example of this is how they
chose to shoot luke skywalker's body
double under the shade that way the
lighting is more uniform and it's much
easier to work with for this shot it
worked out fine because most of the
lighting here is uniform but in this
shot it starts to seriously fall apart
because the left side is orange and the
right side is blue once my face is
composited the ai can't figure out how
to match the lighting on both sides of
my face compare this with one of my
first task defects and you can see how
much better it looks because the
lighting here is more consistent with
all that said here's my first attempt at
being miles morales oh
man
yeah sorry i've been meaning to tell you
i'm not gonna be around for the next few
weeks
is this some kind of b joke i don't get
no uh mj's headed overseas for the bugle
and requested me as her photographer
kind of a working vacation for us oh man
look i don't know if i'm ready to fly
solo i screwed up today big time with
the helicopter but then you delivered
big time you saved my bacon miles
i got lucky
hey
i did this gig for eight years without
backup and you better believe i screwed
up lots of times
but that is how you learn
what's this christmas present
but first
you gotta take the oath oh
um okay
i promise to do everything in my power
to protect this city
i promise
that's it
that oath a real thing
totally
definitely didn't just make it up
see in a few weeks spider-man
new york's only spider-man
i'm new york's only spider-man
you