this new model by google research and
tel aviv university is incredible you
can see it as a very very powerful deep
fake that can do anything take a hundred
pictures of any person and you have its
personnel encoded to fix edit or create
any realistic picture you want this is
both amazing and scary if you ask me
especially when you look at the results
just take a second to admire them
[Music]
the model simply uses a pre-trained
style gun architecture which i covered
in numerous videos so i won't enter into
the detail of this network quickly star
gun takes an image encodes it using
convolutional neural networks and is
trained to regenerate the same image if
this sounds like another language to you
just take two minutes to watch the video
i made covering style gun
then when you have it well trained with
a big data set of many people you can
teach it to transform the image directly
from the encoded space as i explained in
my videos so you don't need to fade it
images anymore you can simply play with
what we call the generator this means
you can teach it to change the whole
picture like a style transfer
application where you would for example
take a realistic picture and encode it
or start right from the encoding and
transform it into an anime like digital
image trained and manipulated properly
you can also change only some local
features like the color of the hair or
any other edits to make you look your
best
so this new model called my style uses
the style gun base model and modifies it
to achieve not only a style transfer
task but any task that can be associated
with your face as i said it literally
learns how you look and can do pretty
much anything in painting super
resolution or editing imagine painting
is where you'd have some object in the
shot covering your face and you'd remove
the subject from the picture and make
your face reappear just like if you
enable transparency in a video game to
see through their walls image super
resolution is an incredibly challenging
task when trying to generalize to many
different faces but much easier when you
focus on one person here the goal is to
take a very low definition image and
upscale it to a high resolution one so
you basically have this a blurry image
of yourself and you try to make it look
like this you can see how these two
applications are quite challenging for a
machine as it needs to understand the
person in order to fill in big gaps or
add pixels to make the face look sharper
the model basically has to be both a
very close friend of yours and a great
artist at the same time as it needs to
know what your face looks like from any
angle as well as be able to draw it
realistically while i will always do the
most i can to be the best friend
possible forget about me drawing an
accurate version of your face if you
want good results this is just another
level so taking this style gun basis
train with a huge general data set of
thousands of people and a hundred
pictures of yourself my style will learn
an encoded space unique to your face it
will basically find you in the included
representation of all faces and be
retrained to push the model to focus on
your different features then you will be
able to feed it incomplete or failed
pictures of yourself and ask it to fix
it for you how cool is that it requires
quite a lot of images of yourself but a
hundred pictures just mean a big day
outside with a friend and your phones to
have much better results than the
general models that try to generalize to
everyone it's also much cheaper than
hiring a professional on photoshop and
asking to edit all your future pictures
still you can see how this kind of model
can be dangerous for famous people or
those with a lot of instagram pictures
someone could use them to train a model
and basically create super realistic
pictures of yourself in compromising
situations this is why i often say that
we can't trust what we see anymore
especially on the internet let's not
think about all the possible issues when
it will also be in the real world with
augmented reality glasses nonetheless
the results are fantastic and much
better than what we've seen before
considering it only requires a hundred
pictures of yourself instead of hours of
video shooting for older deep face and
has much fewer artifacts than those
requiring fewer images performing only a
single task and voira this is how my
style a new model from google research
and tel aviv university is able to
perform imaging painting image super
resolution and image editing using a
single architecture and training scheme
compared to other approaches as it
focuses on the person instead of the
task itself which makes it much more
accurate realistic and generalizable to
you i hope you enjoyed this video let me
know what you think of this shorter and
simpler format if you like it or not of
course this was just an overview of this
new paper and i strongly recommend
reading the paper for a better
understanding of their training scheme
and the model i will see you next week
with another amazing paper
[Music]
you