[Music]
over centuries we've been taught that
our hair gives us a certain personality
and charm but if you've ever dyed your
hair you've more than likely been
disappointed in the results at some
point then you face the panic of
actually fixing it I heard about a
company that can answer these questions
before you face them but can they really
find the best solution for something as
personal as hair color using something
as technical as AI I'm Arjun from Nvidia
and this is Imai so as soon as a user
will open the application on to their
iOS device and they're instantly able to
see their live image it's like looking
in a camera feed so as you're moving
back and forth we're seeing that you're
moving it's like looking into a mirror
and based on that we can instantly start
tracking your face tracking the hair and
you can apply any color you want we've
been around for over a decade now and it
all initially started back when our CEO
who is also the founder dr. Parmer
Robbie was working on face tracking and
lip detection some of our initial
clients Allergan being the very first
one to ever launch with us had
approached him with the concept and idea
of can you take this facial tracking and
do it in a different way and actually
show what a product could look like for
things such as Botox and Juvederm
injectables but we progressed so much
over time because there's such a need in
the market for the consumers to see what
they could look like with the hair color
applied before buying that product and
doing that themselves are going to the
salon and so being able to utilize that
it is so easy to use now there's no user
input you just look at a screen and even
at the back of my head without my face
necessarily being shown on the screen we
can track that we know where your hair
is we know what the texture really is
we're understanding the placements and
we can color it virtually anything you'd
like as facial tracking lip detection
have become more common uses of AI what
was the natural progression from face to
hair where does the process start the
initial applications were 2d
applications where you would upload a
photo you had to manually outline your
hair or make corrections to what the
detected mass was and then you would see
a coloration result on that 2d photo but
it doesn't give you that live view and
so what we had to do was really
understand
how can you take all of the data and
know-how we have about hair and applied
to understanding and finding 3d hair so
an image find every strand of hair and
know what is hair that's black but what
is not hair that also is black but is
part of the background there are 150,000
hair follicles that are unique to every
human I wondered where you even start
the training how can you teach a network
to look at each strand of hair what we
had to do is manually annotate these
images so we had to make sure you our
users would go and manually define what
is hair and what is not hair to provide
training data for it for the neural nets
and then the neural net was trying to
mimic what humans could do so that first
attempt did well but it wasn't perfect
so we had to actually improve our neural
net architecture
modifies uses a convolutional neural
network or CNN that's been modified to
generate a mask for the hair in an image
typical CNN architectures consist of a
sequence of convolutional layers of
increasing depth and decreasing
resolution together these layers are
called a convolutional encoder they
provide strong feature Maps and deeper
levels of the network but without all
the detail of the source image to
generate a reasonable mask or hair this
process has to be reversed this is done
by decoding the feature maps generated
by the encoder using up sampling and
convolution to improve resolution this
encoder decoder model forms a fully
convolutional network or f CM that can
generate a detailed mask for hair it's
interesting that once this neural net
understands what hair is in one image
when you provided live video it can
build that three-dimensional model of
the video but the basic ingredient of
what it detects is a 2d hair image the
hair color app is so easy to download
and try out I wanted to take it out of
the world I wanted to see how people
responded to it
I was curious to see how hair color
enthusiasts would react as well as those
who would never risk diner
[Music]
NoHo there it is
[Music]
so the haircutter app is a demo of what
our technology can do eventually
customers can use this technology if
they go in salons if they if they're
trying to get on a website if they're
trying to buy a haircolor product or if
they they're just at home they're
wondering what color might be best for
them so there was a lot of hope and a
lot of guessing but now it's all about
knowing precisely what the color will
look like on you and different lighting
conditions and by the time you commit
that this the color you want you know it
is the one you really do bond after
seeing how people responded to the app I
wanted to know how this technology could
evolve what about this is going to be
the game changer in the beauty industry
in terms of where this is going to be
going in the future
I mean AI is really just hitting the
market and I think in the future this is
gonna be more prominent in new locations
but it's also gonna be used more for
that personalization consumers to
understand what's gonna work best for
them know what works best on that
celebrity in the magazine or what works
best on that model but it's all about
them their face their skin tone their
hair colors at what works for who they
are
[Music]
you