it's a dream that many of us have been
pursuing for decades across the industry
and academia we have always aspired to
build intelligent systems computers and
and machines that can see see like us
computers and machines that can hear
understand and even feel the emotional
context and use these capabilities to
interact and communicate with us well
it's been called human-computer
interactions human-machine interfaces in
many names today I am really excited to
share with you our efforts to make these
experiences natural intuitive and
immersive welcome to the era of
perceptual computing where the computers
and machines can perceive the world and
interact with human beings and each
other how do we accomplish that how do
we make this happen well we take a deep
look at the nature and copy from its
playbook with pride more precisely we
look at ourselves we the humans have
evolved to be very highly cognitive and
interactive beings we have developed a
very nice set of sensors and actuators
visual aural tactile etcetera supported
by a very highly capable brain and we
deploy this massive array of resources
as we perceive the world understand and
interact with each other how about the
computers and machines debt that we have
developed well first let's take a look
at the brain where we have come a long
way especially thanks to the efforts at
Intel what you see here is the first
commercial microprocessor the Intel 4004
which was introduced to market in 1971
it had 2,300 transistors working at a
speed of 740 kilohertz humble beginnings
40 years ago
this is an intel core microprocessor in
today's computer it has over a billion
transistors working at nearly 4
gigahertz so in in 40 years slightly
over 40 years the brain inside the
computer has gone from 2,300 transistors
to over a billion transistors it has
gone from a speed of 740 kilohertz to
close to 4 gigahertz well to put things
in context this is the homo sapiens
brain and this thing has about 100
billion neurons well it's an average
number on an average some of us have
some more and some less but it's it's a
pretty average number the thing about
these neurons are that they're rather
slow devices you know they respond in
milliseconds or in less than a kilo
Hertz so I'm going to simplify this
tremendously give or take we are
catching up with the nature as far as
the brain inside the computers go ok but
we have forgot something it's not just
all about the brain how about the senses
and the perception well that's a whole
different story
so take visual perception as an example
you know with with sophisticated 3d
visual system I'm showing a picture of
human visual system here and now it's
stereo image capture and very highly
parallel visual cortex in the brain we
perceive and see the world in 3
dimensions and thanks to that I can
reach out grab an object in
three-dimensional space manipulate it
move it around every time without making
a mistake it's critical to we are and
how we operate fossil records show that
the nature experimented with biological
systems with binocular vision about 300
million years ago during the
Carboniferous era and all indications
are that that was a homerun in the
evolutionary process by niccolò vision
was a critical attribute of the earliest
mammals and it's widely believed to be
the fundamental reason behind the
success of this evolutionary group so in
contrast here I'm showing the computing
devices of today they are simply
one-eyed monsters or the Cyclops of the
Greek mythology with rudimentary
two-dimensional vision they see a flat
projection of the reach
three-dimensional world and they discard
a wealth of visual information in the
process you cannot have natural
interactions with such rudimentary
visual capabilities okay so that's about
the visual system the same situation
applies to other perceptual sensors for
example the year and the hearing process
okay so we forgot to add this capability
and learn from the nature and develop
interactive systems we are changing that
with perceptual computing so in focused
on adding human-like senses to the
computing devices the eyes the ears
voice touch so that they will be able to
see hear understand like us and with
that they will be able to interact with
us so I would like to show some
demonstrations of some interactive cool
experiences that can be built with this
technology what you see on the screen if
I can go to the demo screen please so
here you see portal doodles
those of you who played portal 2 you
know it's a hugely popular first-person
puzzle game from pal right if you're
suppose to play that with with a
keyboard here you see a special version
of it enabled by Intel perceptual
computing technology in collaboration
with our partners at 6 cents so as I get
close
the system immediately recognizes my
hand and associates my hand with this
portal gun which I can move around in
the three-dimensional space as you can
see with a simple grabbing gesture I can
pick up the cube and then I can move
that cube in the three-dimensional space
left-right up-down
I can even rotate it around with six
degrees of freedom and in this episode
of the game I'm supposed to put it
inside that pedestal but let me try
always taking off and hitting the wall
so let's just go inside through this
hole align it over there on the pedestal
and drop it okay so now thank you
so those of you who have played portal 2
if I want if you know you'd know that if
I wanted to do this routine with the
keyboard I would have to wish I had 20
fingers so you know that experience was
natural and intuitive for me I was using
my natural resources there was no
keyboard mouse controller it felt
intuitive because I was manipulating the
cube as I would in the real world
it felt immersive because I felt I was
part of the content I was part of the
virtual world and the boundary between
the virtual world in the real world was
starting to blur let me show you another
demo so here if I can see on the screen
you see a treasure cave and I played the
route in build you see this copper
fountain that's viewing gold coins and
I'd like to go in and get some so let me
go in there
and see if I can collect some of those
coins I play with it can I move my
fingers throw them around
so that level of interaction where you
know I can go in and play with virtual
objects without having to move keyboard
in the mouse is phenomenal so this was
made possible by the three-dimensional
image capture device based on soft
kinetic technology and software that can
recognize fine grain ten finger
articulations in the 3d space we have
recently released the Intel perceptual
computing software developer kit that
includes this close range finger
detection algorithm alongside the 3d
camera but also speech recognition and
text-to-speech technology it includes
face recognition analysis and tracking
technology it also includes 2d and 3d
object tracking technology ok so and and
a set of API is or application
programming interfaces for all the
developers out there to develop
wonderful interactive applications based
on it so I'd like to show you just one
more demo it's tempting running out of
time but I'd like to show you just one
more so here you can see me and as I do
this demo I would feel really powerful
and it's ey so I've created the solar
system with a simple gestures of my hand
and you can see I can make it smaller
and make it bigger it's just the
beginning and you know we have seen
tremendous amount of traction with the
developers they're all developing very
exciting application concepts with it
you'll see it in the market the
computing devices that you know today
are going to be transformed with
perceptual computing when you add
interactive capabilities to the
computing devices it's going to be a
fascinating right I can hardly wait how
about you thank you
you