>>> GOOD MORNING, EVERYBODY. I'M
GOING TO GO AHEAD AND GET STARTED.
THIS IS AN INTRODUCTION TO MIXED
REALITY. NORMALLY I DO THIS DECK
AND WE HAVE IT PUT TOGETHER, AND
IT TAKES ABOUT AN HOUR. I HAVE 20
MINUTES SO I REDUCED IT A LITTLE
BIT. WE'RE GOING TO COVER A FEW
POINTS HERE. WHY AM I TALKING TO
YOU? AND THEN WHY? WHY AM I INTERESTED
IN TALKING TO YOU? AND WHY NOW?
SO WHY IS NOW AN IMPORTANT TIME
FOR YOU TO GET STARTED WITH MIXED
REALITY? AND FINALLY, HOW DO YOU
GET STARTED? SO WHY ME? MY NAME
IS JESSE McCULLOCH. I GET TO TALK
TO DEVELOPERS AND MAKE SURE I HAVE
A GOOD PATH OF COMMUNICATION TO
COMMUNICATE MICROSOFT'S MESSAGE
TO DEVELOPERS. BUT ALSO DEVELOPERS
HAVE A GOOD PATH OF COMMUNICATION
BACK TO MICROSOFT SO WE CAN GET
FEEDBACK AND BUILD YOUR FEEDBACK
INTO THE PRODUCT. THIS IS MY THIRD
BUILD. BUT MY FIRST AS A MICROSOFT
EMPLOYEE. MY FIRST ONE WAS TWO BUILDS
AGO. AND I THINK IT CAME HERE JUST
AS AN ATTENDEE AND HAD A GREAT EXPERIENCE.
AND GOT INTRODUCED TO THE MIXED
REALITY TEAM. REALLY INVOLVED A
COUPLE YEARS BEFORE THAT AND DECIDED
TO MAKE A JOB OF IT. AND I'LL TALK
ABOUT THAT IN A LITTLE BIT. AND
LAST YEAR, I WORKED WITH THE MICROSOFT
TEAM AND WE PUT A SUB CONFERENCE
ON. THAT WAS ALL AROUND MIXED REALITY
HERE AT BUILD. AND NOW I'M HERE
ACTUALLY AS AN EMPLOYEE. SO HISTORY
WORKING BACKWARDS. I STARTED AT
MICROSOFT ABOUT SEVEN MONTHS AGO.
PREVIOUS TO THAT, I WAS A FREELANCE
MIXED REALITY DEVELOPER. THIS IS
ME WITH ALEX WHO INVENTED THE HOLOLENS
AND ONE OF THE PRIMARY INVENTORS
FOR CONNECT. PREVIOUS TO THAT, I
WAS A TECHNICAL CONSULTANT. WORKING
ON SERVER SIDE JAVA SCRIPT FRAMEWORK,
THAT WAS ABOUT 20 YEARS OLD BEFORE
IT WAS REALLY A THING. BEFORE THAT,
I WAS IN TECH SUPPORT FOR A COMPANY
CALLED IHS. AND BEFORE THAT, I WAS
A MOUNTAIN RESCUE EMT. SOME OF THE
THINGS YOU WON'T NOTICE ON THERE.
NOTHING ABOUT COLLEGE. NO GAME STUDIOS.
NO 3D ARTIST TRAINING. THIS IS TECHNOLOGY
THAT'S ACCESS TO BELIEVE EVERYBODY.
WHICH BRINGS US TO MY NEXT POINT
OF WHY YOU. I SPECIFICALLY WANT
YOU GUYS TO GET INVOLVED WITH MIXED
REALITY BECAUSE WE HAVE TOOLS FOR
EVERYBODY, NO MATTER WHAT TECHNOLOGY
STACK YOU'RE WORKING ON. AND NO
MATTER WHAT YOUR INTERESTS ARE.
SO RIGHT NOW, OUR STACK AT THE VERY
BOTTOM, WE HAVE DEVICES SO THINGS
LIKE THE AZURE CONNECT. WE HAVE
THE MIXED REALITY HEADSETS, VR HEADSETS,
NEW HOLOLENS TOO. AND THINGS LIKE
DRONES AND PHONES, ALL OF THESE
DEVICES HAVE RICH SENSORS ON THEM
AND ARE PART OF THE AZURE CLOUD
MIXED REALITY CLOUD AND EDGE STORY.
ON TOP OF THOSE DEVICES, WE HAVE
THE SERVICES THROUGH AZURE. AZURE
DIGITAL TWIN, AZURE SPATIAL ANCHORS
AND AZURE REMOTE RENDERING. ON TOP
OF THAT, WE HAVE THE MORE GENERALIZED
COGNITIVE SERVICES, THE SPEECH AND
VISION SERVICES THAT LET YOU DO
FACIAL RECOGNITION OR SPEECH LANGUAGE
RECOGNITION AND WHATNOT. AND THEN
BUILT ON TOP OF THAT, WE HAVE A
REALLY RICH PARTNER ECOSYSTEM AND
A DYNAMICS 365 OFFERING SO. NO MATTER
WHAT YOU ARE DOING, FOR YOUR BUSINESS,
WE'VE GOT A SPACE FOR YOU. AND WE'VE
GOT TOOLS FOR YOU. SPECIFICALLY
LOOKING AT OUR AZURE SERVICES. THINGS
LIKE OUR MIXED REALITY OR AZURE
SPATIAL ANCHORS LET'S YOU PLACE
DIGITAL CONTENT IN THE REAL WORLD
AND HAVE IT PERSIST ACROSS PLATFORM
SO WORKING WITH HOLOLENS, HOLOLENS
2 AND PHONES AND TABLETS SO. IF
YOU HAVE A BUSINESS USE WHERE YOU
NEED DIGITAL CONTENT TO LIVE IF
A SPECIFIC PLACE, WE REALIZE THAT
NOT EVERYBODY NEEDS A $3, 000 HOLOLENS
ON THEIR HEAD TO GET THEIR JOB DONE.
WE CAN DO IT WITH A PHONE OR TABLET.
WE HAVE TOOLS FOR THAT. SAME WITH
THE COGNITIVE SERVICES. THESE ARE
VALID ACROSS ALL DEVICES, WHETHER
A PHONE OR A PC OR A HEADSET OF
ANY SORT. WE ALSO LET YOU BUILD
WITH THE TOOLS THAT YOU CHOOSE AND
WHAT YOU ARE ALREADY USING. IF YOU
GUYS ARE C++ DEVELOPERS, OUR OPEN
XR AND DIRECT INTEGRATIONS WILL
LET YOU BUILD FOR MIXED REALITY.
IF YOU ARE A AR CORE AND AR KIT
DEVELOPER, WE'VE GOT SERVICES THAT
WORK WITH YOUR MIXED REALITY THERE.
IF YOU ARE ON LINUX, WE SUPPORT
YOU THERE. IF YOU'RE VISUAL STUDIO
OR UNITY OR UNREAL, NO MATTER TOOL
SET YOU ARE ALREADY BUILDING ON,
WE HAVE SOLUTIONS FOR AND WAYS FOR
YOU TO BUILD FOR MIXED REALITY.
SO THE SOONER WE CAN GET YOU ON
TO THIS SET, THE BETTER. SO WHY
NOW? WE REALLY VIEW MIXED REALITY
AS THE THIRD PLATFORM. THE FIRST
WAS PERSONAL COMPUTERS. BACK IN
THE MID70s. HIRED A COUPLE GUYS
TO BUILD AND PORT THEIR MS BASIC
SYSTEM OVER. THERE WAS A COUPLE
GUYS TURNED AROUND AND BUILT MICROSOFT
FROM THAT. THAT WAS KIND OF THE
FIRST WAY OF PERSONAL COMPUTING.
WE SAW THEM MOVE FROM BUSINESSES
WHERE MOST PEOPLE PRI MIRLY INTERACT
WITH PC AND -- PRIMARILY INTERACT
WITH PCs AND INTO HOMES. THE SECOND
WAVE IS THE ONE WE'RE MOSTLY IN
RIGHT NOW, SMART PHONES ARE HUGE
TO MAKE YOU ACROSS THE WORLD. EVERYBODY
HAS A SMART PHONE AND COMPUTER IN
THE POCKET AND IT MADE TECH SUPER
ACCESSIBLE. AND WE SEE MIXED REALITY
AS BEING THIS THIRD OF WAVE OF COMPUTING
WHERE WE'RE USING THE DEVICES THAT
HAVE RICH SENSOR SETS TO TALK TO
THE CLOUD AND SERVICES UP THERE
THAT CAN UNDERSTAND THE WORLD AROUND
THEM AND THEN TAKE THAT UNDERSTANDING
AND FEED IT BACK OUT TO THE DEVICES
TO ENRICH EXPERIENCES. WE'RE LOOKING
IN THE NEXT SIX YEARS, ABOUT $144
BILLION IN MARKET CAPACITY THAT
WE SEE. THIS IS BASED ON A STUDY
THAT MICROSOFT DID WITH AN INDEPENDENT
RESEARCH COMPANY. RIGHT NOW, WE'RE
VERY MUCH IN THE ENTERPRISE TASKS
AND PROCESSES SPACE. THIS IS WHERE
WE GET A LOT OF THE SIGNAL RIGHT
NOW. BUT WE DEFINITELY ARE STARTING
TO SEE SOCIAL ENTERTAINMENT AND
PRODUCTIVITY AND COLLABORATION.
IF YOU SAW THE SPATIAL DEMO ON STAGE
YESTERDAY OR AT THE BOOTH, THEY'RE
FITTING NICELY INTO THE PRODUCTIVITY
AND COLLABORATION SPACE. SO THERE'S
LOTS OF MONEY STILL TO BE MADE IN
THE SPACE. WE HAVE A WHOLE BUNCH
OF PARTNERS. TO US, A WHOLE BUNCH
OF PARTNERS I SHOULD SAY. ABOUT
130 IN THE MIXED REALITY PARTNER
PROGRAM. WHEN YOU LOOK AT THAT ACROSS
OTHER MICROSOFT PLATFORMS, 130 PARTNERS
IS NEXT TO NOTHING. SO THERE IS
A LOT OF SPACE FOR YOU GUYS TO COME
IN AND BUILD A BUSINESS IN THIS
MIXED REALITY WORLD. SO HOW DO YOU
GET STARTED? I'M GOING TO LEAVE
YOU WITH ONE SHORT QUICK LINK. FROM
THERE, YOU CAN GO AND REGISTER INTEREST
FOR THE DEVELOPER PROGRAM. THIS
WILL LET US KNOW MORE ABOUT YOU
AND YOUR PROFILE. AND GIVE US PERMISSION
TO CONTACT YOU WHEN WE HAVE EVENTS
COMING UP. WE HAD AN EVENT LAST
WEEK, MR DEV DAYS, 400 DEVELOPERS
FROM AROUND THE WORLD COME TO THE
MICROSOFT CAMPUS AND SPEND TWO DAYS
WITH OUR ENGINEERS. IT WAS A REALLY
GREAT TIME. THEY GOT HANDS-ON TIME
WITH HOLOLENS AND AZURE. AND ONE
DEVICE AVAILABLE, HOLOLENS 2, WE
ANNOUNCED AT MOBILE WORLD CONGRESS
THIS YEAR. AND SO AS THE DEVICES
START SHIP, IT WILL BE THROUGH THE
CHANNELS THAT WE LET YOU GUYS KNOW.
FROM THAT LINK, WE CAN ALSO GET
YOU -- WE ALSO SEND YOU OUT TO WHERE
YOU CAN BUILD FOR THE DIFFERENT
SERVICES SO SPATIAL ANCHORS IN PUBLIC
PREVIEW RIGHT NOW. YOU CAN USE IT
TODAY, PUBLISH APPS WITH IT AND
IT'S FANTASTIC. AND WE HAVE A LOT
OF TUTORIALS AND QUICK STARTS FOR
THESE. AZURE REMOTE RENDERING LET'S
YOU REMEMBEREDDER SUPER HIGH-QUALITY
HOLOGRAMS TO PHONES AND HOLOLENS.
THAT IS IN PRIVATE PREVIEW BUT YOU
CAN SIGN UP FOR MORE INTEREST THERE.
AND MARRY YOUR DATA FROM THE MACHINES
AND IoT SENSORS IN THE COMPANIES
TO THOSE MACHINES AND BE ABLE TO
VIEW THEM THROUGH MIXED REALITIED
AND THAT'S ALSO AVAILABLE THERE.
AND THEN IT ALSO POINTS TO YOU THE
DOCUMENTATION. WE HAVE A TON OF
DOCUMENTATION SAMPLES. IT'S OPEN
SOURCE. I'M IN CONTROL OF THE REPOSITORY.
I MAKE UPDATES ALMOST DAILY. AND
SO WE WOULD LOVE TO GET YOU IN AND
WORKING ON THIS. AND WORKING WITH
US TO BUILD THE PLATFORM AND YOU
KNOW, ELEVATE THE ENTIRE THING.
SO I KNOW I WENT WAY FASTER THAN
I WAS EXPECTING TO. I USUALLY DO
THAT. IF YOU HAVE QUESTIONS, I AM
MORE THAN HAPPY TO ANSWER QUESTIONS
NOW. NOBODY HAS QUESTIONS ABOUT
MIXED REALITY? XAMARIN SUPPORT,
YES. SO XAMARIN HAS A MIXED REALITY
ENGINE CALLED ERO SHARP. SO YOU
CAN USE XAMARIN AND DEPLOY OUT TO
THE HOLOLENS AND HOLOLENS 2 WITH
IT. AR? YEAH, SO I DON'T KNOW IF
IT WORKS WITH AR CORE. I'M NOT SURE.
I WILL GET YOUR INFORMATION AND
GET BACK TO YOU ON THAT. YEAH. MACHINE
LEARNING? GREAT QUESTION. SO THE
QUESTION IS, ARE MACHINE LEARNING
MODELS SUPPORTED ON HOLOLENS? YES.
LAST YEAR WE RELEASED THAT YOU COULD
RUN DIRECTLY ON HOLOLENS. I'M NOT
SURE ON HOLOLENS 2. I KNOW WE'VE
BEEN AI CHIP ON THERE, BUT I'M NOT
SURE HOW EXPOSED THAT IS. SO I WILL
GET BACK TO YOU ON THAT. AND WE
ALSO HAVE AN FAQ ON OUR DOCUMENTATION.
SO I WILL MAKE SURE THAT THE QUESTIONS
END UP ON THE FAQ SO EVERYBODY HAS
THE ANSWERS TO THEM AS WELL. ANY
OTHER QUESTIONS? DIGITAL TWINS,
YES. SO DIGITAL TWINS IS A WAY TO
RECREATE YOUR PHYSICAL ENVIRONMENT
AND OVERLAY YOUR DATA FROM PHYSICAL
MACHINES INTO THAT ENVIRONMENT.
AND THEN BE ABLE TO VIEW IT THROUGH
EITHER A PHONE OR A TABLET OR A
AR HEADSET. SO IF YOU'RE SAY IN
A MANUFACTURING FACILITY AND YOU
HAVE A BUNCH OF MACHINES ALL INSTRUMENTED
WITH IoT SENSORS, WHAT DIGITAL TWINS
WILL LET YOU DO IS GO THROUGH AND
LAY OUT THE DATA ON TOP OF THE MACHINES
IN A NICE LAYOUT AND PERSIST THEM
SO THAT AS A SUPERVISOR, YOU MIGHT
COME BAY BIAND SEE THE DATA FROM
THE IoT SENSORS DIRECTLY IN CONTEXT
OF THE MACHINE THAT YOU'RE LOOKING
AT. WHY IS IT CALLED TWINS? SO YOU'RE
RECREATING THE PHYSICAL ENVIRONMENT
IN A DIGITAL WAY. AND MARRYING THEM
TOGETHER. SO YOU'RE ALMOST LIKE
CREATING A DIGITAL REPLICATION OF
YOUR ENVIRONMENT. YEP. ANY OTHER
QUESTIONS? SO THE QUESTION WAS,
FOR THIS TO BE THE THIRD WAVE OF
COMPUTING, THE COST SEEMS REALLY
HIGH AND HOW DO WE WORK THROUGH
THAT AND MAKE IT MORE AFFORDABLE
AND MORE AVAILABLE TO DEVELOPERS
AND ENTERPRISES? YES, ABSOLUTELY
TRUE. I WOULD SAY THAT WWE HAD THIS
PROBLEM IN EVERY -- THAT WE'VE HAD
THIS PROBLEM IN EVERY WAVE OF COMPUTING.
THE ORIGINAL PCs WERE NOT $400.
THEY WERE MULTI-THOUSANDS OF DOLLARS.
SO AS THE TECHNOLOGY EVOLVES AND
THE PROCESS OF MANUFACTURING THEM
GETS CHEAPER AND ALSO YOU GET SCALES
OF ECONOMY, THE PRICES WILL COME
DOWN. WE DID JUST ANNOUNCE THE DEVELOPERS
SKU FOR HOLOLENS 2 LAST WEEK. WHICH
ACTUALLY HAS AN OPTION FOR A PAYMENT
PLAN-TYPE SO THAT THE BARRIER OF
ENTRY IS LOWER INSTEAD OF HAVING
WHAT THE ORIGINAL HOLOLENS WAS $3,
000 UP FRONT. I KNOW BECAUSE I BOUGHT
ONE. YOU KNOW, HAVING A PAYMENT
PLAN OPTION LOWERS THAT BARRIER
OF ENTRY AND LET'S PEOPLE NOT HAVE
TO FRONT THE MONEY UP FRONT. ANY
OTHER QUESTIONS? NOT HOLOLENS LIKE
PHONES AND TABLETS AND WHATNOT?
THE VR HEADSETS. OKAY SO THE QUESTION
IS WHERE DO OTHER NON-HOLOLENS DEVICE
FIT INTO THE ECOSYSTEM? LIKE VR
HEADSET, TABLETS AND WHATNOT. REALLY
COMES DOWN TO THE RIGHT TOOL FOR
THE RIGHT JOB. YOU CAN HAVE EXTREMELY
IMMERSIVE THINGS HAPPEN IN A VR
HEADSET AND IT DOESN'T MAKE SENSE
TO DO IN AN AR HEADSET. SOMETIMES
YOU WANT TO BE DEEPLY IMMERSED IN
THAT ENVIRONMENT. BUT WANTING TO
INTERACT WITH THE PHYSICAL WORLD
WHERE YOU HAVE ITEMS THAT ARE PLACED
ON A SURFACE OR ARE INTERACTING
WITH THE REAL WORLD OBJECT, THEN
AR MAKES MORE SENSE. AND WITH AR
AGAIN, IT'S THE RIGHT TOOL FOR THE
JOB. A FRONT LINE MANUFACTURING
WORKER WHO MAY NEED BOTH HANDS TO
WORK, IT ABSOLUTELY MAKES SENSE
TO THEM V THEM IN THE HEADSET. A
SUPERVISOR LOOKING AT DATA, MAYBE
HAVE A TABLET WHICH IS A MUCH CHEAPER
OPTION FOR THEM TO VIEW THE SAME
DATA. THIS IS WHY IT'S IMPORTANT
TO HAVE THE CROSS PLATFORM TOOL
SET AND ALLOW YOU GUYS TO DECIDE
WHAT THE BEST TOOL FOR THE JOB IS
NO MATTER WHAT THAT JOB IS. ANYTHING
ELSE? FIELD OF VIEW. IT'S BIGGER.
SO HOLOLENS 1, WE PUT IT OUT THERE.
GOT A LOT OF FEEDBACK. SOME OF THE
FEEDBACK IS THE FIELD OF VIEW IS
TOO SMALL. DEPENDING ON WHO YOU
TALK TO, YES AND NO. BUT IT WAS
UNIVERSAL FEEDBACK WE GOT. SO ONE
OF THE THINGS WE DID WITH HOLOLENS
2 IS INCREASE THE FIELD OF VIEW,
NOW 52 DEGREES DIAGONALLY. IT DOUBLES
THE ACTUAL AREA. AND IT'S GREAT.
AND I SUGGEST THAT IF YOU WANT TO
SEE IT FOR YOURSELF, WE ARE DOING
HOLOLENS 2 DEMOS IN THE BACK OF
HALL DF. YOU KNOW, A LOT OF THE
STUFF WITH HOLOLENS 2 THAT WE MADE
IMPROVEMENTS ON WAS BASED ON DIRECT
FEEDBACK FROM HOLOLENS 1. WHEN YOU'RE
IN A DEMO SPACE, THE VOICE COMMANDS
DON'T WORK. SO WE PUT MICROPHONES
ON THE BOTTOM SO WE GET BETTER SOUND.
THE VOLUME OFF, SO YOU COULDN'T
HEAR WHEN WE HAD AUDIENCES EXPERIENCES
SO WE UPPED THE VOLUME. FIELD OF
VIEW IS BIGGER. SO ALL THE FEEDBACK
WE GET FROM THE PREVIOUS GENERATION
OF DEVICE, WE FEED INTO THE DESIGN
OF THE NEW GENERATION. AND HOPEFULLY
WE CONTINUE TO DO THAT. AND KEEP
MAKING BETTER, AND BETTER DEVICE.
ANYBODY ELSE? THANK YOU GUYS FOR