BEEN LOOKING FORWARD TO ALL DAY.
PLEASE WELCOME KATJA HOFFMAN. >>
>> HI. HI. THANK YOU FOR JOINING
DIGITAL STREAM. WE ARE WELL UNDER
TELL US WHAT YOU DO AT MICROSOFT?
CAMBRIDGE HERE IN THE UK. WE SEE
OF THE ART IN MACHINE LEARNING,
TO ENABLE FUTURE APPLICATIONS WHERE
IN THE VIDEO GAME SPACE. >> VERY
I GO TO MICROSOFT RESEARCH CAMBRIDGE
TRYING TO GET MYSELF AN INVITE.
WHAT EVERYONE IS WORKING ON. IT'S
AND WHAT THEY'RE DOING. NOW, I KNOW
OTHER PARTS OF MICROSOFT, BUT BEFORE
OF THE SESSION, YOU TALK ABOUT REINFORCEMENT
ARE SUPER SPECIALISTS IN THAT SPACE,
IN OUR DEVELOPER AUDIENCE? >> ABSOLUTELY.
TYPE OF MACHINE LEARNING WHERE WE
IS EMBODIED IN SOME ENVIRONMENT.
TAKING ACTIONS AND LEARNING ABOUT
SO IT'S FASCINATING FOR TWO REASONS
TRIAL-AND-ERROR LEARNING THAT INTUITIVELY
WE DO AS HUMANS. AT THE SAME TIME,
FOUNDATIONS, THERE'S A REALLY PRINCIPLE
OPTIMIZATIONS IN COMPLEX ENVIRONMENTS.
POWERFUL TECHNIQUE. SO WHAT I'M
AS IT BECOMES MORE WIDELY AVAILABLE,
SOME THAT WE CAN ENVISION AND MANY
DEVELOPERS WHEN THEY GET ACCESS
THING I WANTED TO CONNECT THIS TO,
SIDE, WHAT IS EXCITING ABOUT BEING
HAVE ROOTING IN THE COMMUNITY WORKING
OF THE ART AND DEVELOPING NEW TECHNOLOGY.
THESE COLLABORATIONS BRANCHING OUT
TEAMS ACROSS MICROSOFT TO UNDERSTAND
BE TAKEN A STEP FURTHER, DEMOCRATIZED,
WORLDWIDE. >> AMAZING. FROM WHAT
MACHINE LEARNING COMMUNITY, IT'S
A LOT OF DATA AND UNDERSTANDING
ENVIRONMENT CAN BE, A WORLD, FOR
REINFORCEMENT LEARNING COMING OUT
TO HIT THE MAINSTREAM WITH OUR DEVELOPER
SERVICE WITH THE PERSONALIZED SERVICE,
TO FRUITION AND PEOPLE BEING ABLE
BEEN COLLABORATING. WHO HAVE YOU
MICROSOFT? IT'S AN EXCITING COLLABORATION
WITH A TEAM. WE'VE COLLABORATED
TRY AND UNDERSTAND WHAT IT MEANS
A MUCH BROADER AUDIENCE TO DEVELOPERS.
AZURE REINFORCEMENT LEARNING, WHICH
CAN GO AND CAN TRY OUT REINFORCEMENT
WHAT THIS TECHNOLOGY MEANS AND HOPEFULLY
THAT MAKE USE OF THIS POWERFUL TECHNOLOGY.
I DON'T WANT TO WISH AWARE OUR TIME
IT MYSELF. I KNOW WE HAVE AMAZING
CAN FOLLOW ALONG. TALK TO ME ABOUT
IS THAT PART OF THE STORYLINE? >>
REALLY COMES BACK AND CONNECTS TO
AND CONSTANTLY KIND OF CHALLENGING
HOW WE CAN BOTH PUSH THE STATE OF
AND AT THE SAME TIME BRING WHATEVER
DEVELOPERS. WE RELEASED THIS ALMOST
WAS A PLATFORM FOR AI EXPERIMENTATION
MINECRAFT WHERE OUR GOAL WAS TO
REINFORCEMENT LEARNING TO USE MINECRAFT
OWN EXPERIMENTS AND GET STARTED
AND PUSHING THE STATE OF THE ART
YOU AN EXAMPLE THERE. FROM THE RESEARCH
MINECRAFT, AS A GAME, STARTS PUSHING
PUBLISHED A PAPER AT THE CONFERENCE
IS ONE OF THE ACADEMIC CONFERENCES
AND TRIED TO UNDERSTAND HOW WE COULD
IT WOULD MORE EASILY AND QUICKLY
EXAMPLE, DETERMINING IF IT NEEDED
THIS IS JUST ONE EXAMPLE OF HOW
AND MANY IN THE RESEARCH COMMUNITY
PUSH THIS STATE OF THE ART. WHAT
AZURE MADE TODAY IS NOW THAT EVERY
LEARNING ABOUT REINFORCEMENT LEARNING
CAN TRAIN YOUR VERY OWN AGENT THAT
HOW TO NOT DIE IN LAVA AS MUCH.
BEEN ABOUT FOUR YEARS AGO THAT I
LITERALLY ON THE SCREEN -- I THINK
SO IN THE RIGHT PLACE HERE IN TECHNOLOGY
AGENT AROUND A MAZE. IT'S A BIT
LEARN. IT RUNS INTO THE FIRE AND
BEING REWARDED. I LOVE WE'VE INTEGRATED
EXAMPLES. I GO AND LOOK AT THE DOCS,
BUILD THIS SAMPLE, BUT IT'S THAT
TO BUILD ON RATHER THAN A BLANK
I THINK WE HAVE A SHORT LINK WHERE
TO FIND THESE BITS OF DOCUMENTATION.
YOU'VE BEEN WORKING WITH THE TEAM.
A LOT OF THE RESEARCH YOU DO AND
LEARNING. WHY IS MINECRAFT SUCH
LEARNING? WHY HAVE YOU FOUND IT
QUESTION, AMY. THIS GOES BACK TO
WE STARTED THIS PROJECT. WE WERE
WOULD ALLOW US TO KEEP PUSHING THE
LEARNING FOR MANY, MANY YEARS, EVEN
BEING AN OPEN-ENDED GAME, ONCE WE
CLEAR THAT THIS IS THE IDEA PLATFORM
SET OF INSIGHTS THAT MORE GENERAL
THAT I LIKE PARTICULARLY ABOUT MINECRAFT.
OPEN-ENDED NATURE. SO YOU CAN START
STRAIGHTFORWARD THAT CAN BE EASILY
LIKE THE MINECRAFT MAZE. AT THE
WORLD FOR THE EXPERIMENT. YOU CAN
WOULD IT TAKE TO HAVE AN AGENT LEARN
MINING RESOURCES LIKE WHAT WE RUN
YEAR ALL THE WAY UP TO UNDERSTANDING
WITH HUMAN PLAYERS. SO THE SECOND
ABOUT IS THAT IN A GAME LIKE MINECRAFT,
INTO THIS ENVIRONMENT ON A KIND
ALLOWS US TO DRIVE RESEARCH ALONG
WITH HUMANS. SO OUR LONG-TERM GOAL
TECHNOLOGY THAT ALLOWS US TO DEVELOP
UNDERSTAND WHAT OUR HUMAN PLAYER
HOW TO EFFECTIVELY SUPPORT OR IN
GOALS. SO MINECRAFT OPENS UP ALL
WE'RE SO EXCITED ABOUT IT. >> IT'S
AS SUCH AN AMAZING ENVIRONMENT FOR
I LOVE THE IDEA THAT THIS IS FUTURE-LOOKING
THERE'S SO MANY THINGS YOU CAN DO
AS WELL, ON WE SPOKE ABOUT REINFORCEMENT
IT INSIDE CLOUD SERVICES. WHERE
BEING USED IN THE INDUSTRY? ARE
EARLY? >> AGAIN, A FANTASTIC QUESTION
THAT ARE ALREADY WIDELY USED ACROSS
THAT YOU ALREADY MENTIONED. AS PART
OF REINFORCEMENT LEARNING FOR PERSONALIZATION.
THAT THE AUTONOMOUS SYSTEMS GROUP
IS USED FOR INDUSTRIAL CONTROL.
APPLICATION AREAS. I'M CONVINCED
SUCH A GENERAL TECHNOLOGY, THERE'S
SOME OF WHICH WE CAN'T EVEN IMAGINE
FOR APPLICATIONS AND VIDEO GAMES,
EXCITING AND INFLUENTIAL KIND OF
BECAUSE IT KIND OF ALLOWS US TO
WITH BUILDING UP TOWARDS OTHER APPLICATIONS.
THIS IDEA OF HAVING AGENTS THAT
PLAYERS, ONCE WE UNDERSTAND THE
TAKING THAT, FOR EXAMPLE, INTO THE
TRANSLATING THIS TECHNOLOGY INTO
FINALLY, I'M ALSO SUPER EXCITED
DEVELOPERS MIGHT COME UP WITH. EVERYONE
OWN NEEDS. I'M SURE THERE ARE MILLIONS
EVEN THOUGHT OF YET. >> THAT'S AMAZING.
QUICK POLL ON HOW TO ENCOURAGE PEOPLE
TO THE SPACE, THEN THEY WILL HOPEFULLY
HAD PEOPLE THAT ARE VERY, VERY POSITIVE
LEARNING WITH MINECRAFT. SO THANK
BEEN AN ABSOLUTE PLEASURE TO SPEAK
YOU'RE DOING WITH THE AZURE LEARNING
ME. >> IF YOU WOULD LIKE TO LEARN
>> WE HAVE AZURE SYNAPSE ANALYTICS,
WAREHOUSE. YOU HAVE THE BEST CAMERA
>> I KNOW. IT'S SO EARLY WHERE YOU
FOR JUMPING ON THE STREAM. LOTS
AT MICROSOFT HAVE BEEN GETTING UP
OWN CHRISTINA. A HUGE THANK YOU
ZONE. >> IT'S MY PRIVILEGE. >> LET'S
YOU DO AT MICROSOFT. >> I LOVE THIS
WHAT I DO. THERE ARE THREE THINGS
IT'S ONE OF THE THINGS THAT -- WE
THERE FROM DAY ONE. THIS IS A COMPLEX
MOVING PARTS, AND MY TEAM HELPED
COMPONENTS THAT REALLY MAKES USER
OF. THAT NUMBER TWO, LIKE MANY OF
I'M REALLY DRIVEN BY NUMBERS AND
NUMBERS AND SEEING THE SIGNALS FOR
PRODUCT TELEMETRY TELLS US, WE TEST
AND ACTION THAT. I LOVE OPERATING
THAT SHOULD BE DOING THAT. FINALLY,
VERY DEEPLY PROUD OF. IT ISN'T JUST
VILLAGE. WE BUILT A WORLD CLASS
ABOUT THE UX DESIGNERS AND PROJECT
PEOPLE. THEY'RE SUPER PASSIONATE,
OTHER. MOST IMPORTANTLY, WE BUILD
FROM THE GREAT CULTURE, YOU GET
AND FROM OUR BUSINESS. >> TOTALLY
TEAM TO BE ON, WHICH IS AMAZING.
I GUESS, FIRST THINGS FIRST, WE
THE STREAM, BUT WE MIGHT ALSO HAVE
BREAK DOWN WHAT IS AZURE SPIN-UPS
MENTIONED BEFORE, WE'VE EVOLVED
IN ONE WAY, IT'S ANALYTICS THAT
AND BIG DATA. THINK ABOUT THE CHALLENGE
THEY'RE TRYING TO BUILD AN ANALYTICS
BUSINESS. THEY'RE STRUGGLING WITH
FORMATS, TYPE SYSTEM SECURITY MODELS,
UP IS REALLY DAUNTING. SO AZURE
ONE QUESTION: HOW DO I DO ANALYTICS
THAT'S HOW YOU DO ANALYTICS IN AZURE.
ONE EXPERIENCE, ONE SECURITY MODEL
ON ANY SCALE. ONE OF MY COLLEAGUES
TO MANY. IT'S ONE TO ANY. I LOVE
WITH ANY DATA YOU HAVE. THERE ARE
SQL ANALYTICS, DOING ANALYTICS WITH
WITH. APACHE SPARK, DOING ANALYTICS
DATA INTEGRATION AND ORCHESTRATION.
WEB NATIVE USER EXPERIENCE. THOSE
ANALYTICS. THE SQL ANALYTICS PART
BEFORE. GOING FORWARD, WE'RE MERGING
>> I LOVE THAT. IT'S SO MUCH, I
WE SAW AZURE SYNAPSE ANALYTICS RELEASED
SUCH AN EXCITING PRESENTATION, THAT
AND WAS LIKE, WHAT IS GOING ON?
WHAT HAS HAPPENED SINCE IGNITE 2019.
THE NEW BRANDING. THAT'S PART ONE.
WE REVEALED WAS THE PREVIEW OF THE
CALLED SYNAPSE WORKSPACES. THAT'S
BRINGS TOGETHER SQL ANALYTICS, SPARK,
WAS AMAZING. WE GOT TREMENDOUS AMOUNTS
CUSTOMERS LOVE THE CONCEPTS, THE
SOLVE THEIR PROBLEMS. AND THEIR
WE DID AT IGNITE WAS LAUNCH A PREVIEW
FOR THE LAST SIX MONTHS. WHAT WE'VE
AND LISTENING AND RESPONDING. SO
CICD, PLATFORM, MONITORING, METADATA
WE DEFINE THE USER EXPERIENCE. THAT'S
VERY, VERY NICE. IT ALLOWS YOU TO
AND HOW IT WORKS AND WHAT PEOPLE
IS ONE OF THOSE AMAZING PIECES OF
WHAT IS NEW AT BUILD? I THINK I
I WILL LET YOU REITERATE FOR US.
THING, HONESTLY, IS WE WERE IN PRIVATE
THE CALL TO ACTION: GO IN AND TYPE
ENTRY. CLICK ON IT. YOU WILL ANSWER
ACCOUNT. AND IN ABOUT FIVE MINUTES,
SPARK ANALYTICS, STUDIO, AND PIPELINES
NOW, THAT'S THE MAJOR ANNOUNCEMENT.
THAT HAVE BEEN ADDED OR IMPROVED.
WITH YOU. NUMBER ONE, WE'VE MADE
SQL WORLD AND THE SPARK WORLD THROUGH
MADE MASSIVE STRIVES IN MONITORING
WE'VE REALLY STRENGTHENED OUR SECURITY.
MODEL. WE HAVE IMPROVED OUR POWER
MAJOR ANNOUNCEMENTS YESTERDAY, I
WE INTRODUCED SYNAPSE LINK WHICH
TO DATA THAT'S IN OUR TABLES AND
AND DATALAKE STORE, WE'RE TALKING
THAT'S HUGE. AGAIN, WE WANT TO BE
YOU HAVE IN AZURE. OF COURSE, IT
PART OF THE EXPERIENCE THAT MAKES
GOING TO SAY WHEN I SAW THAT IN
WRITING DOWN IN MY NOTEBOOK THAT
YOU FOR BRINGING THAT ONE UP. IT'S
IN EVERY AREA OF THE PIPELINE, WHETHER
OR THE FEEDBACK MECHANISM FOR UNDERSTANDING
BETWEEN SQL AND SPARK, NO LONGER
THESE ALL TOGETHER. I GUESS ONE
IF YOU DON'T MIND S DO YOU HAVE
ANALYTICS? >> I DO. IN THE FEW MINUTES
JUST A TASTE OF WHAT WE REALLY HAVE.
ICEBERG. THERE'S SO MUCH THERE.
AT. YOU'RE SEEING SYNAPSE STUDIO,
IT ALL TOGETHER. SYNAPSE STUDIO
THIS IS JUST WHERE YOU'RE GOING
KINDS OF TOPICS. WE'RE IN THE HOME
IS TO LEAD A USER AROUND THE PROCESS
MODELED SOME OF THOSE. EXPLORE THE
WITH SPARK AND VISUALIZE WITH POWER
HEAVILY ON THE EXPLORE AND ANALYZE.
THE WORLD OF SQL AND SPARK COMING
THERE ONE EXPERIENCE. YOU'RE GOING
SEAMLESS AND EASY IN THESE TWO CASES.
FIRST HUB, WHICH IS CALLED DATA.
DATA. WE HAVE, LIKE, 90 CONNECTORS,
AS WELL AS CLOUD SOURCES. WE LAND
THEM IN MY ACCOUNT. IT'S THE FAMOUS
EXPORTED IT IN TWO VERY COMMON FORMATS.
WHICH IS POPULAR IN THE SPARK WORLD.
WITH NOTEBOOK, THAT'S WHERE SPARK
A NOTEBOOK I BUILT. YOU WILL GET
HAS TWO CELLS IN IT. THE FIRST CELL
SPACE HERE. IT'S ESSENTIALLY A SINGLE
WITH SPARK A PARKAY FILE. THIS READS
ARE ONE-LINERS. WHAT YOU SHOULD
TO WRITE ABOUT SECURITY. I DIDN'T
AUTHENTICATION WORKED BECAUSE OF
IN BOTH OF THESE CASES, I DIDN'T
CASE, IT'S IN THE FILE. DATA ABILITY
THE EXPLORATION PHASE OF USING DATA.
SPARK. WE'VE MADE IT SEAMLESS IN
SQL WORLD BECAUSE IN THE SQL WORLD,
VERY DIFFERENT. I'M GOING TO OPEN
NOW, WHAT YOU MIGHT HAVE DONE IN
CREATE AN EXTERNAL TABLE IN A DATA
ALL OF THESE OBJECTS JUST TO READ
LOOK AT THE FIRST LINE. SELECT TOP
FILE NAME, THE PARCAY FILE. IT HAS
SPARK WORLD. IT'S ONE-LINER. AUTHENTICATION
COURSE, THIS JUST MAKES IT SUPER,
TO DO ANY SCHEMA INFERENCE. IT DOES
CAN CREATE SEPARATE TABLES AND SPECIFY
IN SEEING THE DATA YOU HAVE, IMAGINING
NOW, LET'S TAKE A LOOK AT DATA THAT
THE LAKE. LET'S TAKE A LOOK AT TABLES.
JUST GOING TO EXPAND THAT OUT IN
I SEE UNDER WORK SPACE SEVERAL DATABASES.
SQL DV1 AND ANOTHER DATABASE, A
NYC TAXI. I'M GOING TO FOCUS ON
THESE TWO SYSTEMS. TRADITIONALLY,
LET'S TAKE A LOOK AT WHAT IT LOOKS
IN THIS NOTEBOOK. THERE'S ONLY FOUR
JUST TALK ABOUT WHAT THOSE LINES
THE SQL SPARK CONNECTOR. FIRST LINE,
TABLE. WHAT COULD BE SIMPLER? NEXT
PRETTY OBVIOUS. NEXT LINE, TAKE
TO AGGREGATES. AND THEN PREPARE
LINES THAT WOULD TAKE YOU A LOT
WE HAVE FULL SUPPORT IN SQL SPARK.
WE'RE OUT OF TIME. IT'S AMAZING
EVERYONE UP IN THE AUDIENCE TO GO
WANT TO LEARN MORE ABOUT WHAT'S
MS/SIGNOUT. THANK YOU FOR WAKING
>> NOW, LET'S HEAR MORE ABOUT MASTERFUL
BLACK BELT IN . >> IN MY BUSINESS
AZURE. IN MY PRIVATE LIFE -- IT'S