A key component of building a Modern Workplace is creating tight connections between the
people you work with, the content you create, but especially the conversations and meetings
you share.
So today we're going to show you some conceptual scenarios for how you can create those connections
with intelligent devices and services that understand both our physical worlds and our
digital worlds.
Let's start with something we're all familiar with -- meetings.
Hey, Cortana.
Set up a meeting right now with the Smart Building team to discuss the new project proposal
we're creating.
CORTANA: Sure thing.
You are all free now.
Where do you want to meet?
RAANAH AMJADI: Find me a conference room with a Surface Hub.
CORTANA: Okay.
Team Scrim Room is available now, too.
Want me to book it?
RAANAH AMJADI: Yes, please.
CORTANA: Great.
You're all set.
RAANAH AMJADI: Well, you can see behind me is a common office meeting room, but this
one's different.
On the desk, we have a prototype device built on similar technologies to the ones we showed
you earlier.
It picks up both audio and video that you can pair with AI Services and Microsoft 365
that help with key tasks like identification, voice transcription, and even real-time translation.
CORTANA: Welcome, Jamal.
Hello, Dave.
RAANAH AMJADI: So, AI Services even identify Dave and Jamal as expected meeting attendees.
I'm going to go join them.
CORTANA: Good morning, Raanah.
Would you like to start the meeting?
RAANAH AMJADI: Yes, please.
I know Katie and Julia are coming from another meeting, so let's go ahead and get started.
Dave, what's the latest with the Smart Building pilot?
DAVE: I've already done some preliminary analysis on the data, and I'm finding some high-temperature
outliers, we should discuss it later in the meeting.
RAANAH AMJADI: Okay, sounds great.
JAMAL: Dave, do you know if we'll have enough of the Yanzi multisensors to update the showcase
floor?
DAVE: Actually, I have some concerns about the location of those sensors.
We should hold off on doing a one-to-one replacement until I can --
RAANAH AMJADI: Oh, I'm really sorry to interrupt, Dave.
I actually have some ideas about the replacement.
So maybe let's connecting after the meeting.
DAVE: Okay, that's good to know.
I'll follow up with my team and post and update to the channel after the meeting.
RAANAH AMJADI: And I'll follow up and send Yanzi an e-mail about those showcase sensors.
DAVE: Okay, that sounds great.
RAANAH AMJADI: Now, take a look at the transcript behind me on the left.
Even though we were all speaking over each other and the sound environment here is actually
pretty challenging, but AI Services, coupled with the audio and video signals from the
device, could still accurately identify who was speaking and when.
You'll also notice that it picked up our meeting items and listened them on the right.
And the voice recognition model has been trained, over time, the understand our team's unique
communication style, and recognizes those speech patterns, even when we're speaking
in business jargon.
This not only helps the interactions in the meeting room, but it helps remote participants
have a more active meeting experience.
Our remote teammate in China can see and hear a translation of this meeting.
In fact, we can support multiple simultaneous translations.
Hey, Katie.
Hey, Julia.
KATIE: Hi.
RAANAH AMJADI: With Microsoft Teams, we can continue this conversation right within the
context of the work we're creating together and the business apps we use to stay on top
of our project.
I can even access great third-party apps like Trello and GitHub.
So now Cortana is in this workspace with me, so she can help me stay connected across all
my experiences.
As you can see here, Cortana has detected that we need to find a time to meet.
Instead of struggling to find time that works for everyone's calendar, Cortana will automatically
offer up a few options based on our mutual availability.
She'll even carry the context of our conversation forward to the meeting details.
And just like that, our meeting is scheduled.
But Cortana also understands the files we're working with, can detect that I want to share
the Q2 sales forecast, and will bring the most relevant documents straight into this
conversation with my team that can share it in just a matter of seconds.
KATIE: Hi, even though I came in late, I love that I can catch up and identify everyone
in the room.
I'm deaf and I work with a sign language interpreter, the transcript doesn't eliminate the need
for my interpreter, but it lets me give my full attention without having to worry about
note-taking.
This makes it a lot easier for me to bring my engineering knowledge to the table and
participate in the discussion.
I love getting the meeting notes at the end, too.
Hey, we need to get started on the Smart Buildings proposal.
JAMAL: I've already started on the outline, and there's a bunch of elements we still need
to include.
Creating a proposal like this in the past was time consuming, not just for me, but for
everyone on my team.
I'd send e-mails to experts, search for information I need, and run reports from line-of-business
apps all just to pull them into the document.
Now, since everything is part of the Microsoft Graph, I never have to leave my document,
which means that I can stay focused, ask for what I need, and it just shows up.
As I'm working on my document, I can add a simple reminder as a placeholder, or say I
want to get a customer quote from my colleague, Patty.
So what I'll do is I'll at mention Patty and ask her to please provide that great customer
quote.
In the past, I'd have to switch from Word to Outlook and run the risk of getting sucked
back into my inbox.
But now, Patty's quote will show up in the document exactly where I need it.
And what's great is I can keep working.
So let's do that.
Lastly, I want to provide some more information about the Yanzi Smart Building sensors.
So what I'll do is at to-do and remind myself to insert the Yanzi information here.
Now, this is my favorite part.
Cortana has remembered that I've used this phrase before, saw my intent from a to-do
item, and then suggested the information I needed using AI.
And in case you didn't notice, Patty's information showed up right as I was doing it.
The Graph becomes richer the more we use this service and will better understand our intent.
In the future, developers will be able to connect and extend their own applications
and data sources to the Graph, and have that information show up in the document exactly
where you need it.
RAANAH AMJADI: Great.
Thanks for that update, Jamal.
JAMAL: Anytime.
RAANAH AMJADI: Katie, what's the latest with the common area design?
KATIE: I've been texting with James, let me take a look.
As an engineer, I spend a huge amount of time in front of my PC, but I'm also getting nonstop
text messages and alerts on my phone.
On average, we open our phones more than 100 times per day, but we think we can do better
with an Android phone and an upcoming version of Windows 10.
Let me show you two simple examples.
As you can see, I'm getting SMS messages from my phone right here on my PC.
I love being able to respond without having to pick up my phone and unlock it.
It's much easier to type messages on my PC.
I can also drag pictures from my desktop.
Let me send this over.
Not only that, when I get a picture from James, I can use it right away just by dragging and
dropping it into PowerPoint.
Let's see how this sensor would look in our common room.
Looks pretty good.
I can also access my phone's notifications and can click on them to open the equivalent Windows
App or see them on the Web.
Here, I'm opening the Smart Building design.
I'll send it to the team after the meeting.
RAANAH AMJADI: Great.
Thanks, Katie.
Dave, how about we hop into that temperature data now?
DAVE: Of course.
Let me bring up the latest data from Power BI.
RAANAH AMJADI: Great.
DAVE: This is the last 24 hours of temperature sensor data.
And I can see that most of the sensors are reporting normal values, but I've got these
three high-temperature outliers.
Let me reorganize the data by room type.
When I do that, I can see that most of the higher values are coming from focus rooms.
RAANAH AMJADI: But we looked into that, didn't we?
We didn't find any equipment in the focus rooms that would cause a temperature spike.
DAVE: Right.
But let me reorganize the data spatially, because I've found something interesting.
RAANAH AMJADI: Okay.
DAVE: These are the actual three-dimensional positions of the sensors with the building
plan.
Let me add a 3D map there from Bing for additional context.
Now I think the best way to look at spatial data is using my HoloLens.
So I'm going to switch devices.
Now, I'm going to connect my device to the screen and share my view.
Now, let's take the hologram that I'm looking at and place it directly onto the meeting
room table.
In this way, everyone can get a sense of what I am seeing, without having us all have to
wear HoloLenses.
Now, I can clearly see that the three sensors giving us a problem are vertically aligned
with one another.
Let's put it back.
I want to ask my colleague Tao (ph.) to join the meeting.
Hey, Tao.
Now, I can see Tao's avatar looking around at the data, just as if she was in the room
with us.
Tao, have you got any insight as to why these three sensors that are in a vertical stack
might be giving us an issue?
TAO: If there's a hot air duct running from the cafeteria kitchen on the ground floor
up to the roof, there were some changes in the kitchen recently.
We may be way overstacked thermally.
KATIE: Got it.
Maybe we could change the sensor placement for more consistent readings.
RAANAH AMJADI: That's a good idea.
DAVE: That's great.
I'll follow up with the building manager to check both hot air ducts and the sensor position.
Data visualization is a powerful tool for both finding and sharing insights in data,
especially when we can collaborate with multiple people across multiple devices.
RAANAH AMJADI: Using AI and the cloud, everything that we've discussed has now been neatly captured
as a searchable transcript on the left.
And a summary of all of our meeting items have automatically been created for us on
the right.
Which reminds me, Dave, I need to follow up with you so you can present that data to our
leadership team next week.
DAVE: Great.
RAANAH AMJADI: Great, meeting, thanks, team.
JAMAL: Anytime.
RAANAH AMJADI: Today, we've shown you our vision for the future of modern work and how
you can leverage the power of AI to connect experiences across our physical and digital
world.
With a range of intelligent devices and services, we can now understand the spoken and unspoken
nuance of meetings, even when we're not in the room, carry those insights into our broader
team experiences, and create opportunities for everyone to collaborate in more immersive
ways.
Thank you.