(upbeat electronic music)
- Welcome to Microsoft Mechanics Live!
Coming up, we'll take a look at all your modern compute options
in Azure, with tips on how you plan, build,
or move your apps to the cloud.
We are joined by Corey Sanders, to take us on a tour
- [Christina] of everything that's new. New virtual machines,
new hardware options, for even the most demanding workloads.
- [Corey] I'm incredibly excited to be here.
- [Christina] Yes.
- Thank you so much for having me.
I actually thought I was banned from this show I
haven't been asked to be on for quite some time.
- You were banned, then you got promoted.
- [Corey] Wow, so then you had to unban me?
- Basically. - I see.
- That's how that works. - That's right.
- If you are on probation though
- I've got a lot of influence now
- The promotion didn't mean that you got off probation.
- [Corey] Okay.
- You are not banned
- It's secret probation though.
- [Christina] Basically.
- It is okay. Fine. Alright.
- [Christina] So we're seeing a lot of new options using
infrastructure as a service, and cloud native architectures
with stuff like containers, and server lists.
Can you help us understand these options?
- I can certainly try. I'm not gonna make any
promises though, we'll see how the probation goes.
So, while more options can sometimes be confusing,
the goal with all of these different options
and these different services is to offer a range
of capabilities to support the huge variability
of workloads that all of you have.
This gives you more options to both deploy and manage
a workload. So you can quickly lift and shift your apps,
or you can modernize them by re architecting
or completely rebuild them using server list options
or microservice based solutions. So,
it really depends on what you need to do.
It depends on what you can do. So, for example
if you are running a third party server app,
or have a legacy business critical app, it
may not be possible to fully repackage it,
unless you completely rewrite it. And sometimes
that's not possible. So, even when you can't or don't
want to change a thing, you can simply re host it,
and your apps and workloads will move just fine
into infrastructure as a service. And so,
to do this, we have many different VM options for you.
- [Corey] Spanning all the way up from your very very
basic sizes, to huge multi core four terabytes of RAM,
for your workloads, and in fact we are working
on 12, which is very exciting. You seem excited.
- [Christina] I'm very excited. Twelve terabytes.
- [Corey] Twelve terabytes, I mean, it's so much
you could do with that. Dedicated GPUs of course
and exciting offer that we've seen a lot of people use.
And of course, HPC, high performance computing,
and much much more. In fact we just added this really
really cool skew, called Confidential computing,
or the DC series, this allows you to keep your data,
and what you're running inside the CPU itself secure,
and protected and confidential. Even from Azure and me!
So, in addition to keeping things confidential,
we are also looking to always expand out
our storage options, and give you faster and faster storage.
And the recent announcement that we made this week,
Ultra SSD. - Ultra
- Ultra.
That's better than premium, just to be clear.
If you were wondering, ultra is higher.
Beyond VMs we have many many other options
and solutions including physical built hardware solutions
like the Cray Supercomputer, or massive servers
like SAP supporting up to 24 terabytes of RAM,
and even actually NetUP servers as well. So, let me
give you an example actually, of one of those SAP servers.
So I'm connected here, I'm SSH'd into this SAP machine here,
and just because I totally like to geek out
a little bit here, I'm gonna zoom in and show you right now.
- [Corey] Wait, where is it?
I just see lots of numbers. - Oh gosh.
- [Corey] Oh, you're all sick now. Oh, hold on.
Let me re zoom in. I wanna show you the CPU count,
there it is! So, 960 physical CPUs on this machine.
That's pretty awesome. Alright now,
Alright now, I'm gonna show you the memory.
Memgo. Now I'm gonna show you the memory here,
and of course it's still in KB, when it's listed
here in Linux. This is Mark's tool. Terrible.
- [Christina] But look at all those, look at all those
- [Corey] Oh, you know what it is? Yeah, okay, fine,
hold on one more time guys, here we go, watch this.
- [Christina] You're gonna get it right eventually.
- [Corey] I'm gonna get it right. This is the demo, enjoy.
Alright, there it is! Woo! Successful demo!
(audience claps)
20 terabytes of memory written in KB. So if
you're wondering, thank you for the clapping. It's so nice.
I have worked around Mark's tool. You can see here,
20 terabytes, that's how many zeros it takes
to get to the 20 terabytes. So that is that fantastic thing.
What's great about this is it's not just a lot of
memory and CPU, it is fully certified and supported by SAP.
And so you can really run from this full range,
any size, any workload you need with confidence in Azure.
- [Corey] Move your existing virtual machines with
Azure migrate and Azure site recovery,
it's really just a few clicks to get it up there.
We've also deeply integrated these services
with a bunch of partner solutions. Something
like Turbonomics so you can go and include assessments
on what that migration will do to your cost.
So it's very very powerful, bringing together some
of these solutions we have, with some
of our partner solutions as well, to make
it really easy to move those virtual based machines.
- This sort of option is great for people if they
wanna mirror exactly what they have in their data center
if they wanna extend it. But what if I'm
not ready to move yet? How do I get my specific workloads
to the cloud if I don't wanna commit to doing everything?
- That's right, that's right. First, there's a lot of apps
that can help you on your commitment problems,
but to move your things there is a lot
of different options, and this is where hybrid is
a really powerful part of our overall offering.
We support hybrid across networking, identity,
management security, data, and of course,
development platforms. And this allows you to sort
of pick and choose how you wanna use the cloud.
Maybe you're not quite ready to take that big step
in rebuilding everything, maybe you wanna go just use
the identity story across the entire global ecosystem.
You can pick and choose how you wanna take advantage
of this. Azure Stack being really, one
of the more exciting offerings that we have,
which is an appliance solution that allows you
to run Azure services in your datacenter.
We also recently announced a really cool feature called
DataBoxEdge, that allows you to run with FPGA power
on the edge, on data before you bring it into the cloud.
So this really gives you that great hybrid story.
- Alright, so that sounds good.
But what if I wanna rebuild my apps, or re architect
them to be cloud native?
- Yeah, so for some of those applications
that you're looking to make those changes,
you can move them really quickly into Azure
by taking advantage of containers and Kubernetes.
And so, with Kubernetes, we have a
manage Kubernetes service called AKS,
which is short for Azure Kubernetes Service.
And we just announced the addition of virtual node.
So this week announced a new capability there,
called virtual node that allows you
to take advantage of Azure container instances,
to scale almost instantaneously when you're
running those Azure-Kubernetes containers
in Azure-Kubernetes.
- [Christina] So how does this change things?
- So let me give a visual. You seem like
a visual sort of person. - Yes.
- So let me try and paint a picture here.
So ultimately, containers run on VMs.
And with just about every container service out there,
you need to provision those Host VMs first
before you run your containers on them.
So when you're scaling, you have to create the VM first,
before you can provision more of the containers on top.
Even using Kubernetes, even a managed Kubernetes service,
requires those VMs to be scaled first.
Now, our managed Kubernetes service, AKS, gives you
a lot of automatic management. It gives you easy control,
it makes it a really simple experience to go and deploy,
but it still requires VMs in the backend to go
and manage and deploy that, which means it takes
that extra time and that extra management on VMs.
And that's just like all of our competitors.
It is not actually a serverless platform.
It's VM level isolation. But with ACI, which is
a capability that we launched about a year ago,
- [Corey] are Azure container instances, we now are taking
our serverless platform and adding it
to our Kubernetes platform. And so now you can
get Kubernetes-managed containers on demand,
without having to provision maintain or deploy any VMs.
So it really is offering a serverless Kubernetes option,
giving you all that power of Kubernetes while
still making sure that it's serverless. You
don't have to worry about any VMs underneath.
And it really is a good option if you're
building Linux based apps that are designed
to scale instantaneously based on variable load,
and still needing that high response time,
where a minute, two minutes, to get the VMs up
and running and integrated is too long to wait.
So let me actually show you, so, here is an app.
- [Corey] This app connects to and processes a set of images.
And so we built this just to show this off.
It's a TensorFlow app, right? So it's running
on Linux containers, it's running in AKS,
and it's using data that's stored locally,
to look at these images and try and guess what
the thing is, right? And so we've trained
it ahead of time. It's running okay, you see
it makes some mistakes, so that's unfortunate.
- [Christina] Banana and apple are the same.
- [Corey] Banana and apple, I mean. It's fine.
It's close enough, let's not be mean to the machine please.
So, right now, this is running with one front end.
So this is the website that you're seeing,
and one backend that's doing this work.
And so I haven't really scaled this out,
it's kinda running pretty slow.
And if I were needing to process let's say
tens of thousands of images instead of just one,
you see right now it's running about .5 images
a second, as you can see up here, which is relatively slow.
And with that one worker, that's unfortunate.
So now I wanna scale it. Okay? And so I can
use now ACI in the backend to be able to scale this.
So if you go over here, and I've got the cloud shell
up and running, I'm gonna show you how to do this here,
using ACI. - Nice.
- [Corey] If I go in and this is all just
a helm-based solution, so it's super easy.
I can go in with helm, I'm gonna upgrade it here,
and you can also do this as an automated way based
on load, but in this case I'm gonna show it
to you just to make the effect that much more intense.
Okay, so I'm actually using a helm chart.
I'm gonna scale this, I'm gonna set it here,
and it works faster than my typing, I promise.
Alright and so just double-checking that I got it all,
I type it wrong a lot here. Okay, great!
Okay. So this is now off to the races, right?
So this is like okay, great we're now gonna scale this.
So let me actually take a look here and see
if I can do kind of a watch here and see
what's going on as this is running.
So this one, I'm not gonna type, I'm
not gonna bore you with that. So,
this one here you can watch, and see, and you
see right now, I'm actually calling a Kubernetes,
oh, I should've typed it see. - See, see, this is
- [Corey] I know. Human error here.
Get pods. Okay. But this is, if I type it correctly,
this is just using a standard Kubernetes command here,
right? And so now I can watch this, and you can
see some of them are actually already starting.
So the IP addresses are coming in, these containers
are already responding to this load. So,
the time it took me to incorrectly type the command,
you see here I slide over here, you're
gonna start seeing that workers are already up to two.
So, I'm already taking new load, I'm expanding this out,
and these are gonna just start going up and up,
and so already I'm processing .83 images.
If I slide back over here and take a look there's 3 workers,
so you can see them up and running their IPs are getting
assigned. Four workers, and just like that,
this has scaled out. So this is so much faster
than you would have seen me to create a VM
and add it to my Kubernetes cluster,
and then launch a container on top of it.
This just makes everything faster and easier and simpler.
And again, that watch command is just using
a standard Kubernetes command, so this isn't
making it unportable. You can go and take this app
and go anywhere, you can take this management
and go anywhere, it's just better and easier,
here on Azure.
- So this really does seem like I said,
this is, you know, putting server lists
in your Kubernetes, and it seems like it's
a big step forward for people who don't want
to have to choose between the two.
- That's right. That is exactly the goal,
and also ones to do image management this fast.
This offers you immediate scale out with
zero VM-based compute. Still all management Kubernetes.
- Fantastic. Okay, now I love Kubernetes.
But what if you're not using it, and for some
reason you don't even have any plans
to use it, what are your Azure options?
- Ultimately, we want to be able to just
have you bring your code, and deploy
your applications so you don't even need to worry
about containers, or orchestration, or infrastructure.
And so I just showed you that AKS plus ACI, and
that removed a lot of the VMs out of the house.
But there are several ways for you to be
able to deploy and take advantage
of serverless solutions without having
to even think about containers.
And so I'm gonna pull this up here and just show you,
probably the best way to do this is with Azure App Service.
And so if you go into the portal and click here on Web App,
it's incredibly easy to spin this up.
In less than five minutes you can have
your code running, an app fully deployed from scratch,
and completely configured in CICD without thinking
about orchestrator without thinking about containers,
you can just go, launch your app, start facing traffic,
almost immediately, and that's one of the great powers
of Azure App Service and that type of solution.
Now we also have, of course, the ability
to just do functions. And this is a serverless solution,
that allows you to respond to let's say specific events.
So, timing events, something fires,
someone clicks a button, maybe a webhook of some kind.
This allows you to again, just take your code,
put it in, have it run when you need it,
and only when you need it, you pay only
when it runs, and you don't have to worry again
about orchestration, how it's running,
who's running it, whether it's a container or not,
none of that matters, just take your code and run it.
This is gonna be super powerful,
and we have so many people using this
to supplement existing applications that we have out there.
- [Christina] Yeah so, basically what you're saying is
Azure functions like logic apps, it sounds like it's
a good solution for modern apps, IOT solutions,
but even in IT pro scenarios.
- [Corey] You actually got this one right.
- [Christina] Thank you, thank you.
- [Corey] I'm sorry. You got a lot right.
That's not nice of me. But imagine implying
some security policy, every time a storage account
is created, it is incredibly easy to get
that done with a function or a logic app, right?
In addition to these types of server list solutions,
we also have another really cool option,
more focused on code and microservices,
called service fabric mesh. And so,
this is an application platform that is
really geared towards microservices,
again, without you having to think about
orchestrator, or containers. It supports Windows
or Linux, and is really a great option
to accelerate your deployment.
You just bring your code, we run the app,
and that's it. So I'm gonna show it, again.
- [Corey] So, here I have smart hotel.
Which is actually not to be confused with
smart hotels that actually exist,
this is a sample one, it's like a Contoso.
This is Contoso smart hotel, we'll call it that.
And so, here I have (laughs) AIT.net solution,
and .NET framework application, so this is all Windows.
And it exists today. And normally that would
run on something like IIS and I would
deploy it that way, so let me actually zoom
over to visual studio. And here I have actually
got it, it's WCF and web-based application.
And so you can see, sorta your standard based solution
here in Visual Studio exactly what you would sort of expect.
But here's what's amazing. With just a few clicks,
I can now turn this into a service fabric mesh solution.
So if I go right click, add, container orchestrator support,
I said you didn't need to know about orchestrator,
but anyway you click that, and now you just hit okay,
and away you go. And now, this takes care of everything.
It is containerizing it, but you don't need to know,
you don't need to care and you can just go and publish this.
And so simple operation here, now I go in,
and I can go publish, if I can find it. There we go.
And so this built right into my Azure account.
I go in and I pick my subscription, the location,
let's go East US, resource group let's go 360,
and then the containers registry to store
the content, and again like that, I now have
this exact same app can be up and running in seconds
up on top of service fabric mesh,
with no code changes at all.
So if I switch over to Azure portal just
to show you what this looks like, this is an app
that is using both service fabric mesh and SQL DB,
no VMs. So you see here, I've got the SQL DB running,
I've got the service fabric mesh app,
and I can click in and you can see there
is actually running here, if I zoom in here,
WCF and web. So these are the two components
that I just showed you, they're all up and running,
all a single-arm template, all interconnected,
again, no VMs to manage or deploy.
- [Christina] I mean I have to be honest,
I'm really impressed that you were just able
to bring your code in and run the app.
But what if I need to then, update that app,
or add new functionality? How does that work?
- Yeah it's actually incredibly easy.
For those who are familiar with service fabric,
you can go back in, and so that service fabric mesh
solution, you didn't really need to
understand service fabric, you're just sort
of converting it and deploying it and we've got it.
- [Christina] Just hitting a button.
- [Corey] Hit a button, that's right.
But if you do know service fabric,
or want to deploy using service fabric technology
and language, you can go in and actually hit add
new service fabric service. And so right
to that same solution I just created,
I can now go in, I can add an ASP.NET Core solution,
I can use reliable collections which is the
powerful service fabric capability,
to put the data right near compute,
and make it really easy to manage that
as it scales out. And again, I can add this,
right here, hit okay, and now it's all one application.
So I can now hit deploy on this,
and it's still all fully managed, fully serverless,
still no VMs, and we're doing that storage for you.
So the storage is managed as part
of that serverless app as well, all sort
of taking care of as part of that compute.
So it's really really pretty unbelievable
to be able to combine that relational database,
that power of that serverless side of the relational side,
and then adding the serverless backend
on service fabric mesh, to be able
to get that app up and running.
And so once I've written this code,
and I go and deploy it, my existing app
now, can have more power. And if anytime I need
to scale this application, again,
because it's all serverless, it's just a few clicks,
and away we go. - Very impressive.
- [Corey] I thank you.
- Well thank you Cory for explaining,
and showing us the latest updates for compute on Azure.
- Absolutely, and I guess my last question for you,
and I'd like the audience to chime in on this,
am I officially out of probation?
- What do you say guys? Is he out of probation?
(audience claps)
- I see like ten shaking no. - Yeah.
- That gentleman is shaking, he's like,
no, I don't, the demo is not any good.
- Yeah, it's cause you're out of probation,
but, and we are out of time, but
where can people go to learn more?
- So, there's a lot of options.
So I walked through a bunch of stuff.
Look, if you're looking to build websites,
Azure App Service is clearly the place to get started.
You can find those details online. If you're familiar,
or want to play with Kubernetes, obviously AKS,
and then ACI, it's called virtual node, you can
get into that preview by either clicking on a link here,
or you can go see those guys at the booth.
Service fabric mesh again, for .NET, Windows,
microservice based applications. And if you just want
guides on how to migrate, check out the
Azure migration center to learn more
about both what we have, and what our partners can do.
- And of course, you can follow our series here
on Mechanics, and you can subscribe to our channel,
so hit that like button, hit that subscribe button.
And follow us on Twitter for all the updates.
Thank you so much for watching.
- Thank you Christina.
(audience claps)
(upbeat electronic music)