(upbeat music)
Hello, and welcome.
Please enjoy this short readiness video
on Azure Readiness for Postgre SQL.
Hi, Umur.
How are you doing today? Hi, Sanjay. Great.
How are you?
Great to have you back again.
Awesome, it's good to be back.
Umur, let's start with an introduction
for those of you who are tuned in here today.
Of course.
I head up our PostgreS product team at Azure,
and prior to that I was the CEO at Citus Data,
which is now part of Microsoft as of earlier this year.
Fantastic.
And Nikhil, I know you'll be showing us a demo later on,
so can you please introduce yourself as well?
Hi, Sanjay.
How are you doing? Great.
I run the engineering team
for Hyperscale PostgreS data services on Azure Arc.
Fantastic.
You make the magic behind the scenes.
We do.
We try to. Awesome.
So let's get started, Umur.
What are you going to talk about today?
Sanjay, I'll hit a few topics.
First, Azure Arc, which we announced just last month
at Ignite, ability to bring Azure data services anywhere,
something we're super excited about.
It's not yet in production, it's in preview,
or early access program,
but we want to look a bit under the hood,
kind of show you how it works,
and then look at some core data services
that are running on top of that,
specifically, PostgreS, and then a unique, scalable approach
to that, which is Hyperscale Citus.
Then Nikhil will dive in and do a demo,
looking into how it works.
I really enjoyed that Ignite keynote ready show,
the Azure data services with Azure Arc,
so let's see that in action,
then you can talk about it after.
Let's do it.
First off, what is Azure Arc?
It's really is a set of technologies
that extends Azure management capabilities,
data service capabilities, to other environments
that are not Azure.
That could be your data center,
it could be on-premises,
or it could be other cloud providers.
If you think about it, it allows you
to bring cloud practices
that you hopefully like (laughs)
to kind of to on-premises.
If I actually look into what those practices are,
what Azure Arc can allow you to do,
it really gives you a unified management,
a view, a single pane, if you will,
of your instances to look at and to manage.
Part of that management is security,
being able to, for example, have your Azure policies
and have them apply to your on-premise assets.
When you look into what data services are,
we have very popular services like Azure Database,
or PostgreS, or SQL managed instance,
which are available on Azure,
and now we're bringing capabilities
that are similar to those to on-prem environments.
What do those do?
A simple example is it'll allow you
to operate your database, do the patching automatically
so you don't have to worry about it.
What that means is you stay always current.
For example, you can take your backups,
you can rest assured that all of this is taking care
of you, over your databases, through this infrastructure.
All the best practice of the cloud
also now available in a way-- Exactly.
That includes provisioning instances,
scaling them, or even cloud billing, pay as you go type
of conception is available with Azure data services.
Fantastic.
Best of both worlds. Exactly.
Now.
Architecture.
Architecture, exactly.
Looking kind of under the hood on how this works.
When we say an infrastructure, that means literally
any hardware that you have on your premises.
There's virtualization there, VMs.
I'll talk about storage just a bit later,
but really we rely on Kubernetes
to do the orchestration.
That Kubernetes could be one that you're managing yourself
as part of your company or whatever,
or it could be, you could be using
Azure's Kubernetes service,
or you could be using any of the, whether it's GCP,
or like Amazon, any Kubernetes service,
that's basically what you need.
The other thing that you need,
which again, is that they have persistent storage,
that again, Kubernetes will have access to
and we'll be able to store that data.
Now that kind of as the underlying substrate,
then you have your data services on top,
the PostgreS, which we'll talk about,
kind of about PostgreS Hyperscale is here
as well as SQL instances.
You could have one of them, you could have many of them
for different applications, you could have copies
for high-availability and so forth,
and other data services will become available over time.
Right now, it's PostgreS and SQLs--
And so all this is coming?
That's coming, right, exactly.
And again, we'll dive into it a bit more.
The way we access these resources
is through a powerful CLI,
a command line interface, which is called azdata.
That's basically what calls the rest full APIs,
and it allows you to, for example,
monitor kind of all of your instances,
and then you can get that single-view, single-panel class,
on Azure Portal, for instance.
Or in fact, you could use Azure Data Studios
as well if you're not connected to Azure at that point
to manage those instances.
I see.
So that's kind of what's under the hood.
I see.
So can you talk a little bit more
about this Postgre SQL and the Hyperscale especially?
Of course.
Let's actually dive into that
in terms of the data services available,
and what PostgreS does.
In fact, if I could expand just a minute
on what some of these management capabilities mean.
I'll give a few examples.
Once we have this infrastructure in place
what you're doing is provision.
Again, the CLI will take care of all of that for you.
They'll be able to add new instances as you need them.
Very useful, actually, is integrating this
into your flow, your development flow,
through CI/CD, like pipelines.
In other words, let's say you wanna create a new database,
in some cases it could take days
on an on-prem environment, sometimes more than a week
to approach an instance, make sure that it's secured,
it can get handed off with our multiple tickets
that get handed over.
In this case, you just call what you would do
in the cloud, which is get an instance in a few seconds,
and backup restore all that goodness.
I wanna give an example of what this kind
of Control Plane layer, which is the Azure Arc
for data services does, using high availability
as an example.
This is some of the things we are working towards,
and making available later on,
but essentially,
you have your pods in Kuburnetes,
and you have these instances that you've created,
then we'll actually create replicas
that could be synchronous, that could be asynchronous,
but all of that is managed for you
and abstracted away, so you see just an endpoint
you connect to it.
Talk about incentive, for example,
for a retail store, they may have some regions
in U.S., but also they have something in Europe--
Correct.
You can make sure that the data is replicated.
You can your backups locally,
or you can take them to an Azure region,
and that just gives you a lot of flexibility
to be hybrid, both on and off-prem.
Okay.
Sounds good.
All right.
To your question of "Hey, why am I looking at PostgreS?"
There's many reasons, but I'll talk
about just three of them which makes PostgreS really popular
and ubiquitous that it is open source.
It's a long standing project
with a huge developer community around it,
all the tooling.
We'll touch upon some of those.
But really, a reputation for resilience
and a reputation for keeping data integrity.
That's something PostgreS is really well known for,
and it's a core pillar of why people love PostgreS.
Last, certainly not least, is its rich feature set.
Whether it's as SQL features,
whether it's all the performance indexing data types,
whether it's JSONB or PostGIS,
makes PostgreS a very complete package.
We make that
even further
by introducing Hyperscale (Citus).
You talked about that briefly,
and that there's other sections coming up,
so I'll just touch upon it really lightly,
but it allows you to take any number
of PostgreS instances.
It could be a couple of them,
could be 10, could be 100 of them,
and have that behave as a single PostgreS
to the application.
It gives you, it's as simple as taking a slider,
dragging it, and as much resources as you like.
You could have terabytes of memory,
thousands of cores, at your fingertips, literally,
within minutes when you provision.
Of course.
When you put all of this together on Azure,
it actually gives a very compelling picture
on why PostgreS
and why on Azure.
We talked about those three core pillars
of open source, proven resilience and the rich feature set,
but we make it really scalable with Hyperscale (Citus).
Add nodes any time without downtime.
Nikhil is going to talk about that later on.
Then we bring those cloud management capabilities
anywhere, not just on Azure.
We talked about any scale.
Now we're talking about anywhere,
and that's a very compelling open source
PostgreS experience, both the community version
that we're running and the Hyperscale (Citus) extension.
They're all open and brings the picture together.
And then on top of it, the amazing power BI.
Oh, yes! (Sanjay laughs)
Thank you for reminding that!
That in fact, this is all integrated inside your ecosystem.
Whether it's power BI, to have any ports on it,
whether it's the Azure Database Studio to access that,
the tools that you're familiar with are at your disposal.
Absolutely. Fantastic.
All right.
With that, I'll hand it over to Nikhil
to dive into the demo.
Thanks.
Thank you, Umur.
Thank you, Sanjay.
I'm gonna do a quick tour of what we have
in terms of Azure data services, running,
and this early access program
that people can sign up for.
Okay.
Here you see,
here what I have is an Arc data service Hyperscale (Citus)
instance deployed in Azure.
How do people get to this?
Portal.azure.com--
Yes, portal.azure.com,
and you just search for Azure Arc,
and you'll get the ability to start doing this.
Here, you can see the family
of your essentially information,
like any other Azure services.
Our resource group, here's my location which happens
to be on-prem.
I have deployed a four node Hyperscale (Citus) cluster.
Here as Umur was saying, you can easily configure it
in terms of the number of nodes, the scale you want,
the cCores you want, the storage you want,
as you move the slider.
That's the slide he was talking about--
Yes, exactly.
You can change the number of cores.
This all happens on your cluster
where you can dynamically change their locations.
You save it.
There's a lot of magic
that happens when you drag that slider.
All of that orchestration kind of bears up to it.
So now, how about we jump in
and connect to a cluster that's deployed on-prem
and start playing with this?
Absolutely.
Here,
let's go talk about easy data CLI.
That is available for you to go and manage your cluster,
and scale, and do things.
Here, if I do easy data, you get the familiar way
of all the context around what it can do.
You can see, you can deploy PostgreS and SQL data services.
Here, as Umur was saying,
we can talk about
what
capabilities we have when you create a PostgreS server.
Here you can configure all the things that you want,
the memory, the backup intervals, excuse me,
the backup intervals, the CPU, all the kinds
of things that you saw in the portal
are available for you to do here.
It's called integrated monitoring.
Let's go and connect with...
Here you see that I have the Arc PostgreS
that we saw in Portal running.
Up here, it is up and running,
and I can
go and
show some more data.
So here, what it's doing is it's asking me
what cluster I want to connect to.
This particular instance is on-prem, or is it--
Exactly.
It's running on-prem.
Here you can see that I am able to,
here's a neat command line screen that I can connect with.
I can show you the actual
PostgreS, the cluster, and data about the cluster.
Again, this is in all the kind
of familiar interfaces
we'll use PSQL, standard data--
As you can see here,
I can connect, and it's connected.
I can run...
You can see that it's a four node cluster connected,
and I can do all kinds of administration
on this cluster.
Here I can do things, like I can do an online scale out.
Let's just see that, how it works.
This is basically like adding new nodes
to the cluster through that command.
It'll extenuate new instances,
it'll start moving the data,
and then it'll be able to run.
New customers coming into the stores--
Exactly.
This is really the promise of the cloud,
that I can add any instances elastically.
What's really cool is as I add new nodes,
my system still stays up.
My queries are up, my reads are up, my rights are up--
Business is on. Business is on.
Exactly.
Here's a thing I can do quickly.
I can talk about the monitoring that we have integrated
with the cluster that customers are familiar and can use.
Here are the four node cluster is being monitored on-prem
with all the setting, all the metrics
that one is used to in terms of CPU, memory,
the databases, deadlocks, conflicts, all of these things
that you're used to.
When you deploy and manage these things on-prem,
you get a cloud-like experience
in terms of managing, deploying,
backing up, and monitoring.
Fantastic.
Thank you so much.
Any closing thoughts?
Well, this is something we're really excited about.
It's very much in the works.
Again, it's an early access program,
so if you're interested please sign up.
How do we sign up?
If you go back to the presentation,
I think there should be a,
this is the link.
But if you search for Azure Arc and then sign up,
they love your input.
This is work in progress.
As it gets continually more features,
they love to hear what you can do with it.
Thank you so much, both of you.
Thank you. Thank you.
Thanks for watching this short Azure Readiness video.