Databricks SQL offers a scalable, fully managed, interactive query engine for all BI and SQL workloads,
that outperforms leading data warehouses on a price / performance basis.
It offers best-in-class open connectors to the BI and reporting tools you already use,
like Power BI, Looker, and Tableau, as well as a built-in SQL IDE.
By the end of this demo, we'll show you how easy it is
to deploy, manage, and administer Databricks SQL
to enable self-serve analytics directly on the Databricks Lakehouse platform.
So let's get started.
The first thing we want to do as administrators is to invite other users to our Databricks workspace.
We can add new users by email like we're showing here,
or Databricks SQL can leverage your existing user roles and groups,
by automatically syncing with Azure Active Directory, AWS IAM,
Okta Single Sign On, or your cloud identity provider of choice.
Once users have access to Databricks SQL, they'll be able to log into the Lakehouse,
and we can start giving them permissions to access data and run queries.
Now that we've invited some users, let's return to the Databricks Homepage.
From here, we can jump over to Databricks SQL by clicking the sidebar,
and selecting the Databricks SQL lens.
You'll see the brand new Databricks SQL guided onboarding experience
in the panel on the left hand side.
Go ahead and click "Configure data access" as the first step in our journey.
From this screen in the SQL Admin Console,
you can turn on Databricks Serverless SQL.
Serverless SQL Endpoints provide instant compute for all your BI and SQL workloads,
with minimal management required.
Down in the Data Security section,
we can add our data lake storage credentials into Databricks SQL,
and configure it to enable users of our endpoint to access data in the lakehouse.
Next, let's jump over to the Data Explorer to view some data and manage permissions.
From here, data analysts and users can discover all the data sets in the lakehouse,
browse schemas, and see sample data.
Let's take a look at the loans_delta table.
When we select it, we can view its schema on the right hand side.
Clicking through the tabs, we can view some sample data from this table,
and see details about where the data files themselves are actually located,
and whether it is a fully managed table or not.
On the Permissions tab, we can grant access to groups or individual users.
Let's go ahead and add the "Data Scientists" group, as well as our friend Amit.
Perfect.
As you can see, those permissions are now recorded here on the right hand side.
Finally, when you need to automate your permission management,
you can grant or revoke access to data objects in the lakehouse using standard SQL GRANT statements,
like the ones seen here.
Simply run these statements using the built-in SQL Query Editor,
and Databricks SQL updates the permissions immediately.
And if you want, you can also synchronize these access controls directly
with Azure Active Directory, or your cloud identity service of choice.
Jumping back to the SQL Endpoints tab. From here, we can view and monitor the
health of all of the endpoints that are currently running, or start up a new one.
Let's go ahead and create a new endpoint now.
As you can see, we have some really simple options here, which is great!
SQL Endpoints were designed from scratch to handle low latency, high concurrency BI and SQL workloads.
To that end, it offers simple "T-shirt sizing" for endpoints
so that you can quickly adjust endpoint capacity to hit the right latency for your needs.
In addition, multi-cluster load balancing allows you to automatically launch new
clusters to meet demand when the load on your endpoints becomes too high.
And finally, the Databricks Photon Engine is a native vectorized query engine
that provides faster, more efficient execution of all your SQL workloads.
For now, let's use Databricks SQL as a powerful SQL backend for Tableau,
and we'll demo the built-in data exploration and dashboarding tools later.
To set up the Tableau connection, first we need to copy the SQL Endpoint credentials
from the Connection Details tab. Then, we'll switch over to the user
settings to create a new personal access token that will be used to authenticate to Tableau.
Now we're ready to switch over to Tableau Desktop.
Let's go ahead and create a new Workbook, and then select Databricks as our data source.
Next, just paste in the credentials from the previous steps.
Once we sign in, in the upper left hand corner, you'll see that Tableau is now connected to our Databricks SQL Endpoint.
We can search for the database we've been working with so far, "deltadb", and select the "loans_delta" table.
When we click the "Update Now" Button, Databricks SQL returns query results almost instantly.
Now that we have a direct connection to Tableau, we can run interactive queries,
and build beautiful visualizations and dashboards using Databricks SQL on the back end.
Returning now to Databricks SQL. As data admins, we'd like to be able
to monitor the health and performance of our endpoints to minimize downtime.
We can view the status and load on our endpoints by navigating to Monitoring,
and viewing the load balancing chart.
As good stewards of our data, we'd also like to be able to know what data sets people accessed,
when they accessed them, and what queries they ran, for purposes of auditability, lineage, and data governance.
We can view this information by clicking the Query History tab.
From here, we can view a central log of all of the timestamped queries that users have run on a particular SQL endpoint.
We can click on any individual query to get a general overview with some summary statistics,
Or, we can choose the Execution Details tab for even more granular metrics.
If we want to dive down even deeper, we can view the Execution Summary.
The information shown here allows you to identify bottlenecks for long-running queries,
understand the physical plan,
or view detailed execution information for debugging purposes.
Now that we've touched on the admin experience,
let's briefly switch gears and explore Databricks SQL from the data analyst's perspective.
If you want a quick way to get started,
the starter Databricks SQL Endpoint comes preloaded with sample datasets, queries, and dashboards.
You can copy these as templates, or just play around with them to discover features
and get comfortable with the built-in SQL IDE.
The new SQL Query editor allows you to run queries in tabs,
that persist even if you close your browser and return to Databricks SQL later on.
From here, you can quickly convert the results of your queries into visualizations,
and build those into dashboards.
Finally, the Past Executions tab offers a quick look at your personal query history,
so that you can easily go back and review interesting queries.
Thanks for watching this demo.
Visit databricks.com/try to get started with Databricks SQL today.