I'm Josh Kaplan, one of the product managers on the Azure Synapse team,
and today I'm going to show you how data engineers and data scientists can use business application data by Synapse link for Dataverse.
Business application data available within Synapse. With just a few clicks, I want to show you how.
First, within the power apps portal, you'll now see the option under data for Azure Synapse Link.
This used to be called, Export to data lake.
Now in creating your export.
You now have the option to not only export the data to a data lake,
but also connect it to a Synapse workspace.
You select that option there, pick your subscription.
Resource group and finally pick the workspace that you want to connect to this data.
As well as which storage account you want to put the data in.
So this will list out all the storage accounts that are already connected to your Synapse workspace.
Then I'll click next.
Then I'll select which tables I want to make available within Synapse.
I'm going to take account.
then I will take a few others
than are within here.
With tables selected, all I need to do is hit save and
this will go and actually start making this data available to Synapse.
That's really it. They don't want to be continuously exported and replicated out into a data lake,
and then data will be made available in Synapse for you to go ahead and use in query, which I'll show you in a moment.
Now that the link is complete, I can select the link.
and open my Synapse workspace.
Once within the workspace on the data tab you will see a new database created with the name of your environment from Dataverse.
Expanding that we'll show you now tables. We'll now show you the tables you selected.
In addition to just the tables, you'll also see the schema that goes along with it.
And immediately this data can now be accessed using Synapse SQL or Synapse Spark.
I can go ahead and create a new SQL script.
And run this using my serverless SQL pool.
And no, there's no copy of data being made here into Synapse, data is just put in the lake, kept update there, and we're accessing the data directly from the lake as it gets loaded for any change.
Within seconds you'll start to see those changes show up within here.
Now this is a normal SQL endpoint. You can use this SQL endpoint. You know that it is in the lake. You can use a SQL endpoint.
And these tables inside Power BI or any application that supports TSQL.
Just as if this is a normal SQL database now it's not a normal SQL database.
The data is in the lake like we talked about,
but also this database can be used with Synapse Spark as well.
So I can take the same table here.
And not only run SQL queries against it, but I can create a new Spark notebook.
And within this Spark notebook I can use the language of my choice to read data from these tables.
One actually switches over to Spark SQL.
And use. Select my Spark pool.
And I'll go ahead and run the notebook.
And actually.
One thing to note, this is a pretty big table, so you put 100 rows on here.
And now run the notebook.
Once your Spark sessions up and running, the query will run. Accessing the same data.
And returning results.
Showing that both engines can actually work over the same data.
Within Synapse Studio and without.
This was a quick overview of Synapse link for Dataverse showing how business
users, data engineers and data scientists can all work on top the same data coming out of Microsoft business applications.
Hope you enjoyed this video.
And check out our channel for more Synapse Spotlight videos.