Welcome to the SAP HANA Academy. My
name is Bob and in this series of videos
will be looking at SAP S/4HANA. In this
video series will be looking at how to
extend S/4HANA with external data
and in this second video we'll be
looking at how to configure the SAP
HANA Smart Data Integration Data
Provisioning Agent. Please note that this
video set shows certain features in
the SAP HANA database which may
require specific licenses even if you
are using S/4HANA. If you are using
your own S/4HANA system and are not using
the S/4HANA trial please contact
your account executive or partner
manager to see if you are licensed to
use these SAP HANA database
features. They are SAP HANA Smart Data
Access, SAP HANA Smart Data
Integration, creating a virtual table in
SAP HANA and creating a calculation
view in SAP HANA. In the previous
video we loaded some data into Hive and
what we need to do now in this video is
actually set up the SAP HANA Data
Provisioning Agent. So there's an
assumption when it comes to this video
and that you've already installed the
SAP HANA Data Provisioning Agent. If
you're not sure how to do it if you do a
search for our website which is academy
.saphana.com that will link you to
our YouTube channel. At the bottom of
this YouTube channel you'll see that
we've got a section called provisioning
and there's 60 plus videos on a SAP
HANA Smart Data Integration and Smart
Data Quality. There's a few videos in
this playlist that we’ll assume you have
watched. So one of them is on how to
install the SAP HANA Data
Provisioning Agent. Now it's got a kind
of a funny name it's actually this video
on Twitter replication part 1 of 3
because essentially the install is very
similar. Now as you can see this video
was for SPS 09. I installed the SPS 12
version. So it's essentially the latest
version available within service
marketplace. This gives us both the
connectivity to Hive
as well as file formats which we're
going to look at in the next video. So
you'll need to watch this video.
Additionally it will be useful if you
are also to watch the second video which
is on user authorizations. We’re going to
create a specific user to carry out some
tasks and that user will need some
rights. I'm going to recap it very
quickly here but if you want more
in-depth information it's a good idea to
watch that user authorizations video as
well. Now if I go back to the homepage
we've also got some other videos that
you might find useful. If I go right down
to our provisioning folder again we have
45 videos on SAP HANA Smart Data
Access. So this includes connecting to
Hadoop and creating what are called
remote data sources. So it would be
useful for you to watch the Hadoop
specific videos in this playlist because
again it will help you and give you more
information on how we connect SAP
HANA to Hadoop. We’ve got various ways
of doing it and this playlist will show
you all the different ways. So assuming
you've installed that Data Provisioning
Agent what we're going to have to do
firstly is create ourselves a specific
user within the SAP HANA Studio. So of
course we use the SAP developer tools
for Eclipse on this S/4HANA partner
image and again watching those few
videos within the Academy's website will
help you understand some of the concepts
I'm going to go through quite quickly in
this video. So one of the first things
that we need to do when we've logged
into the SAP HANA Studio is check
that the DP server is on. So I'm going to
do this in my SAP HANA administration
console. You've been using the ABAP
console in previous videos.
We’ll select the system connection. You
should have three. Of course BPINST, SAP
HANA DB and system and then when you
select system you can select here your
console. So the first thing again it's
covered in the video how to turn on the
Data Provisioning server is to make sure
that that DP server is on. So on the
right hand side you'll need to click on
the tab which is landscape and here you
can see in a few
seconds that the DP server here is on. So
when you've done that what we're going
to do is create ourselves a specific
user. So I'm going to launch myself a
SQL console and we're going to run
the following script. So what we're going
to do is essentially create ourselves a
user called SHA user. We’re creating a
package called SHA user and the main
three rights we have to allocate are
these three at the end which enables us
to create a remote source,
administrate the adapters and also the
agents. So they're really the only three
rights you have to add as that user. So
but I'm going to run this script. It’s
all explained in that user
authorizations video. So when you've
executed that what we should do on the
left-hand side now now we've created
that user is create a connection. So I'm
going to right click on my system
connection add system with a different
user and what we'll do is we're going to
add that SHA user login and of course
Password1 as the password and of
course what's going to happen is that
you will be prompted to change the
password. So if I click next and finish
all you'll have to do is enter yourself
in a new password.
So I'll type in the old password here
and I’ll type in my new password here
and then I’ll click on ok. Ok we can see
the password’s changed.
so now that we've created that login we
can close this SQL console window and
what we just need to do is allocate one
more right and we need to execute this
as the SHA user. So I'll select the SHA
user and then I'll launch a SQL
console from here and we'll run this
script from this window specifically for
the SHA user. So this is going to give
the SYS REPO user access to our schema
and this will help us with modeling
later on. So once you've done that now
we’ve actually finished creating our
user which we're going to use and which
will house our Hadoop tables. So the next
step is to configure the Data
Provisioning Agent. So we can leave the
SAP HANA Studio on now what I'll do is
again I’ve already installed the DP
agent so I'm going to launch it by going
to SAP HANA Data Provisioning Agent
configuration. I'll maximize the window
and what we need to do firstly is
connect to our HANA system. So I'm
going to click on connect to HANA here
on the left hand side. We’ll then put in
of course the IP address of my HANA
server. We’ll put the port which for me is
30215 and then we're going to login
as that user which is called SHA user
and will then put in our password and
then I'll click on connect.
So there's a few tasks that we'd have to
do here. Firstly we need to register our
SAP HANA Data Provisioning Agent by
clicking on register agent. I'm going to
create an agent called SDI_
AGENT connecting to my Windows remote
desktop. So this is the IP address of
this machine. Of course the 37 was the IP
address of the HANA box. So then I’ll
click on register. We basically telling
HANA where the SAP HANA Data
Data Provisioning Agent is. I’ll click on
ok and once you can see that it's
registered and we can see that the agent
started and we've connected to HANA
this is where we can switch on our
adapters. So in this video we're going to
be looking at the Hive adapter. So I'm
going to click on register adapter and
then we'll click on yes and then we'll
click on ok. So there's no real
configuration to be done here within our
Data Provisioning Agent. There's just one
more task that needs to be done. So if I
go to my Windows explorer and we're
going to go to my D Drive where I've
installed that Data Provisioning Agent
which is on usrsap data prov agent.
There's a folder called lib. So
essentially we need to place a JDBC file
in here which enables us to connect to
Hive. So which JDBC file do we use? Well
it all depends on your version of Hive.
So the way you can find that out is by
going back to your browser and if you go
to your specific version of Ambari again
it depends if you followed my videos or
if you're using your own version of Hadoop
but in Ambari all you need to do is
go to stacks and versions here on the
top right hand side and then if I scroll
down I can see Hive is actually version
121. So this means I'm going to have
to install or put a single file within
that lib folder here which is 121.
There are many different versions of
Hive depending on which HDB for example
you've installed. So I'm going to put in
again the version 121. So where do we get
that from?
Well if I launch a tab we need to go and
get the specific version of JDBC for
Hive. So this is where you can get it
from. So I'll just paste in the URL here.
So it's repo.hortonworks.com
/ content repositories
releases org Apache hive and then hive
- jdbc. So essentially you need to get
the version for your system. Now for me
if I go right to the bottom these are
all the different versions of Hive. Our’s
was 121. So you can actually take
any version of this 121. If I go
right to the end. I am actually going to
take the latest version which was
released in June, end of June. So all I
need to do is go into that folder and
there's a file called standalone.jar. So
what I'm going to do is I'm going to
download that by selecting it. It’s only
18 MG for me. I’m going to keep the file
and if I go to my downloads folder what
I’m going to do is I'm going to copy
that file and I'm going to place it into
my Lib folder. So I'll right click on the
file I'll cut the file and then again
I'll go to D usr and then we'll go to
SAP data prov agent and then the lib
folder so I’ll paste the file here in
this folder but what we essentially need
to do is give the file a name. So
essentially in this version of Hive
which I think was anything above zero
. 14 you only need to put one of
these files where in previous versions
for example in 0.13 of Hive you need to put
three or four and of course everything
is explained in the videos and on
help.sap.com but essentially what I
do is I copy this file paste it and I’m
going to rename the copy. I’m just going
to give it the name of the extension. So
if I rename the file and take away
anything after what the version that I’m
going to call in the remote data source
you'll understand this in in the
next video. So i'm going to call it
essentially Hive - jdbc - 121
. jar. So essentially we've got that
file that's all we need to do.
So once you've got this file with this
naming format in this folder we've
actually finished the configuration of
the SAP HANA Data Provisioning Agent.
So again just to summarize what we've
done in this video. We’ve configured the
SAP HANA Data Provisioning Agent. We’ve
switched on the Hive adapter and we've
also created a user within the SAP HANA
Studio which we're going to use called
SHA user. Now what we're going to do in
the next video is create the connection
to our Hadoop system from the SAP HANA
Studio and then we're going to create a
virtual table which is that Airport web
services CSV file which resides in
Hadoop.