in this video we're going to take a look at a tool called 5tran and see how easy it is
to get started from scratch and actually using it to integrate our data if you're
not familiar with 5tran essentially what it does is it automates your data integration
from source to destination i think this gives a nice little visual here essentially you can
connect to a bunch of different sources and have five tran extract and load it into your
data warehouse for you on uh some sort of automated schedule in this example we will look to
move a simple google sheets file and drop it into my snowflake environment so we want to first set
up five tran connect it to google sheets as well as snowflake and see if this can work so let's get
started i don't have an account i'm going to set up a free trial so i'll put in my information here
i'll go through and get this confirmation so this page is where i was taken to from my email address
once i had to confirm confirm my account
get started
okay so we're in now let's set up our first connection in this case the data source will
be just a simple google sheet i made this one here with just some nba players so let's try
to connect there here we go google sheet but you can see here there's a ton of options they have
all sorts of connectors right out of the box for this demo we'll do google sheets destination
will be snowflake i have a snowflake environment and we'll want to drop that there so i'll click
snowflake but you can see also here all sorts of different options okay set up
destination schema schema is permanent and cannot be changed after connection creation
google sheets so i'm assuming this is the name of the schema that will
happen in here destination table this is permanent the table will i'll call it mba players i'll keep
it the same as the sheet here share this sheet with this email address okay copy and share okay
share all right person added now the url the url of your spreadsheet so the whole thing let's
copy this paste find sheet named range
select a range okay so what i want to do here is data named ranges add a range we'll rename this
to player list and i'll have it be this whole selection okay done all right let's go back
click this again let's see if this will refresh it there we go okay player list us
all right save and test not too bad so far let's see if this worked all green okay that's a
that's a good sign let's continue snowflake this should be a little easier i would imagine
follow the setup guide i'm assuming this is straightforward here so i'm going to your
account snowflake.computing so i will take this i will take this whole thing here and put it in
port user 5 train user so if you're using snowflake this would make sense
because you can isolate you can make a specific database you can make a user
and even give them a specific warehouse you can monitor this so i'm going to copy this here
this looks like it's going to give me what i want let's take a look
so i'm going to create the role the user set a password create a warehouse a database
and this should just get us going so i'm going to run this all right so off the bat i can see
the warehouse and the database here to test this out just to confirm i'm going to log out
and log back in as this user okay good so i see the role here and that's it it only has this role
it should only have this warehouse and it can see this database all right lovely
so i've kept these as is let's see user five train user database
it's technically five tran database let's let's keep this case sensitive just just in case
we'll do we'll do password password you know obviously if this was a production
environment you would make this password more a little more legit and lock this down a little a
little more than we're doing here but okay save and test let's see if we can connect
okay connection host connection not the protocol okay got it
just try again okay green is always good all connection tests passed
let's continue your data is ready to sync let's do it start initial sync and just to confirm there's
there's nothing in here right now so let's see what happens
i'll pause this video this might take a couple minutes to let it go and i'll i'll restart it
once the sync has completed this completed it really only took maybe about a minute or two
but let's let's see what this looks like let's go back into snowflake and refresh
and we see okay now there's a new schema called google sheets there's an audit and the players
okay let's preview this
so we see the row all the information that matches
what was in here i'll be in a different order which is interesting you know first name last name
this the columns are in a different order it looks like so that's interesting
and then we have a synth time here which looks like it's utc let's see what the audit looks like
okay so we can see how many updates status progress what table specifically was was updated
all right so that's pretty cool so we're up and running we were able to sync a google sheet to
snowflake pretty easily it really was not too complicated and at this point it's set up
i imagine it would be pretty easy to add more sheets connect to different databases and you
know really connect all sorts of sources to bring your data into your warehouse
and then from there you would use something to transform it so let's say something like dbt
which if you're interested in how that works there are some other videos on this channel that you can
learn a little bit about that and how that might work so this is pretty great that was that was
pretty easy so let's take another look around some of these other things here we can see this
little green marker here that shows the sync time it's enabled we could sync it right now
here's some logs here's some actions it looks like you can do transformations
uploads oh we could upload a csv destination logs users alerts
and here we can see the connector we can see this one specifically schema i guess if this was maybe
a database a table and a database you'd have a little bit more here setup we can see some of
the we can see the connection details and here's how frequently it's going to sync so we can set
how often five tran attempts to replicate data so this is going to do it every six hours and looks
like you can go up to five minutes so you can you can adjust that as needed send a notification
or delete it resync all data delete it permanently so yeah pretty cool all right i'm going to disable
this for now because we don't want this to keep going so that's it for this video i wanted to just
walk through an example of how you might set this up and get started with 5 train connecting some
basic source such as a google sheet to snowflake so i hope you found this helpful let me know if
there are any questions on this thank you for watching and i'll see you at the next video