So, this presentation I call "Learning Analytics in Action:
Empirical Findings from an online program pilot."
doing
Action Resources are comfortable to me but it was a
great process for me to go through.
mom's I hope you understand
the process that can be used to run
an A4L pilot. In my case, in an online program.
hate an online program the
The second point is being really
trying to generate and gather feedback and
documentation of what is the impact
of A4L at your institution.
enough to just throw it out there but really to
gather evidence
and then I hope that
you'll come to come back next year wanting to share your
own failures about what
you've learned in using an
ellipse
tell me about Boise State University we
are located in the in
Boise Idaho beautiful town
if you never been before as
of fall 2017 be about twenty four thousand
students and
none of those are undergraduates I
work in the eCampus witches are fully
online programs and courses we
have 20 fully online through this and
about 43% of our students at Boise State
on some kind of Our Endless journey
is that we've been experimenting with antlers
for a while to you campus we
have been using has a built-in reports
and Blackboard to create these retention
reports that we get out to people and
then earlier this year we begin for a minute
k 4 L until we've been in that Sprint
technical process of past years and
now we're really looking to how do we Implement
that fit to improve
skin success intentions in Arkansas
so so the first thing we
did is we decide to do a pilot
project that's kind of how we like to do things around our
institution so we partnered
with one of our only online programs and
send it to the nearest degree
completion program so that means
that your students who have
had stopped out of the University but I
can come back
and they can take kind of a set of
four classes to finish their degree
focusing
on things like leadership and teamwork but
it's really kind of gathering all the credits
to have already and and help them since
they're completely online
it's really focused on not traditional
didn't even see some numbers they
are about how they are not traditional utilizes
the iTouch advising model submitting
that there is a low
ratio of a visor
so do they call it a
wife love or concierge service altitude
we piloted it April
and 7 courses with seven different prophecies
about 338 total
sample
reports that can be shared
with other people who might want to Pilot
a Pharrell a list of best practices
and Lessons Learned in the online suit
intervention process sample
program possibly
any empirical data to show the impact the
intervention and a research report for
setting on the pilots of the first
is pilot
group when we kind of identify key information that
they would need in order to
you know if they want
to see use analytics what would the information
so
you know they identified some things we
took if
we can get you this by giving
you this report and
we did a few presentations nothing
nothing super big but
you know and
then we talked about how they wanted them delivered
to them using
SSRS it wasn't the most elegant solution
but please set
a reminder with report every week of
you know what was happening
then we kind of went
through with the program we did find a workflow
ride how this information should be used
know when the semester is should be
in what should happen when you know
exactly member Caesar important information
about student who should
they contact between
the family members in the advise if you can work
out this Cadence for how April
should be used in a poker and
then this is the most important things
that we did is we wanted to remember
earlier document
the dimensions
and because of the Season 8
for Alan it's reports in there
there wasn't like an integrated system
of a way of capturing what we were doing around
so I mentioned before that we
sent out a report on a weekly basis
to The Faculty members in the advisors and
what we did did
you do anything as a result of the report
that you see this week what students did
you reach out to them
to say was approved
about this report
and we did a midterm
survey with this actually
not even mine is like 7 of them so they
know they are
most likely found the reports useful
least 66%
getting
this in their email and they were disposable rainbow
sings the consensus
was that the number of log-ins was the most
important for them minutes
that
is a minute maybe the next
one thing we were kind
of had a good sense of what was going on
with the students grade and so they
may be didn't need that information
other things like login that wasn't
immediately
Bank of Erath open
ended questions I hate these
the bride a method they
held in either identify someone. Of my radar
or what I already knew about
the benefits of days,
I like to know how long is students
working and interacting with last word is
it now it might have
been
working very hard and excelling
interesting information mean
adding ordering prisonsuit technologist
hard worker effort
little something that we wanted to dig into a little
bit more and I think we're we're trying
to with the the data is
you know it's a lot
of time to do not always a linear
relationship between units in the courts
and overall grade it could
be an indication that a student is Drexel
design process with horses
computer use 56%
of Faculty said they are more likely to use their
likely to use a problem in the future
we got
some feedback on I apologize for skipping through the
meteors. Intervention
intervention
that came out of using
April Report with an email to the
student and we have some different
things you'll notice it on
the back of the side we had an option for
no action and I was usually
because the package member already knew it
was happening so they didn't feel the
need to do anything as a result
of one
thing we didn't want to do is we wanted to examine the possible
impact of using a free
all night he's
around here somewhere new
edition my team is been really helpful in
and what I basically did was I print
this a long word document
of all the students had received an intervention
and I wanted
to know what happened after
they receive from April
received
the intervention and then we looked at one week after
that to see if there was any change two
weeks and then did
their activity level increase or decrease
after one week because
I'm a little bit that second week
there's still no significant difference in
the the
amount of interactions of the students are at our duty
as a result of that April coming
through this you know we can't like foot
anything solely on the shoulders of April
and April business this is all
about the intervention process all
about the animation process if we have
the ability to go out and reach out till
April to help us do is to identify
those students that need the most
help
we didn't we
didn't close the retention number 260,
the program level in
the spring
we talked about 5% increase
in consumer retention in hubballi
online program in Antelope
but this is the real impact of Zachary Levi
was working with with April
it's kind of a qualitative
stories that we were able to know
the second one as soon was struggling financially and
invited her was able to refer them to the dean of
students where they receive that
was enacted through April
a student was able to get food and
and again it's
very difficult to tease apart of the effect of a Pharrell
and the effect of the intervention but
we do know is that April
identify these students
like this student Benjamin
come out of a week later and said I'm
just really struggling they're failing your classes because
I have no money I
need food but if
we have the information for
death
but it is a crisis
situation right in the fast
Lessons Learned
in the process when the pilot April
the tool not a Super Bowl what kind of came in
saying that exist
in your in your toolbox interventions
batter and they can also be a black box
I think earlier
is like you know I know but
I don't know what to say and that's
something that we need to look more into the
intervention needed
I don't want to keep track of
those things on a document we
need a government conversation
or starting to have that what you say and
then support training and work was
needed so thank
Thank you.