>> Hello and welcome to This Week in Cognitive,
I'm your host Noelle Lacharite,
and it is my pleasure to share with you some of
the cool things we've got going on in
Cognitive Services and Applied AI.
Today, I want to show you one of the tools that we use
internally and that you actually have access to,
in order to test out some of the latest and greatest services,
inside of Cognitive Services and Applied AI organization.
So, I've shown over the course of some of our episodes,
we talked through a lot of the different services.
It's always really great to be able to have a way of testing
them or building projects related to them,
and one way that we do that
internally is through a tool called the Intelligent Kiosk.
So, it gives you the ability to test out many of these services,
but we also give you the ability to build that kiosk yourself.
So, I'm going to walk you through just a couple of those things.
So first, the Intelligent Kiosk is an app
that you can download from the Windows Store.
In your case, I'm also going to show you in
just a minute how you can build that app and deploy your own.
But let me just talk you through
a couple of other things that are in here,
and anytime you go to like a conference,
or come to our Executive Briefing Center
here in Redmond Seattle area,
you would have the ability to kind of test this out.
It's a very very unique way of seeing
a bunch of different functionality in a single application.
So, you can see here we've got things like Vision Explorer,
being able to test out computer vision,
being able to do real-time driver monitoring
to detect distraction.
We also have things like News Analytics and Emotion API.
Real-time Cloud Insights, this
is always a crowd pleaser at conferences,
where we put it up on kind of
a big screen and add a couple of cameras,
and as people walk by it's able to
instantly identify using the Face API,
as well as computer vision, things like,
gender, age range, sentiment.
Are they happy, sad, bored?
It's useful information typically
at a conference, but it's super fun.
A lot you always see people walking by
and they try and change their face to
get a different age to show up and sometimes it doesn't work,
but sometimes it does, I do find that happy people look younger,
so you should smile more often.
But let's take a look at a couple of these.
One is the ability for us to use vision.
Custom vision, we're actually going to
combine a couple of different services here.
The first service is being searched,
so I need to go find an image to analyze.
So, I go in, I use Bing Search as a service in the app,
you'll see this in the GitHub sample code,
and it maybe I would type in,
some of you are getting to know me I like motivational quotes.
So, let's fix some of those. You'll notice what
happen when I start typing in a couple letters,
auto suggest, automatically suggested some options for me.
So, that is also another service that you can take advantage of.
So, a bunch of things come up here,
I'm going to pick one that's a nice motivational quote.
Here are some interesting things that
happen as a result of this analysis.
Now remember, these Cognitive Services,
the reason they're so interesting is that
you as a developer get to access them,
either through an SDK or a RESTful web service call.
So, very, very simple access,
you pass in this request,
send in the image in your RESTful call,
and you get this data on the way back for
you to do what you will within your application.
So, imagine here if you're looking at this,
it gives you these tags.
It also gives you a description.
It gives you celebrities
if there happened to be any using face recognition,
but here's an interesting part, colors.
So, it allows you to take a look at an image,
maybe you have multiple calls to action on your web page,
and based on what that user picks,
maybe they pick one that has blues in it,
as opposed to the one that has oranges.
Now you know that they like this blue for whatever reason,
you can actually hyper personalize,
take their experience, and now shift everything to shades of blue,
because you know that that's what's
driving their action on your site.
These are really great opportunities for us to create
better experiences for our customers and users of our application.
Now, you also notice there's
this feature of Computer Vision called OCR.
OCR allows us to go in, this is an image,
it's from like gooddayquote.com.
OCR or being able to click and drag this image or
try and grab the text off this image is
typically pretty difficult to do.
But in this case, you could see it's able to pull all that off.
Now, why is this important?
So, imagine again if a user passes you an image,
you can now grab text from that image which was old, otherwise,
difficult to do, and now you can execute
a search on any other content that you pulled off.
Notice here, it gives me back Confucius.
So, now I can go in and do a search on
Confucius and pull back things like YouTube,
or SoundCloud, or audio,
or voiceovers, or anything that's related to that content,
again enriching the content that I can
return back to the user as a result of their request.
So, really interesting stuff and it's great to be
able to build an application that
just demonstrates this capability,
it gives you a chance to review
the metadata that you get back from these services,
and so as a learning tool I think it's really, really useful.
So, let's jump to how will you learn this?
So, I will take you over to the GitHub project,
you can actually type in aka.ms/intelligentkiosk sample,
and we'll put that link in the show notes,
and you could see in this sample,
it provides you the ability to rebuild this,
and as always we provide a nice README file,
that'll walk you through what you need in order to build it.
It is a UWP app so be aware of that,
and then running the sample,
you'll need to have a development environment,
you'll need to be ready to deploy it as a UWP app,
and here's all the different projects that are included.
It is not a direct match to what I just showed you,
but we're constantly adding more and more projects
into this area and updating it all the time.
Most importantly, is if you
test some of this and you want some help,
you can submit GitHub issues
and our team will review those issues,
and even you could contribute to
some of these projects if you want to.
What a great opportunity not only to learn by doing,
but then also to even maybe make a difference in
another person who's trying to learn
this by either fixing something,
making something more clear,
or even adding an entire sample to the project.
So, one last thing I want to mention is the ability to build
this at the edge using a device or a Raspberry Pi in this case.
So, not only can you of course
build this as an application that will run on him,
or she, or in the cloud,
through a web application,
or through an application native on a computer,
but you also now can start
playing around with building devices and
integrating these models into devices, really cool stuff.
So, in this really quick week episode,
we decided to just give you a chance to take a look at some of
the projects that are
available for you today that you could build,
that demonstrate some of
the common capabilities provided with Cognitive Services.
So, if you go in again take a look at the show notes,
we provide the link to go and build this yourself,
and you can also download the app and play with it there too.
So, hopefully, you found this interesting and I
encourage you to start building something really cool today,
and I'll see you guys in the next episode.
[MUSIC]