>> You're not going to want to miss this episode of
the AI Show special edition for Microsoft Ignite where we learn
how Cognitive Services put together make
for amazing intelligent applications with my friend here,
Chris. We'll see you there.
[MUSIC]
>> Hello, and welcome to this special edition of the AI Show,
coming to you from Microsoft Ignite where we're going to learn
about a bunch of Cognitive Services from Chris.
Tell us who you are and what you do, my friend.
>> Yeah. I'm Chris [inaudible]. I'm a Program Manager on
the Cognitive Services team and
today I want to show you a little bit about how
the Cognitive Services are letting businesses get more
productive and embed intelligence into their applications.
>> You're going to show us not just one,
but a couple where we're solving
problems with a bunch of them. Is that right?
>> Yeah. So I want to show how you can start with
some base technology like
our OCR which can extract text from images,
and then use that to build
a higher and higher level of capabilities.
>> All right. Let's do it.
>> Yeah. So first I want to show you that base OCR capability.
So this year we released a new update
to that model which really improved the performance.
>> This app that you're showing us. Where is this coming from?
>> Yeah. So this app is a demo application
that we've built and we put out there in open source,
you can find it in GitHub under Intelligent Kiosk.
>> All right. We'll be sure and put
a link in the show notes so you can go and look at that.
>> Yeah, definitely. So I want to start by just
showing what's available out of the box.
You can send an image to our Cloud service and it can go and
detect the text right
out of the image without you having to build your model,
train it, and do any of that complexity.
>> That's cool because it's crooked.
It's not even straight and it still somehow got that.
>> Yeah, it's getting it crooked.
It's getting the different sizes,
and you've got the bounding boxes so you know where it is.
So this is what you get out of
the box with just our OCR capability.
Then what we've released starting at build and then
continuing to build and mature is our form recognizer product.
>> Which is really cool.
I'm a huge fan of this thing.
>> So form recognizer lets you build on that base
OCR and not just get a bunch of words in a digital format,
but start to know hey,
I've extracted this word and I know that it
is the address in the address field of my form.
>> I see. Okay.
>> So I got a quick demo to show that here-
>> Let's see it.
>> -where we can look at invoices.
Where you might have this invoice from your business where you
have some fields that you might not just want to know the address,
but you want to know that it is an address and
you want to know what is the invoice number.
>> I see.
>> So all you need to do with the form recognizer is
provide at least five examples of your filled-out form.
We'll go ahead and train the model for you,
customize it to your specific form,
and then you can just send an image and get the content back.
>> Now, while this is loading, one of the cool things.
I actually did this demo,
and I foolishly thought I need to give it as many PDFs as I can.
They're like, no, Seth,
you need to give it just five and it will be able to recognize it.
>> Yeah.
>> All right. So what is it that it actually returns?
Because I love form recognizer,
like I was saying. What does it actually return?
>> Yeah, so what you get back is not just the extracted text,
but you get it back in JSON already
extracting in a key value pair scenario. So let's take a look.
So looking at the raw data that's sent back.
You can see that we get the key is
an address and the value here is one Redmond Way.
That's cool.
So it's not just that we know, hey,
one Redmond Way is on this form,
we know that is the address that it's being listed here,
and so it really lets you get to more powerful scenarios
faster than just that root base OCR engine that we showed earlier.
>> That's awesome. So we did OCR which was amazing.
We did form recognizer. What else you got?
>> Yeah. So now I want to show you how you can
take this capability and build it in and
combine it with some of our other Cognitive Services
to continue to get even more powerful solutions.
>> Awesome. Let's see that.
>> Yeah. So I have a quick scenario
here called insurance claim automation.
>> All right. Let's take a look at that.
>> So you can imagine we're insurance adjusters.
>> Okay. You and me.
>> Somebody's sending us a picture
of their car that they had an windshield accident.
>> Okay.
>> So we asked them to take a picture,
and maybe they submit a form of their incident.
>> That's an awesome incident you got going on over there.
>> Yeah. So you can see here that they might submit both of these,
and we can then use "custom
vision" which allows you to train a custom object detection
to basically identify the windshield crack
in the image that we sent.
>> That's amazing. So you uploaded an image and
it's basically, you get the crack,
you know where it is, and you're able to
submit this and get some automation automatically.
>> Yeah.
>> Automation automatically.
That's what AI is all about, my friends.
>> Yeah.
>> That's awesome.
>> So you can see what's returned here is we're getting this
"custom visions" detecting the crack, telling us that it's there,
and then it's using form recognizer to
extract the claim details from the form we uploaded,
combining it together and now you
can automate that pipeline and really speed up
the process of getting the money
back in the hands of the person that needs it.
>> The thing that's cool about this is
sometimes when I look at Cognitive Services I'm like,
"Oh, well, that's useful.
Oh, well, that's useful." But it's even more powerful when you
start to put them together into actual applications.
Are customers seeing success doing this?
>> Yeah, we're seeing tons of customers pick it up, combine them,
and we're really seeing that combining multiple services leads
to a solution that's way more
powerful than any one of them could combine.
>> Well, thank you so much [inaudible].
>> Yeah. Thanks.
>> This is really cool. Again, where can people get this demo?
>> Yes. So this demo is available on
GitHub under the Intelligent Kiosk name.
>> All right. We'll make sure to put
the link below. Thank you so much.
This is awesome because the thing about Cognitive Services,
it's weird when you look at each
one of them and you're like, "Are these going to be-?"
But when you put them together they make for
really amazing applications. Thanks so much for being with us.
>> Yeah. Thanks for having me.
>> Thank you so much for watching this special edition
of the AI Show coming to you from Microsoft Ignite where we
learned how a bunch of Cognitive Services together
made intelligent applications even more amazing.
Again, thanks for watching and we'll see you next time. Take care.
[MUSIC]