I want to talk about walking you through the story of president
Kennedy and his asass inauguration tanged cognitive
Search. He was assassinated as he was
Dallas. He was shot by a lone gunman.
At least that's the story the believe.
There's been a ton of controversy to a point where an
Act of congress was defined to release the document that the
Cia had on the investigation by 2018. That happened.
So a couple of months ago the government released what amounts
Documents which are the materials related to the
Assassination. I want to know what's in them,
But there's no way i can read through the 50 thousand
Documents. So what i want to do is create a
Continuous process that enriches search.
And as of today you are going to do this.
This morning scott guthrie announced a new feature within
Azure search that allows you to take your data, ingest it enrich
With cognitive skills and use a search to explore it.
Let's do that. Let's explore
The jfk files. [ Music ] >> okay.
That's enough. Here are the files.
On the lefthand side you can see a bunch of tags extracted.
You can see a bunch of companies, places, people you
Can see the documents talk about jfk and the cia and the act of
Congress and what not. I want to start with oswald.
You'll see a bunch of documents we've already been assigned a
Place in the documents to talk about oswald.
Used to understand. Or even a photo.
The photo that appears does not say anything about oswald.
There's no oswald written but with the computer vision skill
It uses posing for the camera.
Which is close enough to be accurate. When i search for as wailed i
Get this -- oswald i get this image back.
I scroll down more. I find something here that looks
Like a typo. It says jiffy flow.
And it was for oswald. It's not a typo.
If i go to this web site and some person, whoever that is,
Has cure rated a list of the cia [ indiscernible ]
On the planet. So jiffy flow is the code name
For lee harvey oswald according to cia.
Passed through the web site, extracted the [ indiscernible ]
And used as annotation in the context of my data.
In a search of oswald in the results is also the name.
As i look at the key words andant tis extracted, one --ant
Tis extracted one is relevant. Cuba. He had a connection to cuba.
Meeting with a person working in the mexican con sol late.
What you may know or not, in the 60s there were a lot of things
Between u.S. Government and castro. [ Indiscernible ]
Let's see if we can learn a bit more. We will search for astro and operation.
-- Castro and operation. And i find a bunch of documents
That relate to something called mo ngoose. I can read and see what it's on
But let's see if it can understand what is in the
Documents without me trying. I will open this created based
On the documents. Look what pops up.
What you see is this documents, when i ask about the castro operation.
They talk about the mafia, the
Chicago mafia. Fidel castro.
-- And operation mongoose which is an attempt by the cia to pay
The mafia to kill castro by bills. I don't know what is more
Picked this up without knowing anything about the topic.
This is unsupervised. This was not created by somebody
It was created by running cognitive skills on this for
Documents and i can pick up a bunch of interesting pieces as
To what went on there even though completely crazy.
There's one more thing. When the government releases a
Trove of documents to talk about the assassination of a
President, there's one thing that you want to make sure, your
Name is not on it. My name is not on it but one of
Microsoft snowplows. I know what you're thinking you ever think if there was
Something involved in the ould have
To be vista.
No. This is a deck that was created
By the cia in 1997 talking about how did they build a system to
Annotate all these documents. There's a bunch of couples -- documents.
If i find it. Where is it?
One slide. Sorry.
Heres the. The architecture that the cia
Built in 1997 to do exactly what i showed you.
They -- the sql server. [ Indiscernible ]
This power point talks about how many millions of dollars were paid to do this.
How many hours of overtime paid to human fleece manually --
Employees to annotate the data. And we built this in two days.
With one developer. And here's how.
I'm keeping the top secret clip out from the cia.
So we put the documents inside azure storage.
In a blob storage, in this case. Then we ran instruction of the
Content from the pdfs and power point s and world documents.
And ran a set of cognitive skills. They come built in with azure
And ocr, computer vision,ant tis.
And learning to do a bunch of
Interesting thing.
If i close this i go search for oswald. What i really want to find is
The top secret things. The things that even when the
Government actually released they still kept redacted.
Go down here. You see re-daks flag.
-- Redacted.
We don't have any cognitive skills to know what a redacted document is.
I partnered with one data scientist to build
A re-daks classifier. I use this now as a faucet in my
Search index and find documents redact
Ed or poorly not redacted and you can still see.
But it's the government, what can you
Expect? let me show you how.
All this data. All this built in cognitive
Ins i created.
Put inside a search index to allow me to search the
Data. This is the azure portal.
I will look, go directly to the search
Service i already provisioned. This is my search service.
Cognitive search. The easiest way to do it, import
Your data. I will connect to my data.
The search can [ indiscernible ] sql
Db. You can also have a push api to
Upload data from whatever mechanism you want.
I will connect to my existing blob.
I have an existing blob here. Contains the jfk files data.
It's going to look into the schema of these documents.
Seconds. In about two or three seconds it
Will understand what is going on. Offer me what kind of
Annotations the -- you want to run on this data.
Come on.
Never trust anything that is live.
Okay. So i can go --fy want to run the
Images and pdfs extract images and generate a document. I can run built-in skills.
Extracting people names, location, all the things you've seen.
Detect languages in russian. Move this language field to the
Rest of the skills so they can know what kind ofant tis and
What language to search. If i click okay azure is a great
System. I deploy a pipeline that can
Listen in or call to all of these data sources.
Uck those documents and give me the
Results in a search index i can explore.
It's easy. This is what gets created in the end.
This is the jfk file kill set. If i click on okay.
What will happening it says ocr, handwriting, envision.
And more. Let me show you how easy it is
To create a custom skill. So
This is my custom skill for detecting redacted images.
So all i have to do is tell it, tell it it's a can you tell
[ Indiscernible ] take every image and send it to the skill and
Watch it be the output. The output is
A redact. Append to every image.
This is how within my skill set. Right now you cannot create a
Custom skill in the profile you have to do go to usdk.
And the azure function i call is also about 20-something lines of code.
It passes the request, creates a file, and calls
It. And then [ indiscernible ]
I needed some small data scientist to build this thing.
Use some python package which i know nothing about.
I use azure machine learning to create a container, a web look.
I use this thing to plug into my skill set to run this as part of
The cognitive search flow. While i've done this on jfk we
Have customers in private preview. Today public preview doing it on
Legal contract, engineering plans, form, pdfs.
Sharepoint documents and tomorrow we have a session that
You can go and learn more about how
Customers will show us what skills they've done.
Having a built-in ai power within azure research.
If you want to know specifically about jfk we have published
Everything on github. Go to github find the jfk files
And deploy one on your own data or go to the azure and as of
This morning it's available and provision your own cognitive
Search instances. Thank you for staying with me