Well we're here at the demo booth at Shared Services and Outsourcing week here in Orlando
as promised showing you some great technology.
Well last month, we released and put into public preview new technology AI Computer
Vision
And today I've got Lewis.
Thank you for your time Lewis here at the booth.
To talk a little bit about this AI Computer Vision.
Give me an idea what this means?
Yeah sure.
So this is some new cutting-edge technology that UiPath has released.
Essentially what it is is it's a new activities pack.
Okay.
And so what our team did was they actually re-factored some of our fundamental activities
like clicking and typing.
So what our Machine Learning Department did was they developed a neural network in house.
Okay.
That uses Computer Vision to identify user interface elements on the screen.
So things like text, input boxes, radio buttons, things like, that you would imagine seeing
on a screen.
Let's see a difference of what this would mean for our customers.
Sure.
Let's dive in.
Here I've got just an example PDF, right?
This could be some fillable form and with our classic packs things like typing and clicking
with PDFs can be somewhat difficult.
Okay.
So when I hit indicate on screen here, we see the blue pain of the you know, this robotic
vision is highlighting this entire screen.
We can't find selectors for the individual elements on the screen.
So if I want to type in this given name field, I would have to do some clever work around
to make this work.
Maybe I could click on this and use tabs or keyboard navigation.
Trying to find it somewhere.
Exactly and this is analogous to any sort of remote environment.
So if we're dealing with Citrix environments or virtual machines same thing happens, we
can't reliably find selectors with our classic activities.
So now, with the release of our new computer vision activities, we can do just that.
So let's go ahead and build a little example here.
So I've pulled in my computer vision screen scope up here.
I'm gonna indicate on screen the former, image I'd like to you know deal with.
Any PDF, any remote system, Citrix, you can be looking at the screen; whatever's on the
screen you're going to grab.
That's exactly right.
So let's go ahead and use a computer vision type into activity.
So I'm gonna drag it into our work bin here and now I'm going to indicate on screen.
So now this is where it gets cool.
So now we see that we're able to identify.
Okay every single word and input box on this folder.
So I'm going to go ahead and click on it and we're going to see the system actually creates
what's called a smart anchor so we can reliably find that text box every time.
So if that text box moves, will it go and try and find it?
So it will use that anchor and in this case we selected this text box that's next to the
given name field.
Okay, so if those rearranged somehow on the page, it would look for that same pattern.
So let's go ahead and run this automation here.
So the OCR is going to scan this page here.
It's going to identify the given name field and go ahead and type UiPath into it.
Great, so it filled it all out.
It could do any kind of forms, brand new kind of technology, in public preview now, so people
can look at it.
What kind of benefits are you hearing or what do we think is going to happen for customers?
What's the biggest benefit for them?
Sure.
So this is a real game changer when it comes to Virtual environments.
So anything we're talking about remoting into a machine, VMware, Citrix environments.
In the past, sometimes it was impossible to grab reliable selectors for those kind of
scenarios.
Now with computer vision, we're able to reliably determine these selectors which means that
we can accurately, and confidently, type and click in these kind of environments.
A real game changer, I totally agree.
You know AI computer vision now in public preview go to our website check it out.
Call your salesperson or customer success manager if you want to know more
And of course follow us online at anytime for more demos and interviews from Shared
Services and Outsourcing Week.