Welcome back to the oneAPI channel.
If you are on the journey to create an AI based application, you usually start with
the frameworks like TensorFlow, pyTorch or others
And people ask me, why do I need OpenVINO for inference?
I can use these frameworks, or sometimes even a lighter version of them for inference as well
…not only for training..
Well, there are multiple reasons to use OpenVINO.
Maybe the first reason is performance, DL training is usually done on very strong
machines, endless compute power and memory inference is done everywhere, on a small edge
camera, on a drone, and yes, sometimes also on a server
So The device we usually use has compute limitation and memory limitations..
And we want inference do be executed on multiple architecture..
Not only a CPU or a GPU..
And OpenVINO was built exactly for that…
With the spirit of oneAPI, it has great SW portability and almost the same code will
work on CPU, GPU, VPU and more, And even on multiple such devices in parallel,
on CPU and on the GPU of your system together And for each of these devices you are getting
a compact memory footprint, and excellent performance..
Checkout this web-site for examples
OpenVINO 2022 is easier than ever to use and install, and I’d like to show you how to
get started in few minutes..
Your option number 1.
If you just like to learn and try openVINO out,
The easiest way is to just open one of the many OpenVINO notebooks.
Just look for OV notebooks And here there are tons of examples, how to
get started, demos and more…
I’ll just click on this one, and I’ll launch binder…
And that all.
No matter what is you OS, nothing to install..
And of course you can just copy the notebooks and use them locally..
They are yours..
Just run all the cells or one by one..
A great way to learn how OpenVINO works And see it in action..
Your 2nd option, is to use OpenVINO on the intel developers cloud..
For that you got to have an intel dev-cloud account..
It take few clicks, it’s free and easy to use.
Look for intel dev cloud..
Choose the openvino cloud..
Many options to get started I’ll just go to AI sample applications using
OpenVINO For example retail
for example object detection using Tiny YOLO V3
An I have here a notebook, I could also get a terminal.
That is running yolo V3 on the cloud
Just learn how to run it step by step..
Download the model, convert it, and run on a CPU or a GPU or other machines available
on the dev cloud..
Last and my preferred option, install.
Look for openvino.
Here it is.
Free download..
I can download only the run time..
The inference engine…
Here are my options, for these Operating systems..
But I want also the dev tools and all the utilities around OV
I’ll use Linux, pip And here are the instructions.
I’m using Ubuntu on WSL2, I find it very convenient
Open a new virtual environment, I’ll call it OpenVINO _Env _1
Activate the environment..
And we are in Now get the latest pip
And install the package..
Here I’m installing for tensorflow 2 and ONNX..
Everything is being installed.
Let’s run the model-optimizer to see it’s alive..
MO –h … Yes..
OpenVINO is installed
Next video, I’ll show you the full flow.
We’ll activate OpenVINO, get a model, convert it, and run inference.
See you there.