Welcome back to the OpenVINO channel
We have talked about the Movidius VPU (Vision processing unit design)
Please check video 27 and 28
You can find the Movidius latest VPU chip called Myriad-X in multiple form factors, From various suppliers.
This for example is the neural compute stick, the NCS2 , I treat it more as a development platform.
This for example is a m.2 add-on card with 1 Myriad-X
But you can get ones with 2, 3 or 4 chips..
And this is the intel Vision accelerator. We call it HDDL for High Density Deep Learning..
It is a PCIe device and is has 8 Myriad-X, 8 VPUs on a single board..
There is another vision accelerator by Intel, based on Arria10 FPGA
Don't get confused, this one has 8 Myriad-X..
You can read all about the various designs in this link.. https://www.intel.com/content/www/us/en/internet-of-things/solution-briefs/vision-accelerator-design-brief.html
The building block of the HDDL is Myriad X
About 2W power consumption, small memory footprint, FP16, small batch size
Now just multiply that by 8. to get HDDL
But it does not mean that you have a big memory footprint device now..
You have 8 small memory footprint devices
I always say that if Myriad-X is a motorcycle,
and Now that you have 8 of them, you do not have a big truck, you have 8 motorcycles
And this is important to understand. think high inference rate of squeezenet or resnet NOT VGG16..
The network Supported by HDDL will be the same supported by Myriad-X
We'll check the performance next video, but you can expect to get, on most topologies, 8x the performance of a 1 M-X.
If a M-X can give you 35 FPS on Resnet50 , an HDDL card will give you 280 FPS
The first stage is of course to properly connect the HDDL card.
Make sure the fans are connected, depend on the HDDL version you are holding..
Mine is generating a nice green light to indicate it's well connected..
Let's try to install Make sure the OpenVINO environment is set.
We need first to make sure that the Myriad plugin is supported.
Under the install directory, install_dependencies you will find the installation script
install_NCS_Udev_rules.
And Myriad device is supported.
HDDL_INSTALL_DIR is where everything related to HDDL is located..
We just go there,
Install all the dependencies, which I have already installed
go to drivers.
And tun the setup
You might need to run it a little different with an install command..
Run -h to see how..
Now, when I type "lsusb" I can see the 8 Myriad-X devices
which could be treated as separate 8 myriad-Xs or a 1 HDDL card..
I will show you on the next video..
Now just to make sure the card is working, let's go to deployment-tools/demo
And run any of the demos with -d HDDL
You can see that the HDDL plugin is working..
And the sample is running, which is a good indication that the HDDL card is properly installed..
And now few tips that will make your life with the HDDL much simpler.
It is sometimes not trivial to understand if the card is up and running,
So a good practice is to see if the HDDL daemon is up and running.
I will look for processes with hddl And you can see that the hddl-daemon is working..
If you want to make sure it is not running, just kill this process
And now only my "grep" command is related to HDDL, the Daemon is not working..
To re-run it, go to the HDDL directory / bin And run the hddl-daemon
You can see how the 8 devices are being booted one by one
And ready for work
So we saw how to install and set up the HDDL device.
How to run a demo to verify it's working and how to make sure it is up and running.
Next video, I'll show you some tricks how to monitor the device status,
how to debug the performance and more.
Subscribe to our channel to get more videos like this
Thank you!