I have an inference-server running on the new Intel developer cloud.​
I can send it images from anywhere, any client​ And it returns the detected faces..​
It is a face detection service, ​
You can do it too in few minutes
1.
Get a machine on the new Intel developer cloud (could be a CPU, could be a GPU..)​
2.
Run OpenVINO model server on the cloud machine​
Setup and Run a client, on any machine you'd like
Cloud.intel.com​ Get started​
Choose a track​ Create an account if needed​
Fill in details, verify email,​ You are in​
Hardware catalog​ Choose a Xeon CPU or a GPU machine​
I'll take a bare metal machine​ Running Ubuntu ​
Name the machine​ Get a key,​
I already have one.​ Launch​
Provisioning​ Ready​
This is my machine​ How to connect​
Change mode of the ssh key, you will need to remember where this file is and also copy
it to the client…​ Connect​
Your key​ And again​
Congratulation, you have a machine up and running on the intel developer cloud
Set up the openVINO model-server​ I'm following the quick start guide.
Link below​ And I will just keep it simple.
Face detection model​ You can of course run any model, multiple
models in parallel and many other options..
QuickStart guide​ You will need to install docker.
​Pull the latest model server image​
Get a model​ Under repositories you will find many other
models​ Place the model in the right directory​
Run the model server container​ And it is running
3.
Set up and run the client..​ I usually do stuff like that in a virtual
environment​ Activate it​
Go to the directory​ Bring the code and requirements​
Bring some images, only one here, you can get more​
Install all the reequipments​ Create a directory for the results​
Run inference​ Connect to the server via port 9000​
And it is working we got the face detection coordinates..​
And an output image in the results directory
I ran the server and the clients both on the same machine.​
If you'd like to have the client remotely, which makes total sense.​
The only problem is the network access and permissions.
​ You have 2 options..​
First one, if this is your production product..
talk to the Intel cloud support to open a firewall port for you.​
And here is the second simpler option.
First you need to place the key in your .ssh directory​
Below is our connection line.​ We will ssh –L to port 9000, and just use
this as the IP address​ This basically port forwarding to the jump
host.​ It will make the cloud server looks like it
is a localhost​ And we'll ping the server every 60seconds
to keep the connection alive​ Do not close this window.​
On another window​ We have here few images​
And we'll run the same command ​ The port is 9000​
We need to add the GRPC address, it will be our local-host​
And it is sending one image after the other to the cloud and getting the inference results
back..​ Take a look at the results directory.​
I think it looks pretty cool
OpenVINO model-server, running on an Intel developer cloud machine​
Try it out, subscribe, thank you