Edge AI Suite Quick Start Guide

Hello

We bring good news for anyone worried about how to implement AI services. In

recent years, the implementation of AI big data analysis has become an

increasingly important topic. However, interested vendors and customers face

obstructions related to SW/HW integration issues and difficult AI algorithms.

These obstacles can result in costly developmental delays. To help rectify this

situation, Advantech in collaboration with Intel and Microsoft, will release the

Edge AI Suite in 2019 to further its position as global leader in Solution-Ready

Packages (SRP).

To help solve the aforementioned issues around developing AI applications,

Advantech released the Intel Movidius VEGA-300 series mounted in ARK- and

DS- products and installed with the latest Microsoft Windows 10 IoT OS to further

integrate OpenVINO (Open Visual Inference & Neural Network Optimization)

toolkits. OpenVINO was released by Intel and is able to execute real-time

inference for collected data on Intel CPU, GPU, FPGA or ASIC (IPU or

VPU-Moviduis) acceleration chipsets to upgrade computing power. The Model

Optimizer module can translate other common AI models, such as Caffe, Tensor

flow, MXNet and ONNX, to a unified architecture for OpenVINO.

Getting Started

System Requirements

Software

1. Operating System: Windows 10 Enterprise 64-bit version 1809

2. Intel® Graphics Driver: Windows® 10 DCH Drivers

26.20.100.7755 or above (when GPU inference is adopted)

3. Advantech SUSI 4.0 or above required when no VEGA-300 series

exist

Hardware

1. 6th to 10th generation Intel® Core™ processors and Intel® Xeon®

processors

2. Intel Pentium® processor N4200/5, N3350/5, or N3450/5 with

Intel® HD Graphics

3. One of them must be required:

- Advantech VEGA-300 series, or

- Specific Advantech devices with SUSI 4.0 or above preloaded

Installation Steps

Step 1. Choose “Next” to start installation

Step 2. Choose the setup type you want

Typical -> Full Installation (default and suggested)

Custom -> Customized Installation

Step 3. Choose “Install” to begin installing

Step 4. Wait for the installation process

Step 5. Choose “Finish” to complete installation

The Basics

Edge AI Suite caters to users who are comfortable with the machine learning (ML)

experience. It can quickly evaluate computing performance for the CPU, GPU, or

VEGA-300 series VPU, and provides runtime results inferenced with ML.

Moreover, this suite summarizes the process from model transformation to

recognition.

Edge AI Suite is based on Intel OpenVINO with further development using C# and

Qt/C++ tools. The realized target gives users an easy and enjoyable experience

with the AI inference. The following chart shows the major parts after suite

installation.

├── Edge AI Suite

| ├── Demo_Utility_C#

| ├── Inference_Application_Qt

| ├── Inference_Models

| ├── Media_Samples

| ├── OpenVINO

| └── Version.txt

How to Quickly Start AI applications

Step 1. Go to the “Quick Start” page, as shown below

Step 2. Choose one application you want to activate and then confirm inference

info, as shown below

Step 3. Choose your video source which could be video clips or the camera, as

shown below

Step 4. Choose one of the acceleration chipsets to execute selected inference

application, as shown below

Step 5. Another window will pop up to show the AI inference, as shown below

How to Recognize AI Performance

Step 1. Go to the “System Monitoring” page. This page shows payload and

temperature for each chipset, as shown below

Step 2. Click the “Run” button to evaluate each chipset performance and wait for a

few seconds to get results, as shown below

How to Get More Inference Samples and Resources

Step 1. Go to the “Advanced Extensions” page. This page shows the impressive

information and a link button, named as “More”, as shown below

Step 2. Click the “More” button and then the default browser will display the

contents of Edge AI Hub. (It’s suggested to use Chrome browser to open it.)

Furthermore, for example, we can scroll down the page to see the

“Gaze-Estimation” item and then click it to start downloading.

After downloading is done, extract the file to recover all elements inside.

We just need to click a *.bat file therein to launch the inference sample easily.

More operations can refer to ADVANTECH Edge AI Hub website.

In addition, OpenVINO IE SDK and ready-to-use Model Optimizer package can

also be downloadable from Edge AI Hub.

Help and Resources

1. Advantech VEGA-300 Series

2. Intel® Distribution of OpenVINO™

3. SUSI APIs (Secure, Unified, and Smart Interface)