remote support system - ntt data - vuzix m100

Copyright © 2015 NTT DATA Corporation

NTTDATA System Platform SectorSecurity Business Section

Remote Support System using smart glass

2Copyright © 2015 NTT DATA Corporation

Contents

1. About Remote Support System• Overview• Common problems on site• Future style on site work

2. Use cases for on-site work• Inexperienced one-person work• Working while reading manuals• Taking evidence by one-self• Training for inexperienced worker• Supporting multiple worker by one

person3. Features

• Multi-device(smart device and glass)• Hands-free natural user interface• Flexible arrangement(worker and

operator) 4. Functions

• Functions for work• Task management• Reading manual• Evidence management• Help requirement with picture• Image and voice sharing• Text messaging

• Functions for operation

5. Screen images• Screens for operator • Screens for worker

6. System requirement • Overview• Hardware(server, client(operator,

worker))• Network

7. System Deployment• On-premises or Cloud service• Pricing(under construction)• Schedule(under construction)

Copyright © 2015 NTT DATA Corporation 3

1. About Remote Support System


About Remote Support System: Overview

System which supports on-site worker(construction site, building maintenance, home-visiting nurse, etc) from remote site

On-site Remote-site

Remote Support System

On-site situation

Advice/Instrucitons


About Remote Support System: Common problems on site

A lot of paper manuals

Skill enhancement

Management of an overseas base

Management of veterans

Unexpected trouble

On-site visualization

Working in pairs

Common problems related to on-site worker and remote operator


About Remote Support System: Common problems on site

A lot of paper manuals

Skill enhancement

Management of overseas bases

Management of veterans

Unexpected trouble

On-site visualization

Working in pairs

Problems Solutions

Wearable ICT serviceReal time visualizing on-site situations

Supporting from remote site

Reading electronic manuals

Real time sharing of situation on site

Supports form remote site

Taking evidence by one-self


About Remote Support System: Future style of on-site work

Support site with veteran+

Support using wearble device

Management, support

Situation, help

Veteran


About Remote Support System: Future style of on-site work

Exchange situation and advice/instruction

• Task progress• Sharing video• Voice advice• Sending

manual• Taking

evidences

Check statusCheck status of each facilities(uptime, alert..etc).Take a picture and share, if there are some problems.


2. Use cases for on-site work

1. Inexperienced one-person work2. Working while reading manuals3. Taking evidence by one-self4. Training for inexperienced worker5. Supporting multiple worker by one person


Use cases for on-site work

Case １　 Inexperienced one-person work

answer

question

Question about this task, ask it

to remote operator

No need to go site, because of remote

support system

Various support way

Can work by only myself because of

support



Case ２　 Working while reading manuals

Can read manual while

working

Can send or update manual

Less burden for reading

manual

Send manual

Storage

Manual1



Case ３　 Taking evidence by one-self

No need pair worker because of taking evidence

by oneself

No need to check with

handsStorage

Take evidence

Request confirmation



Case ４　 Training for inexperienced worker

Easy to learn how to work because of

images

Storage

Record veteran’s

hands

Veteran

Inexperienced worker



Case ５　 Supporting multiple worker by one person

Can reduce the cost of

move to site

Can support workers on several site

site １

site5


3. Features

• Multi-device(smart device and glass)• Hands-free natural user interface• Flexible arrangement(worker and operator)


Features: Multi-device(smart device and glass)

Select suitable device depending on-site environment or type of on-site work

Only Android based device

Smart glassSmart device

・ one hand is available・ large screen is needed for reading manual

・ case that both hands are occupied


Features: Hands-free natural user interface

Hands-free natural user interface enable to control device without both hands

Twist neck

Gesture controlVoice controlTake

evidenceShow

manual

Gyro mouse

Moving headPage.1 Page.2


Features: Flexible arrangement(worker and operator)

Flexible arrangement enable to reduce supporter’s burden

On-site worker Remote Supporter

One remote supporter enable to support multiple on-site worker

One on-site worker can receive support from multiple remote supporter


4. Functions

• Functions for work• Task management• Reading manual• Evidence management• Help requirement with picture• Image and voice sharing• Text messaging


Functions: Functions for work

Task management• Enable to manage and check tasks hands-free• Progress of task is shared to operator in real time

Finish task2

Go to next task

Finishing task1

Finishing task2

Woker1 Worker2 Worker3　　□ task1　□ task2　□ task3　□ task4　　

Finish task1

　■ task1 　 13 ：10end　■ task2 　 13 ：17end

Check statusCheck status of each facilities(uptime, alert..etc).Take a picture and share, if there are some problems.



Reading manual• Enable to read electronic manual with hands-free• Can download available manual on site

Send manual

Movie manual

Twist neck

Page.1 Page.5

Picture manual

Twist neck



Evidence management• Worker can take and share evidences with hands-free • Evidences are stored on server and can be seen after storing

Storage

Take evidence

Share, store and check

Finish task,Take an evidence

store



Help requirement with picture• Worker can take a picture for help and get a comment from

operator• Available with Free-hand, text, stamp

Share eye direction picture

Pull this cableSend back with comment

Unclear point



Image and voice sharing• Share the on-site eye direction image and voice to remote

site• AR marker is available on shared image

Image sharing

AR marker

Voice call

This working point need advice

from Veteran



Text messaging

please check another machine

Emergency ： get back to office now

Available broadcastChecking message with hands-free

Reduce lack of check

• Operator can send text message to on-site worker


Functions: Functions for system operation

There are following function for system operation.

• User registration(worker and operator)• User authentication• Task registration• Assigning task to workers• Associating with workers and operators


5. Screen images


Screens for operator

Login

User authentication

Task management

Checking workers’ location

Image sharing


Screens of worker

User authentication

Task management

Manual

Receiving comments

All tasks are finished

Help or taking evidence

Checking evidences or comments

Login Finish

Twist neckTwist neck

Voice command Voice

commandVoice command

Help


6. System Requirement


System Overview

Work Area

Office LAN

Support Area

Terminal

Wireless AP

Internet / WANWork Area LAN

Cloud or DMZ

Remote Support System Server, Streaming Server

Outside Supporter

Terminal

Outside Work Area


Hardware(Server/Client)

S/C Equipment Device Requirement(Tested environment)

Q’ty Note

Server Remote Support System Server

1U, PC, Laptop OS:LinuxCPU:2.0GHz 4core and overMemory:4GB and overHDD:50GB and over

1

Streaming Server

1U, PC, Laptop OS:LinuxCPU:2.0GHz 4core and overMemory:4GB and overHDD:50GB and over

1 Streaming server is able to be included in Remote Support System Server

Client Operator Client PC, Laptop, Tablet Web browser: Google Chrome, Firefox

Any iOS device doesn’t support image sharing and voice call function

Worker Client Android smart glass, Android smart phone, Android tablet

OS:Android4.0 and up Any Tested Android smart glass: Vuzix M100(OS2.0)


Network

• Type of network• LAN, Internet, Mobile(necessary when LAN isn’t equipped)

• Quality of network• Broadband network is recommended when image sharing and voice

call function is used(Wi-Fi, LTE)


7. System Deployment


System Deployment

WAN/LAN

Client(Worker)

Client(Operator)

ServerCloud service model

On-premises model

Client(Worker)

Client(Operator)

Server

remote support system - ntt data - vuzix m100

Software