Improving Workforce Development Using Augmented Reality Technology

Mia D. Joe, PhDc

March 2019

Approved for Distribution A

Mia Joe, PhDcSr. Project Manager, Educational Technology

Newport News ShipbuildingMia.joe@hii-nns.com

Introduction

Project DescriptionAugmented Reality (AR) is recognized as an effective tool to improve and enhance the learning experience

for trainees. Through the overlay of digital information in a real world environment, AR applications can

efficiently instruct even the most inexperienced of learners in the performance of complex industrial skills,

tasks and procedures, such as the assembly and maintenance of equipment and machinery.

Project GoalThe goal of this National Shipbuilding Research Program (NSRP) project is to demonstrate

effective use of AR as an instructional support application. Augmented reality provides 3D

visualization overlaid on reality. The anticipated benefits of AR-based instruction is improvement

in employee learning, knowledge retention, and skill/task performance. This presentation will

discuss instructional design considerations when integrating AR with the learning process, as

well as explain the project’s educational research design and status.

Project Deliverables

• Phase One, Three Applications

• Performance Analysis

• Instructional Design Documents

• Application Storyboards

• Baseline Usability Results

Project Deliverables

• Phase Two, Two Applications

• Performance Analysis

• Instructional Design Document

• Application Storyboard

• Pilot Report Apps 1-3

• Final Usability Report Apps 1-3

Application

Course Name: Solid State Devices and Circuits

Upon successful completion of this course learners will be able to:

• Demonstrate how to build a circuit

• Demonstrate how to supply power from an adjustable source

• Demonstrate how to measure voltages

• Demonstrate how to “break a circuit” and measure currents.

Usability Results: Baseline usability: 83.75, Final usability: 85.8

Pilot Results: Convergent evidence from instructor feedback,

participant feedback and participant test scores suggest the

application was a beneficial learning tool.

Application #1

ApplicationCourse: Absence of Voltage Recertification

Upon successful completion of this application, learners will be able to:

• Identify AOV-specific safety and warning signs

• Confirm that the digital multimeter is properly calibrated

• Verify the tag(s) are hung in accordance with the tag(s) called out on work permit, work authorization,

tag-out, red tag log and confirm the device position as stated on tag

• Verify name plate data on equipment to be checked

• Visually inspect meter for any damage (including leads)

• Establish a ground with less than 10 ohms resistance to the ship’s hull

• Check all connections to ground reference point for voltage. Check phase-to-phase if applicable. (A/C)

• Check all connections to ground reference point for voltage. Check all circuits negative to positive (D/C)

• Identify appropriate actions when presented with various electrical anomalies.

Usability Results: Baseline usability: 80, Final usability: 71.25

Pilot Results: Results from the pilot showed participants had a 100% pass rate for

the initial certification and the recertification after utilizing the application.

Therefore, the application may provide a learning benefit for individuals up for

AOV recertification.

Application #2

ApplicationCourse: JLG Operator Training and Requalification

Upon successful completion of this application,

learners will be able to:

• Identify JLG Safety/ODCL requirements

• Demonstrate requirements for operating a JLG

• Demonstrate correct actions for JLG shutdown,

and breakdown/accident reporting.

Usability Results: Baseline usability: 90, Final usability: 78.5

Pilot Results: Participants had a higher pass rate for the JLG

qualification than initial customized reports. Therefore, the application

may be beneficial as a supplemental tool for JLG requalification

Application #3

ApplicationCourse: Flange Make-Up

Anticipated Objectives:

• Identify hazardous and non-hazardous gaskets

• Demonstrate the proper process of flange and gasket joint

assembly

• Demonstrate the process of applying torque to threaded

fasteners.

Devices: Tablet and HoloLens

Usability Results: Baseline usability: <TBD>, Final usability: <TBD>

Pilot Results: TBD

Application #4

Application

Usability Results: Baseline usability: <TBD>, Final usability: <TBD>

Pilot Results: TBD

Course: Ship Construction

Anticipated Objectives:

• Define basic ship structure terminology

• Identify major structural hull components

Device: HoloLens

Technology Transfer

• I/ITSEC 2018

• NSRP All-Panel Meeting

• Final Demonstration

• ModSim World 2019

Next Steps

• Installation Files

• Final Report

Questions

Thank You!