pursuing situational awareness - i-pcgrid workshop 2020 · pursuing situational awareness mark...

48
© UReason i-PCGRID Workshop 2014 March 28, 2014 Pursuing Situational Awareness Mark Walker Application Specialist – Reasoning Systems UReason North America

Upload: others

Post on 08-May-2020

4 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Pursuing Situational Awareness - i-PCGRID Workshop 2020 · Pursuing Situational Awareness Mark Walker Application Specialist – Reasoning Systems UReason North America ... •Algorithms

© U

Rea

son

i-PCGRID Workshop 2014 March 28, 2014

Pursuing Situational Awareness

Mark Walker Application Specialist – Reasoning Systems

UReason North America

Page 2: Pursuing Situational Awareness - i-PCGRID Workshop 2020 · Pursuing Situational Awareness Mark Walker Application Specialist – Reasoning Systems UReason North America ... •Algorithms

© U

Rea

son

What is Situational Awareness?

i-PCGRID Workshop 2014 March 28, 2014

www.funnyjunk.com

Page 3: Pursuing Situational Awareness - i-PCGRID Workshop 2020 · Pursuing Situational Awareness Mark Walker Application Specialist – Reasoning Systems UReason North America ... •Algorithms

© U

Rea

son

Outline

1. SA: Definitions

2. SA: Design Implications

3. SA: Industry Examples

4. SA: Qualitative Characteristics

5. SA: Enabling Technologies

6. SA: Case Studies

7. Conclusion

i-PCGRID Workshop 2014 March 28, 2014

Page 4: Pursuing Situational Awareness - i-PCGRID Workshop 2020 · Pursuing Situational Awareness Mark Walker Application Specialist – Reasoning Systems UReason North America ... •Algorithms

© U

Rea

son

What is Situational Awareness?

OODA (Boyd*) Loop:

Observe – Orient – Decide - Act

i-PCGRID Workshop 2014 March 28, 2014

*Developed by USAF Colonel John Boyd ~1976

Observe – Orient:

• Perception

• Comprehension

• Projection

Perception != Reality:

“Out Of the lOOp”

Page 5: Pursuing Situational Awareness - i-PCGRID Workshop 2020 · Pursuing Situational Awareness Mark Walker Application Specialist – Reasoning Systems UReason North America ... •Algorithms

© U

Rea

son

Design Implications

From a System Development Perspective, Maximizing SA Involves 4 Aspects:

i-PCGRID Workshop 2014 March 28, 2014

Specify

Acquire what you need to know

Process

Display what you need to know

Sense

Know what you need to know

Present

Extract what you need to know

Human Factors

Technology

Measurements

Knowledge Engineering

Page 6: Pursuing Situational Awareness - i-PCGRID Workshop 2020 · Pursuing Situational Awareness Mark Walker Application Specialist – Reasoning Systems UReason North America ... •Algorithms

© U

Rea

son

Design Implications - Specification

i-PCGRID Workshop 2014 March 28, 2014

Goal Directed Task Analysis (GDTA)

1. Identify Goals 2. Identify Critical Decisions 3. Identify SA required to make those decisions

Page 7: Pursuing Situational Awareness - i-PCGRID Workshop 2020 · Pursuing Situational Awareness Mark Walker Application Specialist – Reasoning Systems UReason North America ... •Algorithms

© U

Rea

son

Design Implications - Specification

Mica Endsley

Chief Scientist of the United States Air Force (current) Past President and CEO of Situation Awareness Technologies

i-PCGRID Workshop 2014 March 28, 2014

Designing for Situation Awareness (2nd edition) by Endsley, M. R. & Jones, D. G. (2012) London: Taylor & Francis.

Page 8: Pursuing Situational Awareness - i-PCGRID Workshop 2020 · Pursuing Situational Awareness Mark Walker Application Specialist – Reasoning Systems UReason North America ... •Algorithms

© U

Rea

son

Design Implications – Specification

i-PCGRID Workshop 2014 March 28, 2014

• Drawings, specifications, schematics.

• Functional descriptions posed in terms of user requirements

• Reliability Analysis, FMEA, PRA

Page 9: Pursuing Situational Awareness - i-PCGRID Workshop 2020 · Pursuing Situational Awareness Mark Walker Application Specialist – Reasoning Systems UReason North America ... •Algorithms

© U

Rea

son

i-PCGRID Workshop 2014 March 28, 2014

• What evidence exists of the failure?

• Functional Failure descriptions ensure that the PHM system detects what users care about

Design Implications – Specification

• What sensor suite is required to eliminate ambiguity?

Page 10: Pursuing Situational Awareness - i-PCGRID Workshop 2020 · Pursuing Situational Awareness Mark Walker Application Specialist – Reasoning Systems UReason North America ... •Algorithms

© U

Rea

son

i-PCGRID Workshop 2014 March 28, 2014

Design Implications – Specification

• Did something break? Is the system down? Did something spill? Does anyone get hurt?

• What could be done to avoid the consequences?

• Ready to do fault modeling

• How serious are the effects?

Page 11: Pursuing Situational Awareness - i-PCGRID Workshop 2020 · Pursuing Situational Awareness Mark Walker Application Specialist – Reasoning Systems UReason North America ... •Algorithms

© U

Rea

son

i-PCGRID Workshop 2014 March 28, 2014

Design Implications – Specification

• Define the usage monitoring requirements and parameters

• If possible, prognosticate

J. Moubray. Reliability Centered Maintenance, Second Edition. New York, NY: Industrial Press, 1997.

Page 12: Pursuing Situational Awareness - i-PCGRID Workshop 2020 · Pursuing Situational Awareness Mark Walker Application Specialist – Reasoning Systems UReason North America ... •Algorithms

© U

Rea

son

Design Implications - Technology

i-PCGRID Workshop 2014 March 28, 2014

Goal: Transform data into information and knowledge based on operational context, leveraging all available wisdom

Page 13: Pursuing Situational Awareness - i-PCGRID Workshop 2020 · Pursuing Situational Awareness Mark Walker Application Specialist – Reasoning Systems UReason North America ... •Algorithms

© U

Rea

son

Design Implications - Technology

i-PCGRID Workshop 2014 March 28, 2014

1. New sensor technologies

2. New displays

3. New algorithms

4. Improved data acquisition and storage

5. Faster processors

6. Improved understanding of processes and missions

7. Advancements in reasoning software applications

SA should improve with technology innovation

Page 14: Pursuing Situational Awareness - i-PCGRID Workshop 2020 · Pursuing Situational Awareness Mark Walker Application Specialist – Reasoning Systems UReason North America ... •Algorithms

© U

Rea

son

Design Implications - Technology

i-PCGRID Workshop 2014 March 28, 2014

Warning------

Warning------

Warning------

Page 15: Pursuing Situational Awareness - i-PCGRID Workshop 2020 · Pursuing Situational Awareness Mark Walker Application Specialist – Reasoning Systems UReason North America ... •Algorithms

© U

Rea

son

Design Implications - Technology

i-PCGRID Workshop 2014 March 28, 2014

Extracting what you need to know

Data Mining and Feature Extraction Advanced Database and Information Management Systems Model and Case-Based Reasoning, model switching State estimation and prediction Bayesian Sensor and Information Fusion Neural and Statistical Pattern Recognition Expert Systems based Decision Support Genetic Algorithm based Optimization Machine Learning Systems Autonomous Software Systems

Page 16: Pursuing Situational Awareness - i-PCGRID Workshop 2020 · Pursuing Situational Awareness Mark Walker Application Specialist – Reasoning Systems UReason North America ... •Algorithms

© U

Rea

son

Design Implications - Presentation

i-PCGRID Workshop 2014 March 28, 2014

1. Contrast: things that are different should look very different

2. Repetition: repeat visual elements 3. Alignment: every element should have some visual

connection with another 4. Proximity: things that belong together should be placed

together, those that are different should not

Page 17: Pursuing Situational Awareness - i-PCGRID Workshop 2020 · Pursuing Situational Awareness Mark Walker Application Specialist – Reasoning Systems UReason North America ... •Algorithms

© U

Rea

son

Design Implications - Presentation

i-PCGRID Workshop 2014 March 28, 2014

Page 18: Pursuing Situational Awareness - i-PCGRID Workshop 2020 · Pursuing Situational Awareness Mark Walker Application Specialist – Reasoning Systems UReason North America ... •Algorithms

© U

Rea

son

Industry Examples

1. Aircraft and Aerospace

2. Battlefield and Warfighting

3. Naval

4. Power Generation

5. Process Industries

6. Transportation

7. Enterprise

8. Consumer

i-PCGRID Workshop 2014 March 28, 2014

Page 19: Pursuing Situational Awareness - i-PCGRID Workshop 2020 · Pursuing Situational Awareness Mark Walker Application Specialist – Reasoning Systems UReason North America ... •Algorithms

© U

Rea

son

Industry Examples

1. Aerospace – early warplanes

i-PCGRID Workshop 2014 March 28, 2014

*www.mapsairmuseum.org

Sopwith Camel Cockpit Nieuport 28 Cockpit

*www.airminded.net

Page 20: Pursuing Situational Awareness - i-PCGRID Workshop 2020 · Pursuing Situational Awareness Mark Walker Application Specialist – Reasoning Systems UReason North America ... •Algorithms

© U

Rea

son

Industry Examples

1. Aerospace – later aircraft

i-PCGRID Workshop 2014 March 28, 2014

*www.strangedangers.com

Boeing B29 Cockpit North American X-15 Cockpit

*www.militaryfactory.com

Page 21: Pursuing Situational Awareness - i-PCGRID Workshop 2020 · Pursuing Situational Awareness Mark Walker Application Specialist – Reasoning Systems UReason North America ... •Algorithms

© U

Rea

son

Industry Examples

1. Aerospace – later aircraft

i-PCGRID Workshop 2014 March 28, 2014

*www.777boeing.com

Boeing 777 Cockpit Lockheed Martin F-35 Cockpit *www.strikefighterconsultinginc.com

Page 22: Pursuing Situational Awareness - i-PCGRID Workshop 2020 · Pursuing Situational Awareness Mark Walker Application Specialist – Reasoning Systems UReason North America ... •Algorithms

© U

Rea

son

Industry Examples

1. Aerospace – Rockwell International SSC Endeavor

i-PCGRID Workshop 2014 March 28, 2014

Page 23: Pursuing Situational Awareness - i-PCGRID Workshop 2020 · Pursuing Situational Awareness Mark Walker Application Specialist – Reasoning Systems UReason North America ... •Algorithms

© U

Rea

son

Industry Examples

2. Warfighting

i-PCGRID Workshop 2014 March 28, 2014

Virtual Battlespace 2 *www.army.mil

Page 24: Pursuing Situational Awareness - i-PCGRID Workshop 2020 · Pursuing Situational Awareness Mark Walker Application Specialist – Reasoning Systems UReason North America ... •Algorithms

© U

Rea

son

Industry Examples

3. Naval

i-PCGRID Workshop 2014 March 28, 2014

WWII Naval Combat Information Center *flyhistoricwings.com

Page 25: Pursuing Situational Awareness - i-PCGRID Workshop 2020 · Pursuing Situational Awareness Mark Walker Application Specialist – Reasoning Systems UReason North America ... •Algorithms

© U

Rea

son

Industry Examples

3. Naval

i-PCGRID Workshop 2014 March 28, 2014

DDG-51 Naval Combat Information Center *www.arlut.utexas.edu

Page 26: Pursuing Situational Awareness - i-PCGRID Workshop 2020 · Pursuing Situational Awareness Mark Walker Application Specialist – Reasoning Systems UReason North America ... •Algorithms

© U

Rea

son

Industry Examples

4. Nuclear

i-PCGRID Workshop 2014 March 28, 2014

U.S.S. Long Beach CGN-9

*www.leroyjonesnavyhistory.com

S5W Reactor Plant Consoles

*www.emmitsburg.net

Page 27: Pursuing Situational Awareness - i-PCGRID Workshop 2020 · Pursuing Situational Awareness Mark Walker Application Specialist – Reasoning Systems UReason North America ... •Algorithms

© U

Rea

son

Industry Examples

4. Nuclear

i-PCGRID Workshop 2014 March 28, 2014

PAKS Nuclear Plant - Hungary *www.chinadaily.com

Page 28: Pursuing Situational Awareness - i-PCGRID Workshop 2020 · Pursuing Situational Awareness Mark Walker Application Specialist – Reasoning Systems UReason North America ... •Algorithms

© U

Rea

son

Industry Examples

5. Process Industries

i-PCGRID Workshop 2014 March 28, 2014

Typical Process HMI – 1990’s

*www.automationworld.com

High Performance HMI – 2014

*www.novatechweb.com

Page 29: Pursuing Situational Awareness - i-PCGRID Workshop 2020 · Pursuing Situational Awareness Mark Walker Application Specialist – Reasoning Systems UReason North America ... •Algorithms

© U

Rea

son

Industry Examples

6. Transportation

i-PCGRID Workshop 2014 March 28, 2014

*streetsblog.org

MTBA Boston Transit Control NY DOT Command Center

*www.oobject.com

Page 30: Pursuing Situational Awareness - i-PCGRID Workshop 2020 · Pursuing Situational Awareness Mark Walker Application Specialist – Reasoning Systems UReason North America ... •Algorithms

© U

Rea

son

Industry Examples

7. Enterprise

i-PCGRID Workshop 2014 March 28, 2014

*www.enterprise-dashboards.com

Page 31: Pursuing Situational Awareness - i-PCGRID Workshop 2020 · Pursuing Situational Awareness Mark Walker Application Specialist – Reasoning Systems UReason North America ... •Algorithms

© U

Rea

son

Industry Examples

7. Enterprise

i-PCGRID Workshop 2014 March 28, 2014

*www.enterprise-dashboards.com

Page 32: Pursuing Situational Awareness - i-PCGRID Workshop 2020 · Pursuing Situational Awareness Mark Walker Application Specialist – Reasoning Systems UReason North America ... •Algorithms

© U

Rea

son

Industry Examples

7. Enterprise

i-PCGRID Workshop 2014 March 28, 2014

*www.enterprise-dashboards.com

Page 33: Pursuing Situational Awareness - i-PCGRID Workshop 2020 · Pursuing Situational Awareness Mark Walker Application Specialist – Reasoning Systems UReason North America ... •Algorithms

© U

Rea

son

Industry Examples

8. Consumer

i-PCGRID Workshop 2014 March 28, 2014

*www.econais.com

Page 34: Pursuing Situational Awareness - i-PCGRID Workshop 2020 · Pursuing Situational Awareness Mark Walker Application Specialist – Reasoning Systems UReason North America ... •Algorithms

© U

Rea

son

Pitfalls

i-PCGRID Workshop 2014 March 28, 2014

What can interfere with SA? 1. Repetition 2. Ambiguity 3. High Stress 4. Low Stimulation 5. Confusion 6. Impatience 7. Peer Pressure 8. Unfamiliar Situations 9. Fixation/Distraction 10.Violation of rules and policy

Page 35: Pursuing Situational Awareness - i-PCGRID Workshop 2020 · Pursuing Situational Awareness Mark Walker Application Specialist – Reasoning Systems UReason North America ... •Algorithms

© U

Rea

son

Enablers

i-PCGRID Workshop 2014 March 28, 2014

What can help maximize SA? 1. Experience 2. Training 3. Orientation 4. Ability to process information 5. Better understanding of what the user needs to know 6. Transformation of data to information and knowledge

Page 36: Pursuing Situational Awareness - i-PCGRID Workshop 2020 · Pursuing Situational Awareness Mark Walker Application Specialist – Reasoning Systems UReason North America ... •Algorithms

© U

Rea

son

Enablers

i-PCGRID Workshop 2014 March 28, 2014

Enabling Technologies Data Mining and Feature Extraction Advanced Database and Information Management Systems Model and Case-Based Reasoning, model switching State estimation and prediction Bayesian Sensor and Information Fusion Neural and Statistical Pattern Recognition Expert Systems based Decision Support Genetic Algorithm based Optimization Machine Learning Systems Autonomous Software Systems

Page 37: Pursuing Situational Awareness - i-PCGRID Workshop 2020 · Pursuing Situational Awareness Mark Walker Application Specialist – Reasoning Systems UReason North America ... •Algorithms

© U

Rea

son

Case Study: PHM Systems

i-PCGRID Workshop 2014 March 28, 2014

PHM Systems are evolving to meet higher expectations What should PHM Systems do?

– Determination of Health and its impact on system functions – Monitor early warning of incipient failures – Predictions of Remaining Useful Life – Leveraging of advanced “reasoners”

• Signal processing for event detection and sensor validation • Algorithms for event correlation and sensor fusion • Expert Systems and rule-based architectures • Advanced neural and statistical classifiers • Real-time state estimators • Model-based Reasoning • Real-time regime recognition and model switching

– Supervisory-level intelligence / logic – Estimation and understanding of system state within operational context – Decision support to assist operators in maintaining operational availability – Optimize scheduling of maintenance and corrective actions according to the

principals of condition-based maintenance

Page 38: Pursuing Situational Awareness - i-PCGRID Workshop 2020 · Pursuing Situational Awareness Mark Walker Application Specialist – Reasoning Systems UReason North America ... •Algorithms

© U

Rea

son

Case Study: NASA Rocket Engine Testing

i-PCGRID Workshop 2014 March 28, 2014

Transducer Electronic

Data Sheet

Viewing Windows

Blueline Active Monitors

Redline Active Monitors

Blueline Alarm Queues

Redline Alarm Queues

Page 39: Pursuing Situational Awareness - i-PCGRID Workshop 2020 · Pursuing Situational Awareness Mark Walker Application Specialist – Reasoning Systems UReason North America ... •Algorithms

© U

Rea

son

Case Study: NASA Rocket Engine Testing

i-PCGRID Workshop 2014 March 28, 2014

ID # Item-Functional Identification

Function Failure Modes and Causes

Mission Phase-Operational Mode

Failure Effects Local Next End Effects Higher Effects Level

Failure Detection Method

Process Equipment

Fluid feed subsystem

Leak Sealed subsystem maintaining pressure

Pressure leak Decreasing pressure measurement

Identify sealed subsystem, and check pressure sensors for decreasing pressure.

Page 40: Pursuing Situational Awareness - i-PCGRID Workshop 2020 · Pursuing Situational Awareness Mark Walker Application Specialist – Reasoning Systems UReason North America ... •Algorithms

© U

Rea

son

Case Study: NASA Rocket Engine Testing

i-PCGRID Workshop 2014 March 28, 2014

Page 41: Pursuing Situational Awareness - i-PCGRID Workshop 2020 · Pursuing Situational Awareness Mark Walker Application Specialist – Reasoning Systems UReason North America ... •Algorithms

© U

Rea

son

Case Study: NASA Rocket Engine Testing

i-PCGRID Workshop 2014 March 28, 2014

Page 42: Pursuing Situational Awareness - i-PCGRID Workshop 2020 · Pursuing Situational Awareness Mark Walker Application Specialist – Reasoning Systems UReason North America ... •Algorithms

© U

Rea

son

Case Study: Advanced Arresting Gear

i-PCGRID Workshop 2014 March 28, 2014

Page 43: Pursuing Situational Awareness - i-PCGRID Workshop 2020 · Pursuing Situational Awareness Mark Walker Application Specialist – Reasoning Systems UReason North America ... •Algorithms

© U

Rea

son

Hierarchical Goal-Oriented PHM Design

i-PCGRID Workshop 2014 March 28, 2014

Proposed Layered Architecture

Page 44: Pursuing Situational Awareness - i-PCGRID Workshop 2020 · Pursuing Situational Awareness Mark Walker Application Specialist – Reasoning Systems UReason North America ... •Algorithms

© U

Rea

son

Heirarchical Goal-Oriented PHM Design

i-PCGRID Workshop 2014 March 28, 2014

Fatigue Life Management

Page 45: Pursuing Situational Awareness - i-PCGRID Workshop 2020 · Pursuing Situational Awareness Mark Walker Application Specialist – Reasoning Systems UReason North America ... •Algorithms

© U

Rea

son

Case Study: Integrated Threat Detection

i-PCGRID Workshop 2014 March 28, 2014

• Integrated Smart Sensor Network • Wide-area Monitoring including Video Data • Automated Analysis of Chemical and Biological Sensor Data • Real-time Situational Awareness • POC installed at Liberty Island

Page 46: Pursuing Situational Awareness - i-PCGRID Workshop 2020 · Pursuing Situational Awareness Mark Walker Application Specialist – Reasoning Systems UReason North America ... •Algorithms

© U

Rea

son

Case Study: Factory Drilling

i-PCGRID Workshop 2014 March 28, 2014

• Intelligent solutions for both drilling and production • Provide expert decision in support of“the big crew change” • Goal is to embed intelligence into the bit

• Automatic switching of algorithms based on changing conditions

Page 47: Pursuing Situational Awareness - i-PCGRID Workshop 2020 · Pursuing Situational Awareness Mark Walker Application Specialist – Reasoning Systems UReason North America ... •Algorithms

© U

Rea

son

Case Study: Fleet Distance Support

i-PCGRID Workshop 2014 March 28, 2014

• Integration with data from existing critical shipboard systems and services

• Leverages Object Oriented Model-based Reasoning • Online health assessment

•Offline analysis to support creation of “condition indicators” • New CI’s are then pushed back out to the fleet

Page 48: Pursuing Situational Awareness - i-PCGRID Workshop 2020 · Pursuing Situational Awareness Mark Walker Application Specialist – Reasoning Systems UReason North America ... •Algorithms

© U

Rea

son

i-PCGRID Workshop 2014 March 28, 2014

Questions? [email protected]