Human Factors in the Design of Emotion-Aware Gaming: Examining Affective Computing in Gaming with Brain-Computer InterfacesNORA ALDAHASH, AREEJ AL-WABIL, MUHAMMAD HUSSAINCOLLEGE OF COMPUTER AND INFORMATION SCIENCESSOFTWARE AND KNOWLEDGE ENGINEERING RESEARCH GROUP [ SKERG.KSU.EDU.SA ]KING SAUD UNIVERSITY, RIYADH SAUDI ARABIA

@HCI_Lab

Introduction: Affective Gaming Measuring affective states: - brain signals - physiological signals - facial expressions

Introduction: Emotion-Aware Systems

Emotion Stimuli Measurement Technique

Machine Learning Algorithms

5

Affective BCI

Affective Computing

HCI

BCI

Psychology

Machine Learning

Signal Processing

PatternRecognition

Emotion

CognitionPerception

State of the Art in Affective BCI

6

Emotion Aware Systems: Stimuli and Emotion Models Stimuli: Audio

Visual

Video

Self-induced

EEG correlations of emotion :Frequency Bands Cognitive/Affect Correlations in Human Subjects

Delta 0.5-4 Hz Deep sleep, motivational states (e.g. hunger)

Theta 4-8 Hz Memory, recall

Alpha 8-13 Hz Relaxing/meditative state, attention

Beta 13-30 Hz Cognitive processes

Gamma >30 Hz Negative state (worry)

Categorization of Emotion-Aware BCI

Audio-visual induced affect states

Motor imagery control

SSVEP

Emotion state monitoring

Emotion-Aware Gaming Game Emotion Headset / HW Number of Sensors EEG Features Interaction

Brain Ball (2000)[55] Relaxation ProComb 3 Alpha/Beta Active

Attention Enhancement System; Virtual Reality (2002)[60]

Attention Laxtha 4 Beta Activity Active

Neuro Wander (2010)[61] Attention/Meditation Neuro Sky 3 N/A Active

Towers of Hanoi (2010)[62]

Attention/Meditation Neuro Sky 3 N/A Active

Mind Maps (2011) [64] Attention/Meditation Neuro Sky 3 N/A Active

Alpha WOW (2012)[5] Relaxation/Stress Emotiv 4 Alpha Activity Active

Brain Chi[54] Concentration/Distraction Emotiv 1 Fractal Dimension Model Active

Archery Game (2012) [63] Focus 3 Alpha Activity Active

Factors Affecting UX in NeuroGaming User Interface Factors Emotion-Aware Design Factors Utility Factors Software Architecture Design Factors

Factors affecting UXUI/UX Factors

Visual Salience Interruption Handling

Utility FactorsModality (e.g. Tactile response)

Hardware(e.g. headset, peripherals)

Software (e.g. calibration, system feedback)

Factors affecting UXEmotion-AwareDesign Factors

Active Passive Repeatability

Factors affecting UXUtility Factors

Modality (e.g. Tactile response)

Hardware(e.g. headset, peripherals)

Software (e.g. calibration, system feedback)

Factors affecting UXArchitecture Factors Pipeline Flow Fusion Participatory SW Design

Conclusion

Thank youHuman Factors in the Design of Emotion-Aware Gaming: Examining Affective Computing in Gaming with Brain-Computer Interfaces

Nora Aldahash, Areej Al-Wabil, Muhammad Hussain College of Computer and Information Sciences Software and Knowledge Engineering Research group [ skerg.ksu.edu.sa ] King Saud university, Riyadh Saudi Arabia