“Implementation of a 3-Dimensional Game for developing balanced Brain-wave” B.Shim, S. Lee, J.Shin

N.a.m.Leoné

Seminar HMI

Article: Using games for training brainwaves Several techniques, researches Focused on games

Presentation General Brainwaves Advantages Games Techniques used

Introduction

Difficulties

Often hard to control when untrained Training is difficult Awkward for the participant

Training is (often) boring…

Brainwaves

Why are games used?

More fun! Good feedback Good for balancing tasks More intuitive Better training, easier to train longer

Why Games?

Several Games discussed: Balancing with SSVEP 3D shooter(High/Low Mu) Goal moving(Mental relaxation) Course following(Spec Signals) Balancing (Left/Right Hemisphere)

Different Games

“MindBalance – the game” Balancing with SSVEP Focusing on flickering squares Showed in previous presentations…

Balancing(SSVEP)

3D Shooter Graphical, “immersive” environment Controlled by high/low mu signals▪ For left/right control▪ Forward/backward still with keyboard

After some training:▪ Automatically turning with thinking

3D Shooter

Moving to Right/Left Simple, but clear goal Mental relaxation moving towards right▪ Easier when winning? Makes it difficult!

Multiplayer Focus on finding when “relaxed”▪ Alpha + theta & Alpha + Beta + Theta good indicators of relaxation

Goal moving

“Brainathlon” Simple, but direct goal 3 courses▪ Specific signal needed for every course▪ Changing difficulty(starting activation)

Multiplayer

Course Following

Balancing on a rope Main subject of article Complete 3d environment Activation of cortex▪ Left Cortex = Left, Right Cortex = Right▪ Equal = straight on rope▪ Intuitive, but hard to master

Balancing Rope(1)

Balancing on a rope Feedback in Lower Right corner Based on FFT Power value difference▪ Processed 2-8Hz(Theta), 12-20Hz(low Beta)

Handy for training▪ Participant learn to control ranges, stabilizes

Balancing Rope(2)

Interesting graphs: Why second this much higher…?▪ Mentality before starting?

Balancing Rope(3)

Training is very beneficial for good results

(Often)Takes consistent training for reliable results

Still basic control

Optimistic future, but still a lot to do

Research of 2007, is that old…?

Conclusions

Commercially available: OCZ Neural Impulse Actuator(incl

“Far Cry 2”) 3d shooter gaming(€119,-) EMG, EEG, and EOG! Works, but…▪ Needs training▪ Resynchronisation

Nevertheless overall good reviews!

Addition!

Questions?