adhd management gaming system for educational …€¦ · 8 vassilis thanopoulos csri 9 dr. stelios...

D3.2 Operational Gaming System Prototype

Demonstration Report

ADHD MANAGEMENT GAMING SYSTEM FOR

EDUCATIONAL ACHIEVEMENT AND SOCIAL INCLUSION

WORK PACKAGE 3 - Gaming System Technologies Adaptation & Integration

DISSEMINATION LEVEL: Public ■ Confidential □

This document was prepared by NCSRD with the valuable contribution of VWG, CSRI and CORT

Due Date // 30/04/2018 Delivery Date // 30/04/2018

This project is co-funded by the Horizon 2020 Framework Programme

of the European Union Grant Agreement No. 732375

ADHD MANAGEMENT GAMING SYSTEM FOR EDUCATIONAL ACHIEVEMENT AND SOCIAL INCLUSION


D3.2 Operational Gaming System Prototype Demonstration Report Document version 1.0

Copyright © FocusLocus Consortium. All rights reserved. This project is co-funded by the Horizon 2020 Framework Programme of the European Union - Grant Agreement No. 732375

[2]

Project Information

Project Title FocusLocus

Project Subtitle ADHD Management Gaming System for Educational Achievement and Social Inclusion

Project Coordinator National Center for Scientific Research “Demokritos”, EL

Project Start Date 01/11/2016

Project Duration 27 months

Project Funded by European Commission

Under the Programme Horizon 2020 Information and Communication Technologies

Subcall H2020-ICT-2016-1

Topic ICT-24-2016 “Gaming and gamification”

Funding Instrument Innovation Action

Grant Agreement No. 732375




[3]

Document Information

Deliverable number: D 3.2

Deliverable title: Operational Gaming System Prototype Demonstration Report

Deliverable version: 1.0

Work Package number: 3

Work Package title: Gaming System Technologies Adaptation & Integration

Due Date of delivery: 30/04/2018

Actual date of delivery: 30/04/2018

Dissemination level: PU

Editor(s): Tassos Kanellos (NCSRD) Adam Doulgerakis (NCSRD)

Contributor(s):

Jon Arambari Basanez (VWG) Argiro Vatakis (CSRI) Vassilis Thanopoulos (CSRI) Aine Behan (CORT) Maria Bessa (NCSRD) Eftichia Georgiou (NCSRD)

Reviewer(s): Stelios C.A. Thomopoulos (NCSRD)

Ethical advisor(s):

Status:

□ Draft □ Consortium reviewed □ WP Leader accepted □ Ethical Advisor(s) accepted □ Project Coordinator accepted □ Review, minor changes □ Amendments following review ■ Final version

Rights: FocusLocus Consortium




[4]

Document Version History

Version Date Beneficiary Description

0.1 16/04/2018 NCSRD Document Content outline / structure

0.2 26/04/2018 NCSRD Draft version

0.3 27/04/2018 NCSRD Complete version

0.4 27/04/2018 NCSRD Complete version formatted according to template

0.5 27/04/2018 NCSRD Complete version with Annexes

1.0 30/04/2018 NCSRD Final version after internal review




[5]

Disclaimer

The content of this deliverable does not reflect the official opinion of the European Union.

Responsibility for the information and views expressed herein lies entirely with the author(s).




[6]

Executive Summary

This deliverable documents results of the task T3.6: Integration & Optimisation of the WP3 Gaming System Technologies Adaptation and Integration and in particular reports on the demonstration of the FocusLocus Operational Gaming System Prototype of the FocusLocus project that took place on April 25, 2018 at the premises of NCSRD in Athens, Greece.




[7]

List of Acronyms and Abbreviations

Acronym Explanation

ADHD Attention Deficit and Hyperactivity Disorder

AR/VR Augmented Reality / Virtual Reality

CORT Cortechs Connect Limited

CPPM Control Panel and Performance Monitoring

CSRI Cognitive Systems Research Institute

EC European Commission

EEG Electroencephalography

EU European Union

FSJD Fundació Sant Joan de Déu

GUI Graphical User Interface

H2020 Horizon 2020

HAEF Hellenic American Educational Foundation

HMI Human Machine Interface

HSJD Hospital Sant Joan de Déu

MMR Multisensory Mixed Reality

MS Management Simulation

NCSRD National Center for Scientific Research “Demokritos”

RTS Real-Time Strategy

UI/UX User Interface / User Experience

VWG Virtualware 2007 SA

VWM Virtual World Management




[8]

Table of Contents

Project Information ......................................................................................................................................... 2

Document Information .................................................................................................................................... 3

Document Version History ............................................................................................................................... 4

Disclaimer ....................................................................................................................................................... 5

Executive Summary ......................................................................................................................................... 6

List of Acronyms and Abbreviations ................................................................................................................. 7

Table of Contents ............................................................................................................................................ 8

List of Figures .................................................................................................................................................. 9

1. Introduction ........................................................................................................................................... 10

1.1. Objectives - Aim of this report.................................................................................................................... 10

1.2. Document structure ................................................................................................................................... 10

2. Demonstration Event Agenda ................................................................................................................. 11

3. List of Attendees .................................................................................................................................... 12

4. Demonstration Event.............................................................................................................................. 13

4.1. Presentations .............................................................................................................................................. 13

4.2. Demonstration of the FocusLocus Game ................................................................................................... 22

5. Discussion .............................................................................................................................................. 28




[9]

List of Figures

Figure 1. Project Overview presentation by FocusLocus Project Coordinator,.......................................................... 13 Figure 2. Introduction of Consortium Partner representatives attending via teleconference .................................. 14 Figure 3. Introduction of NCSRD representatives. ..................................................................................................... 14 Figure 4. Introduction of invited ADHD Hellas members. .......................................................................................... 15 Figure 5. Presentation of the ADHD Hellas organisation ........................................................................................... 15 Figure 6. Presentation of the FocusLocus cognitive skill training methodology by ................................................... 16 Figure 7. Comments by invited Special Needs Education specialist, Ms. Kazakakou. ............................................... 16 Figure 8. Comments by FocusLocus Project Coordinator, Dr. Stelios Thompoulos (NCSRD) ..................................... 17 Figure 9. Presentation of the FocusLocus game concept and content by ................................................................. 17 Figure 10. Presentation of the FocusLocus game concept and content by ............................................................... 18 Figure 11. Presentation of the FocusLocus game mechanics by NCSRD representative Tassos Kanellos ................. 18 Figure 12. Presentation of the FocusLocus game mechanics by ................................................................................ 19 Figure 13. Comments by invited ADHD Hellas member, Dr. Vourdas........................................................................ 19 Figure 14. Demonstration of the FocusLocus game. .................................................................................................. 20 Figure 15. Demonstration of the EEG Neurofeedback functionality by ..................................................................... 20 Figure 16. Demonstration of the FocusLocus game. .................................................................................................. 21 Figure 17. FocusLocus Demonstration Event participants. ........................................................................................ 21 Figure 18. Game Environment – Side View. No infrastructure present. Multiple units present. .............................. 22 Figure 19. Game Environment – Top View. No infrastructure present. Multiple units present. ............................... 22 Figure 20. Game Environment – Detail View. No infrastructure present. Multiple units present. ........................... 23 Figure 21. Build Mode. Infrastructure possible locations are visible. ........................................................................ 23 Figure 22. Infrastructure under construction by respective units. ............................................................................ 23 Figure 23. Infrastructure Health (Coral Bleaching) Bar. ............................................................................................. 24 Figure 24. Unit Creation Mode Pop-Up Window. ...................................................................................................... 24 Figure 25. Infrastructure Activation (assets producing resources) Mode Pop-Up Window. ..................................... 24 Figure 26. Builder Units (tinted in red) arriving to an infrastructure under construction. ........................................ 25 Figure 27. Game Environment populated with multiple infrastructure assets – Top View. ...................................... 25 Figure 28. Infrastructure under attack by Bumphead Parrotfish Threat. .................................................................. 25 Figure 29. Game Environment populated with multiple infrastructure assets – Detail View. .................................. 26 Figure 30. Game Environment populated with multiple infrastructure assets – Bird-Eye View. .............................. 26 Figure 31. Tetralia Crab Unit Detail View. .................................................................................................................. 26 Figure 32. Trumpet Triton Unit Detail View. .............................................................................................................. 27 Figure 33. Game Environment populated with multiple infrastructure assets – Close-Up View. ............................. 27




[10]

1. Introduction

1.1. Objectives - Aim of this report

This deliverable documents results of the task T3.6: Integration & Optimisation of the WP3 Gaming System Technologies Adaptation and Integration and in particular reports on the demonstration of the FocusLocus Operational Gaming System Prototype of the FocusLocus project that took place on April 25, 2018 at the premises of NCSRD in Athens, Greece.

1.2. Document structure

The Operational Gaming System Prototype Demonstration report is organised into the following sections:

Section 1. Introduction. Includes the aim of this report and the structure of the document.

Section 2. Demonstration Event Agenda. Presents the agenda of the Gaming System Prototype Demonstration event.

Section 3. List of Attendees. Documents the attendees that participated in the demonstration event.

Section 4. Demonstration Event. Outlines the presentations and the demonstrated material.

Section 5. Discussion. Documents the discussion that followed the demonstration.




[11]

2. Demonstration Event Agenda

FocusLocus Prototype Demonstration Meeting

25 April 2018, 11:00-15:00 GR Time (10:00 -14:00 CEST)

Aigaio Lecture Room, Institute of Informatics and Telecommunications, NCSR Demokritos.

1. FocusLocus Project Overview

NCSRD 11:00 – 11:10 Present a brief overview of the project.

2. ADHD Hellas

ADHD Hellas 11:10- 11:30 Present a brief overview of ADHD Hellas main activities and relevant challenges.

3. Learning and Cognitive Skills Training

CSRI 11:30-12:00

Present an overview of the cognitive skills to be trained, and cognitive training methodology.

4. Pilot Study

FSJD 12:00-12:20 Present the pilot preparation activities, evaluation metrics & criteria

5. Gaming System Presentation

NCSRD 12:20-13:50

Present an overview of the gaming system, game modes (User Experience modes, game mechanics, system components and operation).

6. Lunch Break

13:50-14:20 Lunch Break

7. Discussion

All 14:20-15:00 Open Discussion




[12]

3. List of Attendees

No Name Representing

1 Christina Georgiadou ADHD Hellas

2 Dr. Aglaia Stampoltzis ADHD Hellas

3 Dr. Apostolos Vourdas ADHD Hellas

4 Dr. Sofia Georgoutsakou ADHD Hellas

5 Kalliopi Konte ADHD Hellas

6 Dr. Sofia Aroni ADHD Hellas

7 Alexia Kazakakou HAEF

8 Vassilis Thanopoulos CSRI

9 Dr. Stelios C.A. Thomopoulos NCSRD

10 Tassos Kanellos NCSRD

11 Adam Doulgerakis NCSRD

12 Maria Bessa NCSRD

13 Eftichia Georgiou NCSRD

14 Ino Theodorou NCSRD

15 Panagiotos Tsimpiridis NCSRD

16 Christos Maroglou NCSRD

17 Konstantinos Voulgaridis NCSRD

18 Georgios Karafotias NCSRD

19 Vana Alexopoulou NCSRD

20 Georgios Apostolakos NCSRD

21 Giorgos Thanos NCSRD

22 Dr. Jordi Navarra (Remotely) FSJD

23 Carlota Saumell (Remotely) FSJD

24 Dr. Aine Behan (Remotely) CORT

25 Dr. Jon Arambarri Basanez (Remotely) VWG




[13]

4. Demonstration Event

The FocusLocus Prototype Demonstration workshop took place on Wednesday 25 April 2018 and was hosted at the premises of NCSR “Demokritos” in Athens. The objective of this workshop was to bring together members of the Advisory Board and interested parties such as the Hellenic American Educational Foundation, in order to i) receive feedback regarding the FocusLocus methodology and approach based on the demonstrated operational prototype and ii) to exchange knowledge, insight and ideas for promoting inter-project collaboration.

Twenty-five participants attended the workshop, which included five presentations that triggered some constructive and insightful discussions for current and future approaches, methods and solutions related to ADHD management interventions. The speakers were representatives from ADHD Hellas, NCSRD, CSRI, and FSJD.

Consortium partners, stakeholders, advisory board members, and all interested parties that could not make it to attend the workshop in situ, had the option to attend it via a remote connection.

4.1. Presentations

Figure 1. Project Overview presentation by FocusLocus Project Coordinator, Dr. Stelios Thomopoulos.




[14]

Figure 2. Introduction of Consortium Partner representatives attending via teleconference (CORT: Dr. Aine Behan, FSJD: Dr. Jordi Navarra and Carlota Saumel, VWG: Dr. Jon Arambarri).

Figure 3. Introduction of NCSRD representatives.




[15]

Figure 4. Introduction of invited ADHD Hellas members.

Figure 5. Presentation of the ADHD Hellas organisation by ADHD Hellas President Ms. Georgiadou.




[16]

Figure 6. Presentation of the FocusLocus cognitive skill training methodology by CSRI representative, Vassilis Thanopoulos.

Figure 7. Comments by invited Special Needs Education specialist, Ms. Kazakakou.




[17]

Figure 8. Comments by FocusLocus Project Coordinator, Dr. Stelios Thompoulos (NCSRD)

Figure 9. Presentation of the FocusLocus game concept and content by NCSRD representative Adam Doulgerakis




[18]

Figure 10. Presentation of the FocusLocus game concept and content by NCSRD representative Adam Doulgerakis

Figure 11. Presentation of the FocusLocus game mechanics by NCSRD representative Tassos Kanellos




[19]

Figure 12. Presentation of the FocusLocus game mechanics by NCSRD representative Tassos Kanellos

Figure 13. Comments by invited ADHD Hellas member, Dr. Vourdas.




[20]

Figure 14. Demonstration of the FocusLocus game.

Figure 15. Demonstration of the EEG Neurofeedback functionality by NCSRD representative Eftihia Georgiou.




[21]

Figure 16. Demonstration of the FocusLocus game.

Figure 17. FocusLocus Demonstration Event participants.




[22]

4.2. Demonstration of the FocusLocus Game

The current version of the FocusLocus system was demonstrated along with all key features at their current stage of development. It was noted that the presented version was a work-in-progress and not all features have been integrated and finalised. The Graphical User Interface (GUI) used in the demonstration version was developed tentatively to serve the purposes of the demonstration and will be replaced by the final version of the GUI system.

Figure 18. Game Environment – Side View. No infrastructure present. Multiple units present.

Figure 19. Game Environment – Top View. No infrastructure present. Multiple units present.




[23]

Figure 20. Game Environment – Detail View. No infrastructure present. Multiple units present.

Figure 21. Build Mode. Infrastructure possible locations are visible.

Figure 22. Infrastructure under construction by respective units.




[24]

Figure 23. Infrastructure Health (Coral Bleaching) Bar.

Figure 24. Unit Creation Mode Pop-Up Window.

Figure 25. Infrastructure Activation (assets producing resources) Mode Pop-Up Window.




[25]

Figure 26. Builder Units (tinted in red) arriving to an infrastructure under construction.

Figure 27. Game Environment populated with multiple infrastructure assets – Top View.

Figure 28. Infrastructure under attack by Bumphead Parrotfish Threat.




[26]

Figure 29. Game Environment populated with multiple infrastructure assets – Detail View.

Figure 30. Game Environment populated with multiple infrastructure assets – Bird-Eye View.

Figure 31. Tetralia Crab Unit Detail View.




[27]

Figure 32. Trumpet Triton Unit Detail View.

Figure 33. Game Environment populated with multiple infrastructure assets – Close-Up View.




[28]

5. Discussion

During the presentation of the FocusLocus features and functionalities, the FocusLocus game demonstration and the open discussion that followed, the following comments were made:

In general, the attendees found the concept and principles of the overall FocusLocus approach to be sound and promising, while also noting that their implementation appears to be challenging.

Ms. Georgiadou suggested acting as a liaison between FocusLocus consortium and ADHD Europe. Ms. Georgiadou expressed the interest on behalf of ADHD Hellas to participate in other follow-up evaluation procedures of FocusLocus and to assist with any additional requirements for testing the FocusLocus system.

Dr. Stampoltzi and other attendees noted that they find using a video game to address the ADHD condition to be very suitable as a method, as according to their experience, children with ADHD are usually keen and adept gamers.

Dr. Vourdas mentioned that FocusLocus stands out amongst other relevant games and ADHD treatment methods as it addresses motor coordination skill. Dr. Vourdas asked whether it is foreseen to perform motor coordination training of fine motor skills (e.g. specific body part movements, catching a ball, standing one foot, etc.). The FocusLocus Consortium noted that is not foreseen for the current version of the gaming system due to restrictions of the selected HMI devices, but its support will be investigated to be adopted in a future version.

Dr. Vourdas asked if the concept of self-evaluation and self-observation of performed errors before an external evaluation occurs has been used in the cognitive skill training exercises. In Dr. Vourdas’ opinion, this process is very useful for improving the cognitive skill training process in children with ADHD. The FocusLocus Consortium noted that this feature has not been included, but its potential introduction in compatible cognitive skill training exercises will be examined.

The choice of the coral reef setting as a storyline was discussed. Dr. Stampoltzi found that it is most likely to be appealing to younger children, but expressed a concern about whether it would be equally appealing to the upper end of the age spectrum that FocusLocus addresses (teenagers). The FocusLocus Consortium noted that this was also an internal concern and referred to the difficulties that the Consortium faced in finding a unified theme that could be appealing to such a broad age range, while adhering to all identified learning and social user requirements. The FocusLocus Consortium explained the process and the reasons for selecting this option and noted that additional initiatives will be sought in order to make the game more appealing to older child ages through the introduction of visual special effects and the adaptation of gameplay features.

Dr. Vourdas asked why the concept of the game is not based on real-life scenarios such as the task of organising books on a bookshelf or preparing the necessary props in a timely manner before a match/ performance etc. According to Dr.Vourdas the cognitive skills acquired through a reality based game are directly transferred to skills that would be useful in addressing real life situations. The FocusLocus consortium explained that the game theme and scenario, had to be equally appealing to children regardless of their educational and cultural background, as well as the particular interest in certain activities (member of a team, band, etc.). It was also argued that according to the literature in the field of cognitive science, cognitive skills acquired through fantasy themed games can be easily transferred to addressing everyday scenarios. Additionally, the FocusLocus Consortium stressed that it was sought that




[29]

the game had to maintain a sense of detachment, keeping some distance between the game assets and children, ensuring that non-human characters are involved in the game.

Ms. Kazakakou suggested that the presented underwater coral reef environment would be suitable for children with ADHD as it appears to exhibit a sense of calmness. Other attendees agreed with this observation. Dr. Vourdas pointed out that the pace of the game (i.e. the speed of the fish and the crawlers) seems to be appropriate to assist in the player’s relaxation.

It was suggested to give more memorable names to game assets instead of the names given to the respective species in the field of marine biology.

Most of the attendees agreed that inclusion of sounds would be crucial in order to notify the players about game actions.

Ms. Kazakakou asked for clarifications concerning the design of the cognitive skill training exercises, their method/sequence of appearance in the game and the control of the exercise level of difficulty. The FocusLocus Consortium gave further details to describe the approach (i.e. the exercises’ design approach as application of simple behavioural tasks, exercise type appearance frequency ratios, variable Level-Of-Difficulty per exercise type, initial customisation according to user profile information and subsequent automated adaptation according to user performance) and the additional explanations were found to be satisfactory.

Dr. Stampoltzi asked whether the game has an end and it was explained that the game is intended to be open-ended. With regards to this issue, NCSRD staff noted that the FocusLocus game more closely follows the general paradigm of Management Simulation games due to its non-violent characteristics in contrast to Real-Time-Strategy games where the game ends when the opponent is defeated. In each gaming session, the FocusLocus game will be resumed from the point that a user has reached in the previous session. FocusLocus will present intermediate objectives in the form of mini-quests that can be achieved in the short term (within single sessions), following ADHD condition requirements. In a future version, FocusLocus will aim to introduce additional environment levels, to be presented consecutively when the user completes a single level.

The attendees asked about the expected duration of gaming sessions and expressed the concern for lengthy gaming sessions. The FocusLocus Consortium replied that 30 minute sessions of continuous gameplay will be implemented in the pilot study, but the system is intended to support the definition of a maximum session duration by the parent, attending clinician or special needs educator through the Control Panel and Performance Monitoring (CPPM) Web Application.

Dr. Vourdas suggested that it is important to evaluate user satisfaction. The FocusLocus Consortium noted that this falls within the intended tests to be performed in the pilot study.

Dr. Thomopoulos noted that the game could become adaptive to people with colour vision deficiencies by incorporating some colour identification tests before the game starts. During the discussion that followed, it was suggested that due to time limitations, this feature could be developed for a future version of FocusLocus and that the absence of colour vision deficiencies could be incorporated in the inclusion criteria for the pilot study participants.

Dr. Thomopoulos asked whether the infrastructure assets could be animated. NCSRD’s development team expressed their concern in terms of computational graphics performance on a tablet device in case all infrastructure assets are animated. The animation of a number of units (fish) is already quite demanding for the processor of the tablet device. A potential scenario would be to animate some infrastructure




[30]

types, such as the seaweed. Dr. Stampoltzis noted that during the implementation of the pilot study of the program, an experienced

educator who works with ADHD children should be involved in order to be sure that the intervention session will be held correctly. In addition, according to Dr. Stampoltzis, the game should be piloted in a clinical and a non-clinical sample of ADHD children and a control group (not necessarily), with the age group also being a challenging factor.