université de bourgogne franche-comté | utbm serious ...€¦ · mocap: sensors on the body (zare...
TRANSCRIPT
![Page 1: Université de Bourgogne Franche-Comté | UTBM Serious ...€¦ · MOCAP: sensors on the body (Zare et al 2017) Neck: 3 (flex / ext, abd / add, rot) Trunk: 3 (flex / ext, abd / add,](https://reader035.vdocuments.mx/reader035/viewer/2022071300/60896a727ca91577671f6ad0/html5/thumbnails/1.jpg)
Projet Serious Game
Équipe de recherche ERCOS (ergonomie et conception des systèmes)
Université de Bourgogne Franche-Comté | UTBM
Serious game for occupational health: can new technology help to prevent musculoskeletal
disorders?
M. ZARE, B. MIGNOT, J.C. SAGOT
1
![Page 2: Université de Bourgogne Franche-Comté | UTBM Serious ...€¦ · MOCAP: sensors on the body (Zare et al 2017) Neck: 3 (flex / ext, abd / add, rot) Trunk: 3 (flex / ext, abd / add,](https://reader035.vdocuments.mx/reader035/viewer/2022071300/60896a727ca91577671f6ad0/html5/thumbnails/2.jpg)
Project
It is a European project involving French and Swiss universities and companies:
Universities:
Haute école de l’Arc (CH),
Université de Technologie de Belfort-Montbéliard (FR),
Video game companies:
Shine research (FR),
Witchlake studio (CH).
Institute for Market Research and Marketing Support:
Decryptis (FR),
Companies and experimental sites:
PSA – site de Sochaux (FR),
AEE – sites d’Audincourt et Burnhaupt (FR),
Compagnie des Montres Longines – site de St Imier (CH),
Audemars-Piguet – site du Brassus (CH).
From 01/10/2016 to 31/09/2018
![Page 3: Université de Bourgogne Franche-Comté | UTBM Serious ...€¦ · MOCAP: sensors on the body (Zare et al 2017) Neck: 3 (flex / ext, abd / add, rot) Trunk: 3 (flex / ext, abd / add,](https://reader035.vdocuments.mx/reader035/viewer/2022071300/60896a727ca91577671f6ad0/html5/thumbnails/3.jpg)
Project team
ERCOS-UTBM/UBFC
Jean-Claude SAGOT (PU)
chef de file France
Bernard Mignot (Enseignant-Chercheur)
Mohsen ZARE (Enseignant-Chercheur)
Imaging Team Stéphane Gobron (Enseignant-Chercheur) chef de file Suisse Equipe Technologies d’interactions Nabil Ouerhani (Enseignant-Chercheur)
Sylvain Grosdemouge Olivier Darbre Marie-Paule Spinner
![Page 4: Université de Bourgogne Franche-Comté | UTBM Serious ...€¦ · MOCAP: sensors on the body (Zare et al 2017) Neck: 3 (flex / ext, abd / add, rot) Trunk: 3 (flex / ext, abd / add,](https://reader035.vdocuments.mx/reader035/viewer/2022071300/60896a727ca91577671f6ad0/html5/thumbnails/4.jpg)
The aim is to develop a virtual video game, on which the operators can train to find the right strategies and practices to perform the industrial tasks.
The SG will be a complementary tool for existing solutions, and it will help to have a sustainable prevention program of musculoskeletal disorders.
Definitions :
Serious Game :
video game combines serious intent (in this case MSD) in a playful setting.
Musculoskeletal disorders
Project
![Page 5: Université de Bourgogne Franche-Comté | UTBM Serious ...€¦ · MOCAP: sensors on the body (Zare et al 2017) Neck: 3 (flex / ext, abd / add, rot) Trunk: 3 (flex / ext, abd / add,](https://reader035.vdocuments.mx/reader035/viewer/2022071300/60896a727ca91577671f6ad0/html5/thumbnails/5.jpg)
v
Global Approach
Modeling Gestures and
postures
Evaluating and characterizing
gestures/postures
UTBM ERCOS
Acquisition of gestures /
posture in real time
Evaluation of gestures and
posture in real time
Virtual environment
Serious Games
Score HE-Arc
HE-Arc / Shine / Witchlake
Scenarios
Exercises
![Page 6: Université de Bourgogne Franche-Comté | UTBM Serious ...€¦ · MOCAP: sensors on the body (Zare et al 2017) Neck: 3 (flex / ext, abd / add, rot) Trunk: 3 (flex / ext, abd / add,](https://reader035.vdocuments.mx/reader035/viewer/2022071300/60896a727ca91577671f6ad0/html5/thumbnails/6.jpg)
Measurements In real settings
Database
Scenarios of game
Game engine
Decoration, sounds
Tests Validation
Evaluations
1
Characterization Of activity
2
3
Evaluation of operator gesture, score
Levels and progression of the game
4 Evaluation SG Effectiveness of the method
Separate characterization of the gestures and MSD risk assessment
Data management
![Page 7: Université de Bourgogne Franche-Comté | UTBM Serious ...€¦ · MOCAP: sensors on the body (Zare et al 2017) Neck: 3 (flex / ext, abd / add, rot) Trunk: 3 (flex / ext, abd / add,](https://reader035.vdocuments.mx/reader035/viewer/2022071300/60896a727ca91577671f6ad0/html5/thumbnails/7.jpg)
Measurements
The project start with the measurements in several industrial settings in France and Switzerland, in the automotive and watchmaking sectors.
The goal is to build a database for the future game so that it would be as much as possible relevant and realistic.
![Page 8: Université de Bourgogne Franche-Comté | UTBM Serious ...€¦ · MOCAP: sensors on the body (Zare et al 2017) Neck: 3 (flex / ext, abd / add, rot) Trunk: 3 (flex / ext, abd / add,](https://reader035.vdocuments.mx/reader035/viewer/2022071300/60896a727ca91577671f6ad0/html5/thumbnails/8.jpg)
Detail of measurements
Questionnaires (Roquelaure et al 2006; Zare et al 2015)
MSD symptoms (Nordic questionnaire)
Borg scale
KARASEK
MOCAP: sensors on the body (Zare et al 2017)
Neck: 3 (flex / ext, abd / add, rot)
Trunk: 3 (flex / ext, abd / add, rot)
Shoulders: 3 (flex / ext, abd / add, rot)
Elbows: 2 (flex / ext, pro / sup)
Wrists: 2 (flex / ext, abd / add)
Measurements EMG of the muscles of the hand (watchmakers) (Gaudez et al 2015)
Measurements of the physical working environment
![Page 9: Université de Bourgogne Franche-Comté | UTBM Serious ...€¦ · MOCAP: sensors on the body (Zare et al 2017) Neck: 3 (flex / ext, abd / add, rot) Trunk: 3 (flex / ext, abd / add,](https://reader035.vdocuments.mx/reader035/viewer/2022071300/60896a727ca91577671f6ad0/html5/thumbnails/9.jpg)
Activity analysis
Sequencing the activity, as well as the associated chronogram based on data from the biomechanical measurements and video recordings (10 workstations and 5 subjects AEE; 4 operations and 5 subjects Longine; ~7 workstations and 5 subjects PSA; …)
Characterizing movements of each action, task or cycle and comparisons between actions, cycles, workstations, operators (Zare et al 2016; Gaudez et al 2016)
Durée d’observation
![Page 10: Université de Bourgogne Franche-Comté | UTBM Serious ...€¦ · MOCAP: sensors on the body (Zare et al 2017) Neck: 3 (flex / ext, abd / add, rot) Trunk: 3 (flex / ext, abd / add,](https://reader035.vdocuments.mx/reader035/viewer/2022071300/60896a727ca91577671f6ad0/html5/thumbnails/10.jpg)
Activity analysis
Categories of activities to be analyzed
Sedentary static workstation, with reduced mobility of the arms (Watchmaking)
Standing static workstation: reduced amplitude, operators work on a static part, and move on a space of 1 to 2 meters. (Automotive)
Standing dynamic workstation: large amplitude, operators follow production and move at same time with vehicle (moving 3 to 6 meters), then back to take next production (Automotive)
Common features:
repetitive tasks, cycle time from 45 '' to 2 minutes, for a period of 1 to 2 hours.
![Page 11: Université de Bourgogne Franche-Comté | UTBM Serious ...€¦ · MOCAP: sensors on the body (Zare et al 2017) Neck: 3 (flex / ext, abd / add, rot) Trunk: 3 (flex / ext, abd / add,](https://reader035.vdocuments.mx/reader035/viewer/2022071300/60896a727ca91577671f6ad0/html5/thumbnails/11.jpg)
Activity analysis
Different types of activity:
F: activity with heavy effort – material handling, clipping, embedding...
P: Activity requires precision - screwing, watchmaking activities, polishing, retouching...
M: Handling and movement - take a tool, an object, ...
R: rest – time between two cycles, assembly parts or waiting for logistics (recovery time)
![Page 12: Université de Bourgogne Franche-Comté | UTBM Serious ...€¦ · MOCAP: sensors on the body (Zare et al 2017) Neck: 3 (flex / ext, abd / add, rot) Trunk: 3 (flex / ext, abd / add,](https://reader035.vdocuments.mx/reader035/viewer/2022071300/60896a727ca91577671f6ad0/html5/thumbnails/12.jpg)
Summary of activity analysis
Measured Characteristics
Upper limbs :
20 angles, 8 body parts, 3 limbs, 1 individual
Individuals and populations
Categories:
Type: force / precision / movement / rest
Timing of activity:
Duration of action / cycle
Repetition of gesture
Risk prioritization (ISO standard):
3-level model: low / moderate / high
![Page 13: Université de Bourgogne Franche-Comté | UTBM Serious ...€¦ · MOCAP: sensors on the body (Zare et al 2017) Neck: 3 (flex / ext, abd / add, rot) Trunk: 3 (flex / ext, abd / add,](https://reader035.vdocuments.mx/reader035/viewer/2022071300/60896a727ca91577671f6ad0/html5/thumbnails/13.jpg)
Site (4)
workstation (3)
operators (5 to 6)
Cycle (> 10)
Elementary Action (10 to 30)
Modeling (?)
Statistic indicator(6)
Database (25/sec)
Questionnaire (4)
Summary of data collection
![Page 14: Université de Bourgogne Franche-Comté | UTBM Serious ...€¦ · MOCAP: sensors on the body (Zare et al 2017) Neck: 3 (flex / ext, abd / add, rot) Trunk: 3 (flex / ext, abd / add,](https://reader035.vdocuments.mx/reader035/viewer/2022071300/60896a727ca91577671f6ad0/html5/thumbnails/14.jpg)
AEE Audincourt
AEE Burnhaupt
Audemars-Piguet
Longines
PSA Sochaux
Assemblage
Injection
Peinture
Pose-cadran
Pose-aiguille
Borg
Karasek
MSP-25
Site
Poste [*]
Opérateur
Questionnaire
Cycle
30’’
1’ 00’’
1’ 30’’
2’ 00’’
2’ 30’’
24 Females
24 Males
Nordique Emboitage
Visitage
Faisceau
Moteur
Sous-caisse
Demografic
Geometry
Noise
Lighting
Temperature
[*] Environnement
Summary of data collection
Vibration
![Page 15: Université de Bourgogne Franche-Comté | UTBM Serious ...€¦ · MOCAP: sensors on the body (Zare et al 2017) Neck: 3 (flex / ext, abd / add, rot) Trunk: 3 (flex / ext, abd / add,](https://reader035.vdocuments.mx/reader035/viewer/2022071300/60896a727ca91577671f6ad0/html5/thumbnails/15.jpg)
assembling
clipping
putting
pulling
Tightening
type
duration
effort
angles (20)
tools
Cycle
Action
Descriptor
Indicator
Mean
SD
quartile 5%
quartile 95%
velocity
zone-comfort
data.csv
data.avi
Source
repetition
MSD risk
Summary of data collection
![Page 16: Université de Bourgogne Franche-Comté | UTBM Serious ...€¦ · MOCAP: sensors on the body (Zare et al 2017) Neck: 3 (flex / ext, abd / add, rot) Trunk: 3 (flex / ext, abd / add,](https://reader035.vdocuments.mx/reader035/viewer/2022071300/60896a727ca91577671f6ad0/html5/thumbnails/16.jpg)
Measurements of the physical environment factors
objectives
Provide information for the digital setting of the game;
Identify possible risk factors for MSD.
Methods of measurements:
Workstation dimensions: Measure the main dimensions of the workstations and work areas in order to properly characterize the geometry, the architecture of the workstations.
Lighting: Measure illumination and luminance at various workstation and locations.
Sonometery and dosimetry measurements
Vibration measurement
![Page 17: Université de Bourgogne Franche-Comté | UTBM Serious ...€¦ · MOCAP: sensors on the body (Zare et al 2017) Neck: 3 (flex / ext, abd / add, rot) Trunk: 3 (flex / ext, abd / add,](https://reader035.vdocuments.mx/reader035/viewer/2022071300/60896a727ca91577671f6ad0/html5/thumbnails/17.jpg)
1 5
10
10
Automobile domain
Watchmaking domain
Task workstation sounds Accessories
Task workstation sounds Accessories
First phase A cool setting like beach
Neutral setting
Evolution of the game - about 10 levels
Measurements of real settings
![Page 18: Université de Bourgogne Franche-Comté | UTBM Serious ...€¦ · MOCAP: sensors on the body (Zare et al 2017) Neck: 3 (flex / ext, abd / add, rot) Trunk: 3 (flex / ext, abd / add,](https://reader035.vdocuments.mx/reader035/viewer/2022071300/60896a727ca91577671f6ad0/html5/thumbnails/18.jpg)
Technological implementation of the Serious Game
Real-time acquisition of gestures and posture
Non-intrusive technology to maximize immersion
"Portable" technology for high flexibility
Multi-scale acquisition: gestures with large amplitude (shoulders, arms, etc.) + micro gestures (fingers)
Performance constraints (real time)
Evaluation of gestures and postures
Algorithms for matching gestures and postures: models versus real-time acquisition
Multi-level matching (segments, limbs, individual)
Consideration of the temporal dimension: trajectory of the gesture
Merging different levels and factors into an overall score
![Page 19: Université de Bourgogne Franche-Comté | UTBM Serious ...€¦ · MOCAP: sensors on the body (Zare et al 2017) Neck: 3 (flex / ext, abd / add, rot) Trunk: 3 (flex / ext, abd / add,](https://reader035.vdocuments.mx/reader035/viewer/2022071300/60896a727ca91577671f6ad0/html5/thumbnails/19.jpg)
Technological implementation of the Serious Game
Analysis of gesture and postural acquisition in SG
Kinect for «macro" gestures
Leap Motion for «micro" gestures
Format Conversion (Mocap versus Kinect)
![Page 20: Université de Bourgogne Franche-Comté | UTBM Serious ...€¦ · MOCAP: sensors on the body (Zare et al 2017) Neck: 3 (flex / ext, abd / add, rot) Trunk: 3 (flex / ext, abd / add,](https://reader035.vdocuments.mx/reader035/viewer/2022071300/60896a727ca91577671f6ad0/html5/thumbnails/20.jpg)
Thank you very much !
[email protected] Équipe de recherche en ERgonomie et COnception
des Systèmes (ERCOS)