innovative technology getting the knack and mental ... · example 1: sonification of “muscle...

1
Copyright © 2015 NTT. All Rights Reserved. R9 Getting the Knack and Mental Condition in Sports Body / Mind Reading & Feedback Using Wearable Bioelectrode Our wearable bioelectrode can easily sense electromyographic (EMG) and electrocardiographic (ECG) signals during sports. We propose feedback techniques that sonify and visualize muscle activity and heart rate by using these signals. These techniques will help a player to comprehensibly get the knack for a desired action and the mental condition in sports. “hitoe” is functional material for a wearable bioelectrode that was co-developed with Toray Industries, Inc. Taking on challenges toward 2020 We will create novel ICT solutions to support practical training for sports athletes based on the combination of findings in human science and information engineering technology. Features Application Scenarios Skill training such as how to move the body and how to exert force. Monitoring physical and mental condition Use in rehabilitation and entertainment fields in addition to sports. Effortless measurement of EMG and ECG signals is possible by wearing a shirt with fabric bioelectrodes. Transforming multiple muscle activities, e.g., patterns and rhythm, into a synthesized sound in real-time Visualizing heart rate variability (autonomic activity) Providing feedback for getting the knack for desired action, the extent of muscle activation, and the mental state in an understandable way Combination with other sensors, e.g., acceleration sensor, is possible. Contact[email protected] Innovative technology Example 1: Sonification of “Muscle Activity Rhythm” Example 2: Visualization of “Heart Rate Variability” Wrist muscle Thigh muscle 0 0.5 1.0 -3.0 0 3.0 -3.0 0 3.0 EMG (mV) -3.0 0 3.0 -3.0 0 3.0 EMG (mV) Time(s) Good activity Poor activity Transform into sounds in real-time 0 0.5 1.0 Time (s) Frequency (kHz) 0 1.5 Frequency (kHz) 0 1.5 Fabric bioelectrode 0 5 10 Time(s) -1.0 0 1.0 EOG (mV) 50 0.05 100 60 80 70 90 Heart rate (bpm) 0 0.1 Bad (many mistakes) Good (fewer mistakes) Power spectrum density (S 2 /Hz) 50 Time(s) 100 0 150 200 250 Frequency (Hz) 0 0.1 0.2 0.3 0.4 0.5 Frequency (Hz) 0 0.1 0.2 0.3 0.4 0.5 Bad Good LF/HF: sympathetic activity (stress) HF: parasympathetic activity (relaxation) HF LF B G HF power (S 2 ) LF/HF (ratio) 0.8 0 0 B G 1.0 Wrist-based sound Thigh-based sound Thigh with poor activity not sonified Stress level Relaxation level

Upload: others

Post on 26-Jul-2020

2 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Innovative technology Getting the Knack and Mental ... · Example 1: Sonification of “Muscle Activity Rhythm” Example 2: Visualization of “Heart Rate Variability” Wrist muscle

Copyright © 2015 NTT. All Rights Reserved.

R-9 Getting the Knack and Mental Condition in Sports

Body / Mind Reading & Feedback Using Wearable Bioelectrode

Our wearable bioelectrode can easily sense electromyographic (EMG) and electrocardiographic (ECG) signals during sports. We propose feedback techniques that sonify and visualize muscle activity and heart rate by using these signals. These techniques will help a player to comprehensibly get the knack for a desired action and the mental condition in sports.

“hitoe” is functional material for a wearable bioelectrode that was co-developed with Toray Industries, Inc.

Taking on challenges toward 2020 We will create novel ICT solutions to support practical training for sports athletes based on the combination of findings in human science and information engineering technology.

Features

Application Scenarios ■ Skill training such as how to move the body and how to exert force. ■ Monitoring physical and mental condition ■ Use in rehabilitation and entertainment fields in addition to sports.

■ Effortless measurement of EMG and ECG signals is possible by wearing a shirt with fabric bioelectrodes.

■ Transforming multiple muscle activities, e.g., patterns and rhythm, into a synthesized sound in real-time

■ Visualizing heart rate variability (autonomic activity) ■ Providing feedback for getting the knack for desired action, the

extent of muscle activation, and the mental state in an understandable way

■ Combination with other sensors, e.g., acceleration sensor, is possible.

〈Contact〉[email protected]

Innovative technology

Example 1: Sonification of “Muscle Activity Rhythm”

Example 2: Visualization of “Heart Rate Variability”

Wrist muscle

Thigh muscle

0 0.5 1.0

-3.0

0

3.0

-3.0

0

3.0

EMG

(mV)

-3.0

0

3.0

-3.0

0

3.0

EMG

(mV)

Time(s)

Good activity

Poor activity

Transform into sounds in real-time

0 0.5 1.0 Time (s)

Freq

uenc

y (k

Hz)

0

1.5

Freq

uenc

y (k

Hz)

0

1.5

Fabric bioelectrode 0 5 10 Time(s)

-1.0

0

1.0

EOG

(mV)

50

0.05

100

60

80

70

90

Hea

rt ra

te (b

pm)

0

0.1

Bad (many mistakes) Good (fewer mistakes)

Pow

er s

pect

rum

den

sity

(S2 /

Hz)

50 Time(s)

100 0 150 200 250

Frequency (Hz) 0 0.1 0.2 0.3 0.4 0.5

Frequency (Hz) 0 0.1 0.2 0.3 0.4 0.5

Bad Good

LF/HF: sympathetic activity (stress) HF: parasympathetic activity (relaxation)

HF LF

B G

HF

pow

er (S

2 )

LF/H

F (r

atio

) 0.8

0 0 B G

1.0

Wrist-based sound

Thigh-based sound

Thigh with poor activity not sonified

Stress level Relaxation level