1/20 system overview cyclic mo-cap data (walking, running..) cyclic mo-cap data (walking, running..)...
TRANSCRIPT
1/20
System OverviewSystem Overview
Cyclic mo-cap data(walking, running..)Cyclic mo-cap data(walking, running..)
Music / Sound(audio)
Music / Sound(audio)
ResultingAnimationResultingAnimation
Motion Editing1. Stretching
2. Spikes
Motion Editing1. Stretching
2. Spikes
ExtractingPercussive
Events
Modification of the existing motion
Addition of the new gestures
2/20
Demo: StretchingDemo: Stretching
• Mo-cap walking
• Bass drum tracks
• Mo-cap walking
• Bass drum tracks
3/20Motion Editing: Stretching
OverviewMotion Editing: Stretching
Overview
Musical events(Audio
segments)
Cyclic mo-cap data(walking, running..)
Divided mo-cap data(motion segments)
Stretching
Joining
ResultingAnimationResultingAnimation
4/20Motion Editing: Stretching
1. Defining motion segmentsMotion Editing: Stretching
1. Defining motion segments
Cyclic mo-cap data(walking, running..)Cyclic mo-cap data(walking, running..)
Smoothing(Low-pass Filtering)
Smoothing(Low-pass Filtering)
Smoothing(Low-pass Filtering)
Smoothing(Low-pass Filtering)
Smoothing(Low-pass Filtering)
A selectedmotion channel
A smoothedmotion channel
Motion framesthat define
motion segmentsCalculatingFirst derivatives
Divided mo-cap data(walking, running..)
Divided mo-cap data(walking, running..)
Dividing all motionchannels to segments
5/20Motion Editing: Stretching
2. Stretching motion segmentsMotion Editing: Stretching
2. Stretching motion segments
Stretching motionsegments
Divided mo-cap data(walking, running..)
Divided mo-cap data(walking, running..)
Musical events(Audio
segments)
Musical events(Audio
segments)
ResultingAnimationResultingAnimation
Joining
Automatically detected
6/20
Demo: StretchingDemo: Stretching
• 3 different mo-cap animations
• Bass drum tracks
• 3 different mo-cap animations
• Bass drum tracks
7/20
Demo: SpikesDemo: Spikes
• Mo-cap standing
• Drum track
• Mo-cap standing
• Drum track
8/20Motion Editing: Spikes
OverviewMotion Editing: Spikes
Overview
Musical events(Audio
segments)
Adding Spikes Smoothing(Low-pass Filtering)Mo-cap data
ResultingAnimation
Automatically detected
9/20Motion Editing: Spikes
1. Decomposing original data and adding spikesMotion Editing: Spikes
1. Decomposing original data and adding spikes
Musical events(Audio segments)
Musical events(Audio segments)
Spiked mo-cap data
Adding spikes toa selected channelMo-cap data
Decomposition intofrequency bands
10/20Motion Editing: Spikes2. Smoothing and reconstructing spikesMotion Editing: Spikes2. Smoothing and reconstructing spikes
Spiked mo-cap data
FilteringResultingAnimationResultingAnimation
Reconstruction
11/20Motion Editing: Spikes
3. Comparison between the resultsMotion Editing: Spikes
3. Comparison between the results
Decomposition+
Spikes+
Filtering+
Reconstruction
Decomposition+
Spikes+
Filtering+
Reconstruction
Original+
Spikes+
Filtering
Original+
Spikes+
Filtering
OriginalOriginal
12/20
Demo: SpikesDemo: Spikes
• Mo-cap standing
• Drum track
• Mo-cap standing
• Drum track
13/20
Audio AnalysisAudio Analysis
MusicMusic Interventionby the user
Spectrum Analysis
(8 bands)
14/208 frequency bands8 frequency bands
Filtering
Threshold
PercussiveEvents
PercussiveEvents
PercussiveEvents
PercussiveEvents
Interventionby the user
PercussiveEvents
PercussiveEvents
Downsampling
Musical events(Percussive
events)
Musical events(Percussive
events)