title for the poster, as brief and concise solfège hand ... · this is a dummy text. far far away,...

This is a dummy text. Far far away, behind the word mountains, far from the countries Vokalia and Consonantia, there live the blind texts. Separated they live in Bookmarksgrove right at the coast of the Semantics, a large language ocean. A small river named Duden flows by their place and supplies it with the necessary regelialia. It is a paradisematic country, in which roasted parts of sentences fly into your mouth.

Inner titleThis is a dummy text. Far far away, behind the word mountains, far from the countries Vokalia and Consonantia, there live the blind texts. Separated they live in Bookmarksgrove right at the coast of the Semantics, a large language ocean. A small river named Duden flows by their place and supplies it with the necessary regelialia. It is a paradisematic country, in which roasted parts of sentences fly into your mouth. Even the all-powerful Pointing has no control about the blind texts it is an almost unorthge ocean.

1 Introduction

2 Method Overview

3 Materials

4 Results and Discussion

5 Conclusion

6 References

Title for the poster, as brief and concise as possibleAuthor one1, Author two2, Author three3

1Organisational unit, ETH Zurich; 2Organisational unit, University X; 3Organisational unit, University Y

This is a dummy text. Far far away, behind the word mountains, far from the countries Vokalia and Consonantia, there live the blind texts. Separated they live in Book-marksgrove right at the coast of the Semantics, a large language ocean. A small river named Duden flows by their place and supplies it with the necessary

This is a dummy text. Far far away, behind the word mountains, far from the countries Vokalia and Consonantia, there live the blind texts. Separated they live in Book-marksgrove right at the coast of the Semantics, a large language ocean.

A small river named Duden flows by their place and supplies it with the necessary regelialia. It is a paradisematic country, in which roasted parts of sentences fly into your mouth. Even the all-powerful Pointing has no control about the blind texts it is an almost ographic life One day however a small line of blind text by the name of Lorem Ipsum decided to leave for the far World of Grammar. Even the all-powerful Pointing has no control about the blind texts it is an almost unorthographic life

Partners:

Fig. 1. This is a dummy text. Far far away, behind the word mountains, far from the countries Vokalia and Consonantia, there live the blind texts. Separated they live in Bookmarksgrove right at the coast of the Semantics.

This is a dummy text. Far far away, behind the word mountains, far from the countries Vokalia and Consonantia, there live the blind texts. Separated they live in Bookmarksgrove right at the coast of the Semantics, a large language ocean.

Inner titleA small river named Duden flows by their place and supplies it with the necessary regelialia. It is a para-disematic country, in which roasted parts of sentences fly into your mouth. Even the all-powerful Pointing has no control about the blind texts it is an


– This is a dummy text. Far far away, behind the word mountains, far from the countries Vokalia and Consonantia, there live the blind.

– Separated they live in Bookmarksgrove right at the coast of the

– Semantics, a large language ocean. A small river named Duden flows by their place and supplies it with the necessary

1. This is a dummy text. Far far away, behind the word mountains, far from the countries Vokalia and Consonantia, there live the blind texts. 2. Separated they live in Bookmarksgrove right at the coast of the Semantics, a large language ocean. 3. A small river named Duden flows by their place and supplies it with the necessary regelialia. 4. It is a paradisematic country, in which roasted parts of sentences fly into your mouth.

table title left 511 334 3727 69 8 124 1191 218

table title left 64 65 41 14 22 45 73 415

table title left 51 5 1 32 22 45 73 182

table title left 38 6 1 9 5 45 73 63

table title left 23 4 3 4 6 45 20 45

Fig. 1. This is a dummy text. Far far away, behind the word mountains, far from the countries Vokalia and Consonantia, there live the blind texts. Separated they live in Bookmarksgrove right at the coast.



1 Introduction

2 Method Overview

3 Materials


5 Conclusion

6 References






Partners:









table title left 511 334 3727 69 8 124 1191 218

table title left 64 65 41 14 22 45 73 415

table title left 51 5 1 32 22 45 73 182

table title left 38 6 1 9 5 45 73 63

table title left 23 4 3 4 6 45 20 45




1 Introduction

2 Method Overview

3 Materials


5 Conclusion

6 References






Partners:









table title left 511 334 3727 69 8 124 1191 218

table title left 64 65 41 14 22 45 73 415

table title left 51 5 1 32 22 45 73 182

table title left 38 6 1 9 5 45 73 63

table title left 23 4 3 4 6 45 20 45




1 Introduction

2 Method Overview

3 Materials


5 Conclusion

6 References






Partners:









table title left 511 334 3727 69 8 124 1191 218

table title left 64 65 41 14 22 45 73 415

table title left 51 5 1 32 22 45 73 182

table title left 38 6 1 9 5 45 73 63

table title left 23 4 3 4 6 45 20 45




1 Introduction

2 Method Overview

3 Materials


5 Conclusion

6 References






Partners:









table title left 511 334 3727 69 8 124 1191 218

table title left 64 65 41 14 22 45 73 415

table title left 51 5 1 32 22 45 73 182

table title left 38 6 1 9 5 45 73 63

table title left 23 4 3 4 6 45 20 45




1 Introduction

2 Method Overview

3 Materials


5 Conclusion

6 References






Partners:









table title left 511 334 3727 69 8 124 1191 218

table title left 64 65 41 14 22 45 73 415

table title left 51 5 1 32 22 45 73 182

table title left 38 6 1 9 5 45 73 63

table title left 23 4 3 4 6 45 20 45




1 Introduction

2 Method Overview

3 Materials


5 Conclusion

6 References






Partners:









table title left 511 334 3727 69 8 124 1191 218

table title left 64 65 41 14 22 45 73 415

table title left 51 5 1 32 22 45 73 182

table title left 38 6 1 9 5 45 73 63

table title left 23 4 3 4 6 45 20 45


This is a dummy text. Far far away, behind the word mountains, far from the countries Vokalia and Consonantia, there live the blind texts. Sepa-rated they live in Bookmarksgrove right at the coast of the Semantics, a large language ocean. A small river named Duden flows by their place and supplies it with the necessary regelialia. It is a paradisematic coun-try, in which roasted parts of sentences fly into your mouth.

Inner titleThis is a dummy text. Far far away, behind the word mountains, far from the countries Vokalia and Consonantia, there live the blind texts. Sepa-rated they live in Bookmarksgrove right at the coast of the Semantics, a large language ocean. A small river named Duden flows by their place and supplies it with the necessary regelialia.

It is a paradisematic country, in which roasted parts of sentences fly into your mouth. Even the all-powerful Pointing has no control about the blind texts it is an almost unorthge ocean.

1 Introduction

2 Method Overview

3 Materials


5 Conclusion

6 References




This is a dummy text. Far far away, behind the word mountains, far from the countries Vokalia and Consonantia, there live the blind texts. Sepa-rated they live in Bookmarksgrove right at the coast of the Semantics, a large language ocean. A small river named Duden flows by their place and supplies it with the necessary regelialia. It is a paradisematic coun-try, in which roasted parts of sentences fly into your mouth. Even the all-powerful Pointing has no control about the blind texts it is an almost unorthographic life One day however a small line of blind text by the name of Lorem Ipsum decided to leave for the far World of Grammar.

Partners:

Fig. 1. This is a dummy text. Far far away, behind the word mountains, far from the countries Vokalia and Consonantia, there live the blind texts. Separated they live in Bookmarksgrove right at the coast of the Semantics, a larg language ocean.



This is a dummy text. Far far away, behind the word mountains, far from the countries Vokalia and Consonantia, there live the blind texts.

Separated they live in Bookmarksgrove right at the coast of the Seman-tics, a large language ocean. – This is a dummy text. Far far away, behind the word mountains, far

from the countries Vokalia and Consonantia, there live the blind. – Separated they live in Bookmarksgrove right at the coast of the– Semantics, a large language ocean. A small river named Duden

flows by their place and supplies it with the necessary regelialia. disematic country, in which roasted parts of sentences fly

1. This is a dummy text. Far far away, behind the word mountains, far from the countries Vokalia and Consonantia, there live the blind texts.

2. Separated they live in Bookmarksgrove right at the coast of the Semantics, a large language ocean. 3. A small river named Duden flows by their place and supplies it with the necessary regelialia. 4. It is a paradisematic country, in which roasted parts of sentences fly into your mouth.

table title left 511 334 3727 69 8 124 1191 218

table title left 64 65 41 14 22 45 73 415

table title left 51 5 1 32 22 45 73 182

table title left 38 6 1 9 5 45 73 63

table title left 23 4 3 4 6 45 20 45




1 Introduction

2 Method Overview

3 Materials


5 Conclusion

6 References





Partners:










table title left 511 334 3727 69 8 124 1191 218

table title left 64 65 41 14 22 45 73 415

table title left 51 5 1 32 22 45 73 182

table title left 38 6 1 9 5 45 73 63

table title left 23 4 3 4 6 45 20 45




1 Introduction

2 Method Overview

3 Materials


5 Conclusion

6 References





Partners:










table title left 511 334 3727 69 8 124 1191 218

table title left 64 65 41 14 22 45 73 415

table title left 51 5 1 32 22 45 73 182

table title left 38 6 1 9 5 45 73 63

table title left 23 4 3 4 6 45 20 45




1 Introduction

2 Method Overview

3 Materials


5 Conclusion

6 References





Partners:










table title left 511 334 3727 69 8 124 1191 218

table title left 64 65 41 14 22 45 73 415

table title left 51 5 1 32 22 45 73 182

table title left 38 6 1 9 5 45 73 63

table title left 23 4 3 4 6 45 20 45




1 Introduction

2 Method Overview

3 Materials


5 Conclusion

6 References





Partners:










table title left 511 334 3727 69 8 124 1191 218

table title left 64 65 41 14 22 45 73 415

table title left 51 5 1 32 22 45 73 182

table title left 38 6 1 9 5 45 73 63

table title left 23 4 3 4 6 45 20 45




1 Introduction

2 Method Overview

3 Materials


5 Conclusion

6 References





Partners:










table title left 511 334 3727 69 8 124 1191 218

table title left 64 65 41 14 22 45 73 415

table title left 51 5 1 32 22 45 73 182

table title left 38 6 1 9 5 45 73 63

table title left 23 4 3 4 6 45 20 45




1 Introduction

2 Method Overview

3 Materials


5 Conclusion

6 References





Partners:










table title left 511 334 3727 69 8 124 1191 218

table title left 64 65 41 14 22 45 73 415

table title left 51 5 1 32 22 45 73 182

table title left 38 6 1 9 5 45 73 63

table title left 23 4 3 4 6 45 20 45



1 Introduction

2 Method Overview

3 Materials


5 Conclusion

6 References






Partners:









table title left 511 334 3727 69 8 124 1191 218

table title left 64 65 41 14 22 45 73 415

table title left 51 5 1 32 22 45 73 182

table title left 38 6 1 9 5 45 73 63

table title left 23 4 3 4 6 45 20 45




1 Introduction

2 Method Overview

3 Materials


5 Conclusion

6 References






Partners:









table title left 511 334 3727 69 8 124 1191 218

table title left 64 65 41 14 22 45 73 415

table title left 51 5 1 32 22 45 73 182

table title left 38 6 1 9 5 45 73 63

table title left 23 4 3 4 6 45 20 45




1 Introduction

2 Method Overview

3 Materials


5 Conclusion

6 References






Partners:









table title left 511 334 3727 69 8 124 1191 218

table title left 64 65 41 14 22 45 73 415

table title left 51 5 1 32 22 45 73 182

table title left 38 6 1 9 5 45 73 63

table title left 23 4 3 4 6 45 20 45




1 Introduction

2 Method Overview

3 Materials


5 Conclusion

6 References






Partners:









table title left 511 334 3727 69 8 124 1191 218

table title left 64 65 41 14 22 45 73 415

table title left 51 5 1 32 22 45 73 182

table title left 38 6 1 9 5 45 73 63

table title left 23 4 3 4 6 45 20 45




1 Introduction

2 Method Overview

3 Materials


5 Conclusion

6 References






Partners:









table title left 511 334 3727 69 8 124 1191 218

table title left 64 65 41 14 22 45 73 415

table title left 51 5 1 32 22 45 73 182

table title left 38 6 1 9 5 45 73 63

table title left 23 4 3 4 6 45 20 45




1 Introduction

2 Method Overview

3 Materials


5 Conclusion

6 References






Partners:









table title left 511 334 3727 69 8 124 1191 218

table title left 64 65 41 14 22 45 73 415

table title left 51 5 1 32 22 45 73 182

table title left 38 6 1 9 5 45 73 63

table title left 23 4 3 4 6 45 20 45




1 Introduction

2 Method Overview

3 Materials


5 Conclusion

6 References






Partners:









table title left 511 334 3727 69 8 124 1191 218

table title left 64 65 41 14 22 45 73 415

table title left 51 5 1 32 22 45 73 182

table title left 38 6 1 9 5 45 73 63

table title left 23 4 3 4 6 45 20 45





1 Introduction

2 Method Overview

3 Materials


5 Conclusion

6 References





Partners:










table title left 511 334 3727 69 8 124 1191 218

table title left 64 65 41 14 22 45 73 415

table title left 51 5 1 32 22 45 73 182

table title left 38 6 1 9 5 45 73 63

table title left 23 4 3 4 6 45 20 45




1 Introduction

2 Method Overview

3 Materials


5 Conclusion

6 References





Partners:










table title left 511 334 3727 69 8 124 1191 218

table title left 64 65 41 14 22 45 73 415

table title left 51 5 1 32 22 45 73 182

table title left 38 6 1 9 5 45 73 63

table title left 23 4 3 4 6 45 20 45




1 Introduction

2 Method Overview

3 Materials


5 Conclusion

6 References





Partners:










table title left 511 334 3727 69 8 124 1191 218

table title left 64 65 41 14 22 45 73 415

table title left 51 5 1 32 22 45 73 182

table title left 38 6 1 9 5 45 73 63

table title left 23 4 3 4 6 45 20 45




1 Introduction

2 Method Overview

3 Materials


5 Conclusion

6 References





Partners:










table title left 511 334 3727 69 8 124 1191 218

table title left 64 65 41 14 22 45 73 415

table title left 51 5 1 32 22 45 73 182

table title left 38 6 1 9 5 45 73 63

table title left 23 4 3 4 6 45 20 45




1 Introduction

2 Method Overview

3 Materials


5 Conclusion

6 References





Partners:










table title left 511 334 3727 69 8 124 1191 218

table title left 64 65 41 14 22 45 73 415

table title left 51 5 1 32 22 45 73 182

table title left 38 6 1 9 5 45 73 63

table title left 23 4 3 4 6 45 20 45




1 Introduction

2 Method Overview

3 Materials


5 Conclusion

6 References





Partners:










table title left 511 334 3727 69 8 124 1191 218

table title left 64 65 41 14 22 45 73 415

table title left 51 5 1 32 22 45 73 182

table title left 38 6 1 9 5 45 73 63

table title left 23 4 3 4 6 45 20 45

Screenshots of our application running on a Google Glass are shown below. Each pixel in the image gets classified separately as one of the signs or noise and gets colored accordingly. The left hand side shows the RGB camera input and the pixel-wise classification results overlaid, while the right hand side shows the current probability distribution over all classes. The last screenshot shows how noise pixels are recognized.

To also quantitatively test the classification forest, we used a test set consisting of 2300 images per gesture. Our method classified over 95% of the images correctly.

Built on top of our recognition pipeline, we present a solfège teaching app. The application shows a sheet of music, and the user has to practice the hand signs that reproduce that piece of music. The application recognizes the gestures and gives audio and visual feedback.

1 Abstract

2 Introduction

3 Method overview

4 Training

6 References

Solfège hand sign recognitionwith a wearable camera

Gábor Sörös, Julia Giger, Jie Song

Institute for Pervasive Computing, ETH Zurich

We present a fast and robust method for recognizing solfège hand signs with smart glasses in egocentric perspective. Our method achieves above 95% classification rate and close to real time performance running on an unmodified Google Glass device.

A widely used approach in music education is sight singing, where differ-ent hand signs are associated with different tones. Solmization is the system of assigning different syllables to each tone in a musical scale, and solfège is one form of solmization practiced in Europe and most English-speaking countries.

Solfège is based on the seven syllables do, re, mi, fa, so, la, ti. The asso-ciated gesture set is well defined since the XIX. century and contains a small number of gestures only, but is challenging enough to make heuris-tic recognition approaches fail.

www.pc.inf.ethz.ch

Pixel-wise labeling of binary hand silhouette images with a randomized decision forest, similar to the method described in [1]. Advantages: very fast, only RGB camera, can be parallelized on GPU, robust to segmen-tation errors, can be extended to depth regression [2].

[1] Jie Song, Gábor Sörös, Fabrizio Pece, Sean Fanello, Shahram Izadi, Cem Keskin, Otmar Hilliges: In-air Gestures Around Unmodified Mobile Devices. Proceedings of the 27th ACM User Interface Software and Technology Symposium (UIST 2014), Honolulu, Hawaii, 2014

[2] Jie Song, Fabrizio Pece, Gábor Sörös, Marion Koelle, Otmar Hilliges: Joint Estimation of 3D Hand Position and Gestures from Monocular Video for Mobile Interaction. Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems (CHI 2015), Seoul, South Korea, 2015

[3] Gábor Sörös, Julia Giger, Jie Song: Solfège hand sign recognition with a wearable camera. Proceedings of the First International Workshop on Egocentric Perception, Interaction, and Computing (EPIC 2016), Amsterdam, the Netherlands, 2016

[a] drawing adapted from www.classicsforkids.com[b] drawing adapted from Wikimedia Commons[c] photo from www.icscamp2016.blogspot.ch

do re fa so la timi [a]

5 Results

Pooling over all trees:this pixel is red

Pooling over all pixels:this gesture is red

do re mi fa so la ti

The egocentric perspective of smartglasses is advantageous for learningand practicing these hand gestures.

[b]

[c]

We asked six persons to perform the gestures under natural variation and recorded short sequences of each. In total, we recorded 3700 images per gesture covering enough variation in rotation, depth and appearance. The training set also included a no gesture hand class where participants casually moved their hands in front of the camera. Additionally, binary noise samples are added to the clean labeled images with a noise label prior to training.

input RGB image segmented binary image synthetic training image background noise

...

Instructions:– You find the layout versions in the layers window

– A two-column layout and a three-column layout in ETH colors 3–9 are provided

– The template is based on a A3 fomat but can also be printed out as A1 or A0

– For a landscape layout, please use the template “eth_scientific_poster_landscape.ai”

– For logos placed on a colored background, please use the negative version for better visibility

– Logo placement:Logos Partner Universities

Logos Organisational units

Logos Sponsoring Partners

title for the poster, as brief and concise solfège hand ... · this is a dummy text. far far away,...

Documents