multimodal interaction r&d
DESCRIPTION
Multimodal Interaction R&D. 4 Years Dec 2003 – Dec 2007 6 M€ 32 partners + 8 fellows. Similar on the map. 32+8 institutions spread all over Europe (and one in Africa) Red : Partners Yellow : Fellows Blue : Industry. Research interests and application domains. - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Multimodal Interaction R&D](https://reader036.vdocuments.mx/reader036/viewer/2022081504/5681487e550346895db588cd/html5/thumbnails/1.jpg)
SIMILAR NoE at the HUMAINE meeting - 5/06/2007
Multimodal Interaction R&D
• 4 Years Dec 2003 – Dec 2007• 6 M€• 32 partners + 8 fellows
![Page 2: Multimodal Interaction R&D](https://reader036.vdocuments.mx/reader036/viewer/2022081504/5681487e550346895db588cd/html5/thumbnails/2.jpg)
SIMILAR NoE at the HUMAINE meeting - 5/06/2007
Similar on the map
32+8 institutions spread all over Europe
(and one in Africa)
Red : Partners
YellowYellow : Fellows
Blue : Industry
![Page 3: Multimodal Interaction R&D](https://reader036.vdocuments.mx/reader036/viewer/2022081504/5681487e550346895db588cd/html5/thumbnails/3.jpg)
SIMILAR NoE at the HUMAINE meeting - 5/06/2007
Research interests and application domains
• R&D in modalities fusion and fissionSpeech, Handwriting, Gesture, Posture, Emotions, …
• 3 Actual applications domains:– Games and Education,
– Medical imaging and robotics,
– Disabled people
• 3 Future applications domains:– Interactive arts such as music and dance
– Robotic companions,
– Cars
• Next steps: Multi-user interaction and robotics - MAGI and PERGI FP7 proposals submitted
![Page 4: Multimodal Interaction R&D](https://reader036.vdocuments.mx/reader036/viewer/2022081504/5681487e550346895db588cd/html5/thumbnails/4.jpg)
SIMILAR NoE at the HUMAINE meeting - 5/06/2007
Modalities Fusion Example
Right Hand
Left Hand
Right LegLeft Leg
Upper Body
Lower BodyBody
Gestures
Center of Gravity
Speach
Facial Emotion
Voice Emotion
MultimodalHuman
Emotion
![Page 5: Multimodal Interaction R&D](https://reader036.vdocuments.mx/reader036/viewer/2022081504/5681487e550346895db588cd/html5/thumbnails/5.jpg)
SIMILAR NoE at the HUMAINE meeting - 5/06/2007
Similar achievements– The OpenInterface open source platform
– The SIMILAR multimodal behavior interpretation theory
– The SIMILAR medical image database
– The SIMILAR facial expression recognition annotated database
– Development of migratory context-aware user interfaces, standardized UsiXML language
• Many Similar achievements will continue at the end of the project:– The third summer workshop eNTERFACE in July 2007
(after Mons and Dubrovnik, we go to Istanbul)
– The JMUI journal will be distributed by Springer
– 23 PhD exchanges in 2007
– 13 books published in the SIMILAR collection
– Over 950 scientific paper published – 5 web sites (www.similar.cc, www.openinterface.org, www.jmui.org,
www.enterface.net, www.locomummy.net).
![Page 6: Multimodal Interaction R&D](https://reader036.vdocuments.mx/reader036/viewer/2022081504/5681487e550346895db588cd/html5/thumbnails/6.jpg)
SIMILAR NoE at the HUMAINE meeting - 5/06/2007
Similar on the web
![Page 7: Multimodal Interaction R&D](https://reader036.vdocuments.mx/reader036/viewer/2022081504/5681487e550346895db588cd/html5/thumbnails/7.jpg)
SIMILAR NoE at the HUMAINE meeting - 5/06/2007
Similar on the web
![Page 8: Multimodal Interaction R&D](https://reader036.vdocuments.mx/reader036/viewer/2022081504/5681487e550346895db588cd/html5/thumbnails/8.jpg)
SIMILAR NoE at the HUMAINE meeting - 5/06/2007
Similar on the web
![Page 9: Multimodal Interaction R&D](https://reader036.vdocuments.mx/reader036/viewer/2022081504/5681487e550346895db588cd/html5/thumbnails/9.jpg)
SIMILAR NoE at the HUMAINE meeting - 5/06/2007
Similar on the web
![Page 10: Multimodal Interaction R&D](https://reader036.vdocuments.mx/reader036/viewer/2022081504/5681487e550346895db588cd/html5/thumbnails/10.jpg)
SIMILAR NoE at the HUMAINE meeting - 5/06/2007
Similar after 2007
Similar actions will continue under the official name:
OpenInterface Association a non-profit organisation under Belgian law.
Contact : [email protected]