Julie A. Jacko (Ed.)

Human-Computer Interaction

HCl Intelligent Multimodal Interaction Environments

12th International Conference, HCl International 2007 Beijing, China, July 22-27, 2007 Proceedings, Part III

Springer

Table of Contents

Part I: Multimodality and Conversational Dialogue

Preferences and Patterns of Paralinguistic Voice Input to Interactive Media 3

Sama'a AI Hashimi

" Show and Teil": Using Semantically Processable Prosodic Markers for Spatial Expressions in an HCl System for Consumer Complaints 13

Christina Alexandris

Exploiting Speech-Gesture Correlation in Multimodal Interaction 23 Fang Chen, Eric H.C. Choi, and Ning Wang

Pictogram Retrieval Based on Collective Semantics 31 Heeryon Cho, Toru Ishida, Rieko Inaba, Toshiyuki Takasaki, and Yumiko Mori

Enrich Web Applications with Voice Internet Persona Text-to-Speech for Anyone, Anywhere 40

Min Chu, Yusheng Li, Xin Zou, and Frank Soong

Using Recurrent Fuzzy Neural Networks for Predicting Word Boundaries in a Phoneme Sequence in Persian Language 50

Mohammad Reza Feizi Derakhshi and Mohammad Reza Kangavari

Subjective Measurement of Workload Related to a Multimodal Interaction Task: NASA-TLX vs. Workload Profile 60

Dominique Freard, Eric Jamet, Olivier Le Bohec, Gerard Poulain, and Valerie Botherel

Menü Selection Using Auditory Interface 70 Koichi Hirota, Yosuke Watanabe, and Yasushi Ikei

Analysis of User Interaction with Service Oriented Chatbot Systems . . . . 76 Marie-Ciaire Jenkins, Richard Churchill, Stephen Cox, and Dan Smith

Performance Analysis of Perceptual Speech Quality and Modules Design for Management over IP Network 84

Jinsul Kim, Hyun-Woo Lee, Won Ryu, Seung Ho Han, and Minsoo Hahn

A Tangible User Interface with Multimodal Feedback 94 Laehyun Kim, Hyunchul Cho, Sehyung Park, and Manchul Han

XIV Table of Contents

Minimal Parsing Key Concept Based Question Answering System 104 Sunil Kopparapu, Akhlesh Srivastava, and P.V.S. Rao

Customized Message Generation and Speech Synthesis in Response to Characteristic Behavioral Patterns of Children 114

Ho-Joon Lee and Jong C. Park

Multi-word Expression Recognition Integrated with Two-Level Finite State Transducer 124

Keunyong Lee, Ki-Soen Park, and Yong-Seok Lee

Towards Multimodal User Interfaces Composition Based on UsiXML and MBD Principles 134

Sophie Lepreux, Anas Hariri, Jose Rouillard, Dimitri Tabary, Jean-Claude Tarby, and Christophe Kolski

m-LoCoS UI: A Universal Visible Language for Global Mobile Communication 144

Aaron Marcus

Developing a Conversational Agent Using Ontologies 154 Manish Mehta and Andrea Gorradini

Conspeakuous: Contextualising Conversational Systems 165 S. Arun Nair, Amit Anil Nanavati, and Nitendra Rajput

Persuasive Effects of Embodied Conversational Agent Teams 176 Hien Nguyen, Judith Masthoff, and Pete Edwards

Exploration of Possibility of Multithreaded Conversations Using a Voice Communication System 186

Kanayo Ogura, Kazushi Nishimoto, and Kozo Sugiyama

A Toolkit for Multimodal Interface Design: An Empirical Investigation 196

Dimitrios Rigas and Mohammad Alsuraihi

An Input-Parsing Algorithm Supporting Integration of Deictic Gesture in Natural Language Interface 206

Yong Sun, Fang Chen, Yu Shi, and Vera Chung

Multimodal Interfaces for In-Vehicle Applications 216 Roman Vilimek, Thomas Hempel, and Birgit Otto

Character Agents in E-Learning Interface Using Multimodal Real-Time Interaction 225

Hua Wang, Jie Yang, Mark Chignell, and Mitsuru Ishizuka

An Empirical Study on Users' Acceptance of Speech Recognition Errors in Text-messaging 232

Shuang Xu, Santosh Basapur, Mark Ahlenius, and Deborah Matteo

Table of Contents XV

Flexible Multi-modal Interaction Technologies and User Interface Specially Designed for Chinese Car Infotainment System 243

Chen Yang, Nan Chen, Peng-fei Zhang, and Zhen Jiao

A Spoken Dialogue System Based on Keyword Spotting Technology . . . . 253 Pengyuan Zhang, Qingwei Zhao, and Yonghong Yan

Part II: Adaptive, Intelligent and Emotional User Interfaces

Dynamic Association Rules Mining to Improve Intermediation Between User Multi-channel Interactions and Interactive e-Services 265

Vincent Chevrin and Olivier Couturier

Emotionally Expressive Avatars for Chatting, Learning and Therapeutic Intervention 275

Marc Fabri, Salima Y. Awad Elzouki, and David Moore

Can Virtual Humans Be More Engaging Than Real Ones? 286 Jonathan Gratch, Ning Wang, Anna Okhmatovskaia, Francois Lamothe, Mathieu Morales, R.J. van der Werf, and Louis-Philippe Morency

Automatic Mobile Content Conversion Using Semantic Image Analysis 298

Eunjung Han, Jonyeol Yang, HwangKyu Yang, and Keechul Jung

History Based User Interest Modeling in WWW Access 308 Shuang Han, Wenguang Chen, and Heng Wang

Development of a Generic Design Framework for Intelligent Adaptive Systems 313

Ming Hou, Michelle S. Gauthier, and Simon Banbury

Three Way Relationship of Human-Robot Interaction 321 Jung-Hoon Hwang, Kang- Woo Lee, and Dong-Soo Kwon

MEMORIA: Personal Memento Service Using Intelligent Gadgets 331 Hyeju Jang, Jongho Won, and Changseok Bae

A Location-Adaptive Human-Centered Audio Email Notification Service for Multi-user Environments 340

Ralf Jung and Tim Schwartz

Emotion-Based Textile Indexing Using Neural Networks 349 Na Yeon Kim, Yunhee Shin, and Eun Yi Kim

Decision Theoretic Perspective on Optimizing Intelligent Help 358 Chulwoo Kim and Mark R. Lehto

XVI Table of Contents

Human-Aided Cleaning Algorithm for Low-Cost Robot Architecture . . . . 366 Seungyong Kim, Kiduck Kim, and Tae-Hyung Kim

The Perception of Artificial Intelligence as "Human" by Computer Users 376

Jurek Kirakowski, Patrick 0'Donneil, and Anthony Yiu

Speaker Segmentation for Intelligent Responsive Space 385 Soonil Kwon

Emotion and Sense of Telepresence: The Effects of Screen Viewpoint, Self-transcendence Style, and NPC in a 3D Game Environment 393

Jim Jiunde Lee

Emotional Interaction Through Physical Movement 401 Jong-Hoon Lee, 3in- Yung Park, and Tek-Jin Nam

Towards Affective Sensing 411 Gordon Mclntyre and Roland Göcke

Affective User Modeling for Adaptive Intelligent User Interfaces 421 Fatma Nasoz and Christine L. Lisetti

A Multidimensional Classification Model for the Interaction in Reactive Media Rooms 431

Ali A. Nazari Shirehjini

An Adaptive Web Browsing Method for Various Terminals: A Semantic Over-Viewing Method 440

Hisashi Noda, Teruya Ikegami, Yushin Tatsumi, and Shin'ichi Fukuzumi

Evaluation of P2P Information Recommendation Based on Collaborative Filtering 449

Hidehiko Okada and Makoto Inoue

Understanding the Social Relationship Between Humans and Virtual Humans 459

Sung Park and Richard Catrambone

EREC-II in Use - Studies on Usability and Suitability of a Sensor System for Affect Detection and Human Performance Monitoring 465

Christian Peter, Randolf Schultz, Jörg Voskamp, Bodo Urban, Nadine Nowack, Hubert Janik, Karin Kraft, and Roland Göcke

Development of an Adaptive Multi-agent Based Content Collection System for Digital Libraries 475

R. Ponnusamy and T. V. Gopal

Table of Contents XVII

Using Content-Based Multimedia Data Retrieval for Multimedia Content Adaptation 486

Adriana Reveiu, Marian Dardala, and Felix Furtuna

Coping with Complexity Through Adaptive Interface Design 493 Nadine Sarter

Region-Based Model of Tour Planning Applied to Interactive Tour Generation 499

Inessa Seifert

A Learning Interface Agent for User Behavior Prediction 508 Gabriela Serban, Adriana Tar\a, and Grigoreta Sofia Moldovan

Sharing Video Browsing Style by Associating Browsing Behavior with Low-Level Features of Videos 518

Akio Takashima and Yuzuru Tanaka

Adaptation in Intelligent Tutoring Systems: Development of Tutoring and Domain Models 527

Oswaldo Velez-Langs and Xiomara Argüello

Confidence Measure Based Incremental Adaptation for Online Language Identification 535

Shan Zhong, Yingna Chen, Chunyi Zhu, and Jia Liu

Study on Speech Emotion Recognition System in E-Learning 544 Aiqin Zhu and Qi Luo

Part III: Gesture and Eye Gaze Recognition

How Do Adults Solve Digital Tangram Problems? Analyzing Cognitive Strategies Through Eye Tracking Approach 555

Bahar Baran, Berrin Dogusoy, and Kursat Cagütay

Gesture Interaction for Electronic Music Performance 564 Reinhold Behringer

A New Method for Multi-finger Detection Using a Regulär Diffuser 573 Li-wei Chan, Yi-fan Chuang, Yi-wei Chia, Yi-ping Hung, and Jane Hsu

Lip Contour Extraction Using Level Set Curve Evolution with Shape Constraint 583

Jae Sik Ghang, Fun Yi Kim, and Se Hyun Park

Visual Foraging of Highlighted Text: An Eye-Tracking Study 589 Ed H. Chi, Michelle Gumbrecht, and Lichan Hong

XVIII Table of Contents

Effects of a Dual-Task Tracking on Eye Fixation Related Potentials (EFRP) 599

Hiroshi Daimoto, Tsutomu Takahashi, Kiyoshi Fujimoto, Hideaki Takahashi, Masaaki Kurosu, and Akihiro Yagi

Effect of Glance Duration on Perceived Complexity and Segmentation of User Interfaces 605

Yifei Dong, Chen hing, and Lesheng Hua

Movement-Based Interaction and Event Management in Virtual Environments with Optical Tracking Systems 615

Maxim Foursa and Gerold Wesche

Multiple People Gesture Recognition for Human-Robot Interaction 625 Seok-ju Hong, Nurul Arif Setiawan, and Chil-woo Lee

Position and Pose Computation of a Moving Camera Using Geometrie Edge Matching for Visual SLAM 634

HyoJong Jang, Gye Young Kim, and Hyungll Choi

"Shooting a Bird": Game System Using Facial Feature for the Handicapped People 642

Jinsun Ju, Yunhee Shin, and Eun Yi Kim

Human Pose Estimation Using a Mixture of Gaussians Based Image Modeling 649

Do Joon Jung, Kyung Su Kwon, and Hang Joon Kim

Human Motion Modeling Using Multivision 659 Byoung-Doo Kang, Jae-Seong Eom, Jong-Ho Kim, Chul-Soo Kim, Sang-Ho Ahn, Bum-Joo Shin, and Sang-Kyoon Kim

Real-Time Face Tracking System Using Adaptive Face Detector and Kaiman Filter 669

Jong-Ho Kim, Byoung-Doo Kang, Jae-Seong Eom, Chul-Soo Kim, Sang-Ho Ahn, Bum-Joo Shin, and Sang-Kyoon Kim

Kaiman Filtering in the Design of Eye-Gaze-Guided Computer Interfaces 679

Oleg V. Komogortsev and Javed I. Khan

Human Shape Tracking for Gait Recognition Using Active Contours with Mean Shift 690

Kyung Su Kwon, Se Hyun Park, Eun Yi Kim, and Hang Joon Kim

Robust Gaze Tracking Method for Stereoscopic Virtual Reality Systems 700

Eui Chul Lee, Kang Ryoung Park, Min Cheol Whang, and Junseok Park

Table of Contents XIX

EyeScreen: A Gesture Interface for Manipulating On-Screen Objec ts . . . . 710 Shanqing Li, Jingjun Lv, Yihua Xu, and Yunde Jia

GART: The Gesture and Activity Recognition Toolkit 718 Kent Lyons, Helene Brashear, Tracy Westeyn, Jung Soo Kim, and Thad Starner

Static and Dynamic Hand-Gesture Recognition for Augmented Reality Applications 728

Stefan Reifinger, Frank Wallhoff, Markus Ablassmeier, Tony Poitschke, and Gerhard Rigoll

Multiple People Labeling and Tracking Using Stereo for Human Computer Interaction 738

Nurul Arif Setiawan, Seok-Ju Hong, and Chil-Woo Lee

A Study of Human Vision Inspection for Mura 747 Pei-Chia Wang, Sheue-Ling Hwang, and Chao-Hua Wen

Tracing Users' Behaviors in a Multimodal Instructional Material: An Eye-Tracking Study 755

Esra Yecan, Euren Sumuer, Bahar Baran, and Kursat Cagiltay

A Study on Interactive Artwork as an Aesthetic Object Using Computer Vision System 763

Joonsung Yoon and Jaehwa Kim

Human-Computer Interaction System Based on Nose Tracking 769 Lumin Zhang, Fuqiang Zhou, Weixian Li, and Xiaoke Yang

Evaluating Eye Tracking with ISO 9241 - Part 9 779 Xuan Zhang and I. Scott MacKenzie

Impact of Mental Rotation Strategy on Absolute Direction Judgments: Supplementing Conventional Measures with Eye Movement Data 789

Ronggang Zhou and Kan Zhang

Part IV: Interactive TV and Media

Beyond Mobile TV: Understanding How Mobile Interactive Systems Enable Users to Become Digital Producers 801

Anxo Cereijo Roibds and Riccardo Sola

Media Convergence, an Introduction 811 Sepideh Chakaveh and Manfred Bogen

An Improved H.264 Error Concealment Algorithm with User Feedback Design 815

Xiaoming Chen and Yuk Ying Chung

XX Table of Contents

Classification of a Person Picture and Scenery Picture Using Structured Simplicity 821

Myoung-Bum Chung and II- Ju Ko

Designing Personalized Media Center with Focus on Ethicai Issues of Privacy and Security 829

Alma Leora Culen and Yonggong Ren

Evaluation of VISTO: A New Vector Image Search TOol 836 Tania Di Mascio, Daniele Frigioni, and Laura Tarantino

G-Tunes - Physical Interaction Design of Playing Music 846 Jia Du and Ying Li

nanOsphere: Location-Driven Fiction for Groups of Users 852 Kevin Eustice, V. Ramakrishna, Alison Walker, Matthew Schnaider, Nam Nguyen, and Peter Reiher

How Panoramic Photography Changed Multimedia Presentations in Tourism 862

Nelson Gongalves

Frame Segmentation Used MLP-Based X-Y Recursive for Mobile Cartoon Content 872

Eunjung Han, Kirak Kim, HwangKyu Yang, and Keechul Jung

Browsing and Sorting Digital Pictures Using Automatic Image Classification and Quality Analysis 882

Otmar Hilliges, Peter Kunath, Alexey Pryakhin, Andreas Butz, and Hans-Peter Kriegel

A Usability Study on Personalized EPG (pEPG) UI of Digital TV 892 Myo Ha Kim, Sang Min Ko, Jae Seung Mun, Yong Gu Ji, and Moon Ryul Jung

Recognizing Cultural Diversity in Digital Television User Interface Design 902

Joonhwan Kim and Sanghee Lee

A Study on User Satisfaction Evaluation About the Recommendation Techniques of a Personalized EPG System on Digital TV 909

Sang Min Ko, Yeon Jung Lee, Myo Ha Kim, Yong Gu Ji, and Soo Won Lee

Usability of Hybridmedia Services - PC and Mobile Applications Compared 918

Jari Laarni, Liisa Lähteenmäki, Johanna Kuosmanen, and Niklas Ravaja

Table of Contents XXI

m-YouTube Mobile UI: Video Selection Based on Social Infhience 926 Aaron Marcus and Angel Perez

Can Video Support City-Based Communities? 933 Raquel Navarro-Prieto and Nidia Berbegal

Watch, Press, and Catch - Impact of Divided Attention on Requirements of Audiovisual Quality 943

Ulrich Reiter and Satu Jumisko-Pyykkö

Media Service Mediation Supporting Resident's Collaboration in ubiTV 953

Choonsung Shin, Hyoseok Yoon, and Woontack Woo

Implementation of a New H.264 Video Watermarking Algorithm with Usability Test 963

Mohd Afizi Mohd Shukran, Yuk Ying Chung, and Xiaoming Chen

Innovative TV: From an Old Standard to a New Concept of Interactive TV - An Italian Job 971

Rossana Simeoni, Linnea Etzler, Elena Guercio, Monica Perrero, Amon Rapp, Roberto Montanari, and Francesco Tesauri

Evaluating the Effectiveness of Digital Storytelling with Panoramic Images to Facilitate Experience Sharing 981

Zuraidah Sulaiman, Nor Laila Md Noor, Narinderjit Singh, and Suet Peng Yong

User-Centered Design and Evaluation of a Concurrent Voice Communication and Media Sharing Application 990

David J. Wheatley

Customer-Dependent Storytelling Tool with Authoring and Viewing Functions 1000

Sunhee Won, Miyoung Choi, Gyeyoung Kim, and Hyungil Choi

Reliable Partner System Always Providing Users with Companionship Through Video Streaming 1010

Takumi Yamaguchi, Kazunori Shimamura, and Haruya Shiba

Modeling of Places Based on Feature Distribution 1019 Yi Hu, Chang Woo Lee, Jong Yeol Yang, and Burn Joo Shin

Knowledge Transfer in Semi-automatic Image Interpretation 1028 Jun Zhou, Li Cheng, Terry Caelli, and Walter F. Bischof

Author Index 1035