iwall: an interactive public display - unifr.ch · 2011-08-17 · 21/10/2005 iwall: an interactive...
TRANSCRIPT
![Page 1: iWall: an Interactive Public Display - unifr.ch · 2011-08-17 · 21/10/2005 iWall: an Interactive Public Display Presentation by Isabelle Colin Project members: M. El-Betjali, O](https://reader034.vdocuments.mx/reader034/viewer/2022050413/5f89a8a69931440b442cf4b2/html5/thumbnails/1.jpg)
21/10/2005
iWall: an Interactive Public Display
Presentation by Isabelle Colin
Project members: M. El-Betjali, O. Perroud, B. Ulucinar, T. Tran Manh, I. Colin, M. Courant
Pervasive and Artificial Intelligence research groupUniversity of Fribourg
Switzerlandhttp://diuf.unifr.ch/pai
Workshop on
Mixed Reality and Computing in the Physical World
Fribourg, 21 October 2005
![Page 2: iWall: an Interactive Public Display - unifr.ch · 2011-08-17 · 21/10/2005 iWall: an Interactive Public Display Presentation by Isabelle Colin Project members: M. El-Betjali, O](https://reader034.vdocuments.mx/reader034/viewer/2022050413/5f89a8a69931440b442cf4b2/html5/thumbnails/2.jpg)
2/2921/10/2005 "iWall: an Interactive Public Display", PAI Group, University of Fribourg, Switzerland
Introduction
� What is iWall ?� A interactive public display allowing to grasp posters
(tangible interface)� Posters are “posted” to the display by authorized users � Posters are displayed adaptively and dynamically
according to content, priority, and context � Multi-user interaction using handhelds and standard
protocols
� Goals� Designing and testing new ways of interaction with public
information
![Page 3: iWall: an Interactive Public Display - unifr.ch · 2011-08-17 · 21/10/2005 iWall: an Interactive Public Display Presentation by Isabelle Colin Project members: M. El-Betjali, O](https://reader034.vdocuments.mx/reader034/viewer/2022050413/5f89a8a69931440b442cf4b2/html5/thumbnails/3.jpg)
3/2921/10/2005 "iWall: an Interactive Public Display", PAI Group, University of Fribourg, Switzerland
Introduction
� How iWall works ?
![Page 4: iWall: an Interactive Public Display - unifr.ch · 2011-08-17 · 21/10/2005 iWall: an Interactive Public Display Presentation by Isabelle Colin Project members: M. El-Betjali, O](https://reader034.vdocuments.mx/reader034/viewer/2022050413/5f89a8a69931440b442cf4b2/html5/thumbnails/4.jpg)
4/2921/10/2005 "iWall: an Interactive Public Display", PAI Group, University of Fribourg, Switzerland
Introduction
� How iWall works ?
1� 1) iWall displays posters
![Page 5: iWall: an Interactive Public Display - unifr.ch · 2011-08-17 · 21/10/2005 iWall: an Interactive Public Display Presentation by Isabelle Colin Project members: M. El-Betjali, O](https://reader034.vdocuments.mx/reader034/viewer/2022050413/5f89a8a69931440b442cf4b2/html5/thumbnails/5.jpg)
5/2921/10/2005 "iWall: an Interactive Public Display", PAI Group, University of Fribourg, Switzerland
Introduction
� How iWall works ?
1
2
� 1) iWall displays posters� 2) a user is interested in the
displayed poster
![Page 6: iWall: an Interactive Public Display - unifr.ch · 2011-08-17 · 21/10/2005 iWall: an Interactive Public Display Presentation by Isabelle Colin Project members: M. El-Betjali, O](https://reader034.vdocuments.mx/reader034/viewer/2022050413/5f89a8a69931440b442cf4b2/html5/thumbnails/6.jpg)
6/2921/10/2005 "iWall: an Interactive Public Display", PAI Group, University of Fribourg, Switzerland
Introduction
� How iWall works ?
1
2
3
� 1) iWall displays posters� 2) a user is interested in the
displayed poster� 3) iWall allows him to pick it
up
![Page 7: iWall: an Interactive Public Display - unifr.ch · 2011-08-17 · 21/10/2005 iWall: an Interactive Public Display Presentation by Isabelle Colin Project members: M. El-Betjali, O](https://reader034.vdocuments.mx/reader034/viewer/2022050413/5f89a8a69931440b442cf4b2/html5/thumbnails/7.jpg)
7/2921/10/2005 "iWall: an Interactive Public Display", PAI Group, University of Fribourg, Switzerland
Introduction
� How iWall works ?
1
2
3
4
� 1) iWall displays posters� 2) a user is interested in the
displayed poster� 3) iWall allows him to pick it
up � 4) the user chooses a
protocol: email, SMS, PDA
![Page 8: iWall: an Interactive Public Display - unifr.ch · 2011-08-17 · 21/10/2005 iWall: an Interactive Public Display Presentation by Isabelle Colin Project members: M. El-Betjali, O](https://reader034.vdocuments.mx/reader034/viewer/2022050413/5f89a8a69931440b442cf4b2/html5/thumbnails/8.jpg)
8/2921/10/2005 "iWall: an Interactive Public Display", PAI Group, University of Fribourg, Switzerland
Introduction
� How iWall works ?
1
2
3
4
5
� 2) a user is interested in the displayed poster
� 3) iWall allows him to pick it up
� 4) the user chooses a protocol: email, SMS, PDA
� 5) information is sent to the user for personal use
� 1) iWall displays posters
![Page 9: iWall: an Interactive Public Display - unifr.ch · 2011-08-17 · 21/10/2005 iWall: an Interactive Public Display Presentation by Isabelle Colin Project members: M. El-Betjali, O](https://reader034.vdocuments.mx/reader034/viewer/2022050413/5f89a8a69931440b442cf4b2/html5/thumbnails/9.jpg)
9/2921/10/2005 "iWall: an Interactive Public Display", PAI Group, University of Fribourg, Switzerland
Introduction
![Page 10: iWall: an Interactive Public Display - unifr.ch · 2011-08-17 · 21/10/2005 iWall: an Interactive Public Display Presentation by Isabelle Colin Project members: M. El-Betjali, O](https://reader034.vdocuments.mx/reader034/viewer/2022050413/5f89a8a69931440b442cf4b2/html5/thumbnails/10.jpg)
10/2921/10/2005 "iWall: an Interactive Public Display", PAI Group, University of Fribourg, Switzerland
Outline
Introduction
1. State of the art
2. Specification & architecture
3. Display manager
4. Interaction manager
5. Database manager
Conclusion
![Page 11: iWall: an Interactive Public Display - unifr.ch · 2011-08-17 · 21/10/2005 iWall: an Interactive Public Display Presentation by Isabelle Colin Project members: M. El-Betjali, O](https://reader034.vdocuments.mx/reader034/viewer/2022050413/5f89a8a69931440b442cf4b2/html5/thumbnails/11.jpg)
11/2921/10/2005 "iWall: an Interactive Public Display", PAI Group, University of Fribourg, Switzerland
Outline
Introduction
1. State of the art
2. Specification & architecture
3. Display manager
4. Interaction manager
5. Database manager
Conclusion
![Page 12: iWall: an Interactive Public Display - unifr.ch · 2011-08-17 · 21/10/2005 iWall: an Interactive Public Display Presentation by Isabelle Colin Project members: M. El-Betjali, O](https://reader034.vdocuments.mx/reader034/viewer/2022050413/5f89a8a69931440b442cf4b2/html5/thumbnails/12.jpg)
12/2921/10/2005 "iWall: an Interactive Public Display", PAI Group, University of Fribourg, Switzerland
State of the art
� iWall is a project based on 3 ideas:� display� interaction � graspable objects
![Page 13: iWall: an Interactive Public Display - unifr.ch · 2011-08-17 · 21/10/2005 iWall: an Interactive Public Display Presentation by Isabelle Colin Project members: M. El-Betjali, O](https://reader034.vdocuments.mx/reader034/viewer/2022050413/5f89a8a69931440b442cf4b2/html5/thumbnails/13.jpg)
13/2921/10/2005 "iWall: an Interactive Public Display", PAI Group, University of Fribourg, Switzerland
State of the art� Interactive desks
• DigitalDesk (Wellner, 1993)• Responsive Workbench (Krueger & Froehlich, 1994)• InteractiveDESK (Arai, Machii, Kuzunuki, Shojima, 1995)• Hi-space (HITlab & Battelle, 2004)• etc
� Public displays• SmartBoards• AMBIENTE, Roomware, etc (Streitz, Fraunhofer IPSI, De)• EnhancedWall (Sato, Koike, Naganishi, Tokyo)• WebWall (Ferscha, Linz, Austria)• Dynamo-wall (Nottingham & Sussex, UK)• etc
� Context-aware displays• Digital Aura (Ferscha, Linz, Austria)• etc
![Page 14: iWall: an Interactive Public Display - unifr.ch · 2011-08-17 · 21/10/2005 iWall: an Interactive Public Display Presentation by Isabelle Colin Project members: M. El-Betjali, O](https://reader034.vdocuments.mx/reader034/viewer/2022050413/5f89a8a69931440b442cf4b2/html5/thumbnails/14.jpg)
14/2921/10/2005 "iWall: an Interactive Public Display", PAI Group, University of Fribourg, Switzerland
Outline
Introduction
1. State of the art
2. Specification & architecture
3. Display manager
4. Interaction manager
5. Database manager
Conclusion
![Page 15: iWall: an Interactive Public Display - unifr.ch · 2011-08-17 · 21/10/2005 iWall: an Interactive Public Display Presentation by Isabelle Colin Project members: M. El-Betjali, O](https://reader034.vdocuments.mx/reader034/viewer/2022050413/5f89a8a69931440b442cf4b2/html5/thumbnails/15.jpg)
15/2921/10/2005 "iWall: an Interactive Public Display", PAI Group, University of Fribourg, Switzerland
Specification & architecture
� iWall specification:� information is projected on a touch screen using a
beamer� 4 persons can simultaneously interact with it� information is posted by authorized user using a
database� unlimited number of queued posters are
displayed onto a finished space
![Page 16: iWall: an Interactive Public Display - unifr.ch · 2011-08-17 · 21/10/2005 iWall: an Interactive Public Display Presentation by Isabelle Colin Project members: M. El-Betjali, O](https://reader034.vdocuments.mx/reader034/viewer/2022050413/5f89a8a69931440b442cf4b2/html5/thumbnails/16.jpg)
16/2921/10/2005 "iWall: an Interactive Public Display", PAI Group, University of Fribourg, Switzerland
Specification & architecture
� A modular architecture: 3 modules� display manager: autonomous agent managing the
space available to optimize the displaying of information according to some constraints
� interaction manager: allows the simultaneous interaction of several users with the iWall
� database manager: agent allowing storage, addition, suppression or update of data to be displayed on the iWall
![Page 17: iWall: an Interactive Public Display - unifr.ch · 2011-08-17 · 21/10/2005 iWall: an Interactive Public Display Presentation by Isabelle Colin Project members: M. El-Betjali, O](https://reader034.vdocuments.mx/reader034/viewer/2022050413/5f89a8a69931440b442cf4b2/html5/thumbnails/17.jpg)
17/2921/10/2005 "iWall: an Interactive Public Display", PAI Group, University of Fribourg, Switzerland
Outline
Introduction
1. State of the art
2. Specification & architecture
3. Display manager
4. Interaction manager
5. Database manager
Conclusion
![Page 18: iWall: an Interactive Public Display - unifr.ch · 2011-08-17 · 21/10/2005 iWall: an Interactive Public Display Presentation by Isabelle Colin Project members: M. El-Betjali, O](https://reader034.vdocuments.mx/reader034/viewer/2022050413/5f89a8a69931440b442cf4b2/html5/thumbnails/18.jpg)
18/2921/10/2005 "iWall: an Interactive Public Display", PAI Group, University of Fribourg, Switzerland
Display manager� Objectives:
� display some objects in a predefined space according to their constraints
� 2 kinds of objects:� 1) publication object (poster)� 2) interaction object (reserved to interaction with users)
![Page 19: iWall: an Interactive Public Display - unifr.ch · 2011-08-17 · 21/10/2005 iWall: an Interactive Public Display Presentation by Isabelle Colin Project members: M. El-Betjali, O](https://reader034.vdocuments.mx/reader034/viewer/2022050413/5f89a8a69931440b442cf4b2/html5/thumbnails/19.jpg)
19/2921/10/2005 "iWall: an Interactive Public Display", PAI Group, University of Fribourg, Switzerland
Display manager
� Composed by 3 different components:� 1st component: communication with the interaction
manager� 2nd component: communication with the database
manager� 3rd component: management of the display: is
composed by 2 modules:• 1st module: queue manager• 2nd module: display posters
![Page 20: iWall: an Interactive Public Display - unifr.ch · 2011-08-17 · 21/10/2005 iWall: an Interactive Public Display Presentation by Isabelle Colin Project members: M. El-Betjali, O](https://reader034.vdocuments.mx/reader034/viewer/2022050413/5f89a8a69931440b442cf4b2/html5/thumbnails/20.jpg)
20/2921/10/2005 "iWall: an Interactive Public Display", PAI Group, University of Fribourg, Switzerland
Display manager� Poster positioning using poster
constraints:� width� height� padding� dominant color (neighbor
posters must have distinct dominant colors )
� theme: preferred display area
� priority (from 1 to 9)� context of display (time, …)� validity period
![Page 21: iWall: an Interactive Public Display - unifr.ch · 2011-08-17 · 21/10/2005 iWall: an Interactive Public Display Presentation by Isabelle Colin Project members: M. El-Betjali, O](https://reader034.vdocuments.mx/reader034/viewer/2022050413/5f89a8a69931440b442cf4b2/html5/thumbnails/21.jpg)
21/2921/10/2005 "iWall: an Interactive Public Display", PAI Group, University of Fribourg, Switzerland
Outline
Introduction
1. State of the art
2. Specification & architecture
3. Display manager
4. Interaction manager
5. Database manager
Conclusion
![Page 22: iWall: an Interactive Public Display - unifr.ch · 2011-08-17 · 21/10/2005 iWall: an Interactive Public Display Presentation by Isabelle Colin Project members: M. El-Betjali, O](https://reader034.vdocuments.mx/reader034/viewer/2022050413/5f89a8a69931440b442cf4b2/html5/thumbnails/22.jpg)
22/2921/10/2005 "iWall: an Interactive Public Display", PAI Group, University of Fribourg, Switzerland
Interaction manager
� Objective:� allows interaction between iWall and human
� 2 possibilities to access information� passive mode: direct (visual) access to information
displayed on the iWall� active mode:
• selection by pointing using touch screen• sending by SMS, PDA/Bluetooth or email protocols
![Page 23: iWall: an Interactive Public Display - unifr.ch · 2011-08-17 · 21/10/2005 iWall: an Interactive Public Display Presentation by Isabelle Colin Project members: M. El-Betjali, O](https://reader034.vdocuments.mx/reader034/viewer/2022050413/5f89a8a69931440b442cf4b2/html5/thumbnails/23.jpg)
23/2921/10/2005 "iWall: an Interactive Public Display", PAI Group, University of Fribourg, Switzerland
Interaction manager� How the interaction manager works ?
� each poster has an observer� when the poster is selected by a user, this
observer creates a dedicated interaction window� this window proposes several options
� Protocols of transfer� SMS: a light text (summary of the poster) is sent� Email: a pdf file is attached� PDA: small pdf file is sent via Bluetooth
� Security : currently, iWall doesn’t store personal information (email address, telephone number and so on)
![Page 24: iWall: an Interactive Public Display - unifr.ch · 2011-08-17 · 21/10/2005 iWall: an Interactive Public Display Presentation by Isabelle Colin Project members: M. El-Betjali, O](https://reader034.vdocuments.mx/reader034/viewer/2022050413/5f89a8a69931440b442cf4b2/html5/thumbnails/24.jpg)
24/2921/10/2005 "iWall: an Interactive Public Display", PAI Group, University of Fribourg, Switzerland
Interaction manager
menuMensa
menuMensamenuMensamenuMensa
![Page 25: iWall: an Interactive Public Display - unifr.ch · 2011-08-17 · 21/10/2005 iWall: an Interactive Public Display Presentation by Isabelle Colin Project members: M. El-Betjali, O](https://reader034.vdocuments.mx/reader034/viewer/2022050413/5f89a8a69931440b442cf4b2/html5/thumbnails/25.jpg)
25/2921/10/2005 "iWall: an Interactive Public Display", PAI Group, University of Fribourg, Switzerland
Outline
Introduction
1. State of the art
2. Specification & architecture
3. Display manager
4. Interaction manager
5. Database manager
Conclusion
![Page 26: iWall: an Interactive Public Display - unifr.ch · 2011-08-17 · 21/10/2005 iWall: an Interactive Public Display Presentation by Isabelle Colin Project members: M. El-Betjali, O](https://reader034.vdocuments.mx/reader034/viewer/2022050413/5f89a8a69931440b442cf4b2/html5/thumbnails/26.jpg)
26/2921/10/2005 "iWall: an Interactive Public Display", PAI Group, University of Fribourg, Switzerland
Database manager
� Objective:� manages the objects
displayed on the iWall� simple interface to
administrate the database
� Architecture� database � interface to administrate� server
![Page 27: iWall: an Interactive Public Display - unifr.ch · 2011-08-17 · 21/10/2005 iWall: an Interactive Public Display Presentation by Isabelle Colin Project members: M. El-Betjali, O](https://reader034.vdocuments.mx/reader034/viewer/2022050413/5f89a8a69931440b442cf4b2/html5/thumbnails/27.jpg)
27/2921/10/2005 "iWall: an Interactive Public Display", PAI Group, University of Fribourg, Switzerland
Database manager
� Database manager implementation:� Web interface: PHP language� MySQL database:
• store objects• model the data structure• manage user of the Web site
� Apache server• publication of the Web site and the SQL database
via Internet
![Page 28: iWall: an Interactive Public Display - unifr.ch · 2011-08-17 · 21/10/2005 iWall: an Interactive Public Display Presentation by Isabelle Colin Project members: M. El-Betjali, O](https://reader034.vdocuments.mx/reader034/viewer/2022050413/5f89a8a69931440b442cf4b2/html5/thumbnails/28.jpg)
28/2921/10/2005 "iWall: an Interactive Public Display", PAI Group, University of Fribourg, Switzerland
Conclusion
� Summary� A basic interactive public display allowing to pick up
information on the fly� Multi-user, several interaction protocols� Dynamic display using (primary) context, poster
theme dependent positioning with fixed algorithm
![Page 29: iWall: an Interactive Public Display - unifr.ch · 2011-08-17 · 21/10/2005 iWall: an Interactive Public Display Presentation by Isabelle Colin Project members: M. El-Betjali, O](https://reader034.vdocuments.mx/reader034/viewer/2022050413/5f89a8a69931440b442cf4b2/html5/thumbnails/29.jpg)
29/2921/10/2005 "iWall: an Interactive Public Display", PAI Group, University of Fribourg, Switzerland
Conclusion
� Future work� Multimodal interaction: voice, gesture, gaze…� Context-awareness: context-based architecture for
adaptation to environment and personal needs� Integration of dynamic objects (videos, dynamic
outputs of applications,…)� Object zooming and unfolding� Visualization algorithm: improvement towards a true
self-organizing system (with resizing of posters… )