experience montage in the virtual space

Experience Montage in the virtual space

Kai-Tzu Lu & Teng-Wen Chang CAADRIA2005

Graduate Institute of Architecture,

National Chiao Tung University, Taiwan.

Graduate School of Computational Design,

National Yunlin University of Science and Technology, Taiwan.

I n t r o d u c t i o n O b j e c t i v e R e v i e w E x p e r i e n c e M o n t a g e C o n c l u s i o n

Mental Experience is a Black Box

Experience Montage

B l a c k

Experience of Outcome--Signal

• Two Senses: Touch and Sight.

• The signals: Tangible and visual signals.

• Actions: Operating signals with digital form

I n t r o d u c t i o n O b j e c t i v e R e v i e w E x p e r i e n c e M o n t a g e C o n c l u s i o nExperience Montage

About Montage

• Montage comprehends the differences between image space means and the physical spatial experience through the visual concepts.

• The method of Montage is an expression of dynamic collage.

• It provides virtual spatial experiences in the physical environment.

• Montage makes the fuzziness crossing physical and virtual space experiences.

I n t r o d u c t i o n O b j e c t i v e R e v i e w E x p e r i e n c e M o n t a g e C o n c l u s i o nExperience Montage

Experience Montage in the Virtual Space

• Experience Montage describes the characteristics of spatial experiences switching between virtual and physical space through the theory of Montage.

• The action of Montage in the architectural terminology is combination and construction.

• Finding the phenomenon of the 3D interactive behaviorsin the virtual space.

I n t r o d u c t i o n O b j e c t i v e R e v i e w E x p e r i e n c e M o n t a g e C o n c l u s i o nExperience Montage

Searching for Experience Montage

• Finding the characteristics of montage via its operational method of collage: virtual continuity and dynamic interaction.

• Through P2P space, 3D Museum, Critic room to understand the differences causing by image space meaning to the physical space experiences.

• Using the four elements in the Exploration model further: representation, rules, memory, policy to explain the situation of experience montage

I n t r o d u c t i o n O b j e c t i v e R e v i e w E x p e r i e n c e M o n t a g e C o n c l u s i o nExperience Montage

Pilot Studies

• P2P Space: Distributed Visualization feedback.

• 3D Museum: discrete continuity.

• Critic Room: Composition.

I n t r o d u c t i o n O b j e c t i v e R e v i e w E x p e r i e n c e M o n t a g e C o n c l u s i o nExperience Montage

12

12

P2P Space : Distributed Visualization Feedback

• Visualizing distributed spaces with navigation feedbacks

• Transmit data and share circumstances .

• Utilizing “gate”metaphor for connecting among virtual spaces.

P2P space

Kalay, YE: 2004, Virtual Learning Environments, ITconJournal, 9 (ICT Supported Learning in Architecture and Civil Engineering): 195-207.

Kalay, YE: 2004, Virtual Learning Environments, ITconJournal, 9 (ICT Supported Learning in Architecture and Civil Engineering): 195-207.

I n t r o d u c t i o n O b j e c t i v e R e v i e w E x p e r i e n c e M o n t a g e C o n c l u s i o nExperience Montage

12

12

3D museum : Discrete continuity

• Interaction in this space is merely navigation.

• The interaction with discrete continuity between the 3D virtual environment and 2D layers of “interfaces”.

• Adapting the ”spatial metaphors”and “visual components”to describe the navigation behaviours.

3D Museum

Chang, T-W and Lai, I-C: 2003, Navigation in 3D Information Landscape-A 3D Museum for Civic Buildings

Ishida, T: 2002, Digital City Kyoto:Social Information Infrastructure for Everyday Life

I n t r o d u c t i o n O b j e c t i v e R e v i e w E x p e r i e n c e M o n t a g e C o n c l u s i o nExperience Montage

12

12

Critic Room : Composition

• Examining the online critic behaviours for spatial experience exchange

• Developing the Dynamic Interactive Spatial Experiencewith networked spaces.

• Composing discrete virtual objects crossing different virtual spaces.

Critic room

Active Worlds 3.6,Copyright©1995-2005 Activeworlds Inc.

Http://www.activeworlds.com

Mogensen, P and Gronbak, K: 2000, Hypermedia in the Virtual Project Room - Toward Open 3D Spatial Hypermedia, in, eleventh ACM on Hypertext and hypermedia, Texas, United States, pp: 113 - 122.

I n t r o d u c t i o n O b j e c t i v e R e v i e w E x p e r i e n c e M o n t a g e C o n c l u s i o nExperience Montage

Components of Experience Montage

• Experience montage shares several common aspects from montage, experience and collage.

• Two Components of experience Montage are browsing andtransform that contains four metaphors: sliding, catching, atlas and composition.

I n t r o d u c t i o n O b j e c t i v e R e v i e w E x p e r i e n c e M o n t a g e C o n c l u s i o nExperience Montage

Metaphors of Experience Montage• Browsing

– Sliding The process of the browsing and crossing among several virtual space.

– Catching which can download various forms of data crossing among the virtual space in browsing.

• Transform

– Atlas It can manage the data collected.

– Composition It can construct the data after arrangement.

Browsing

I n t r o d u c t i o n O b j e c t i v e R e v i e w E x p e r i e n c e M o n t a g e C o n c l u s i o nExperience Montage

Sliding Catching

Metaphors of Experience Montage

Transform

• Browsing

– Sliding The process of the browsing and crossing among several virtual space.

– Catching which can download various forms of data crossing among the virtual space in browsing.

• Transform

– Atlas It can manage the data collected.

– Composition It can construct the data after arrangement.

Atlas Catching

I n t r o d u c t i o n O b j e c t i v e R e v i e w E x p e r i e n c e M o n t a g e C o n c l u s i o nExperience Montage

Modeling experience using exploration model

• Searching for computational possibility of experience montage

• Closer metaphor for montage in spatial experience is exploration

• Exploration model (representation + rules + memory + policy = search exploration)

* Woodbury, R: 1996. Exploring Large Spaces of Building Design., ARC (Australia Research Concil) large grant proposal.

I n t r o d u c t i o n O b j e c t i v e R e v i e w E x p e r i e n c e M o n t a g e C o n c l u s i o nExperience Montage

Exploration Model

• Representation comes from the field of design and formalsymbolic language for representing design

• Rules are designed as the operational basis over the representation.

• Memory infers the possibility of the design in the space through the rules.

• Policy is to search and set the principles for guiding the design.

I n t r o d u c t i o n O b j e c t i v e R e v i e w E x p e r i e n c e M o n t a g e C o n c l u s i o nExperience Montage

* Woodbury, R: 1996. Exploring Large Spaces of Building Design., ARC (Australia Research Concil) large grant proposal.

The Mapping

• Representation: Distributed virtual world and crossing the virtual space with different places remotely;

• Rules: the way of Connection, relating to the virtual space connection ways in different ends;

• Memory: Inspiration recoding, use the browsing carelessly to record the selection of the memory;

• Policy: Composition principles create personal interface according to your preferences in design to give variety of browsing experiences.

I n t r o d u c t i o n O b j e c t i v e R e v i e w E x p e r i e n c e M o n t a g e C o n c l u s i o nExperience Montage

* Woodbury, R: 1996. Exploring Large Spaces of Building Design., ARC (Australia Research Concil) large grant proposal.

Integrating Experience Montage• Representation

– Communication between human to human and human to machines

– Visual information components.– 3D Virtual environments and 2D/3D interfaces– Avatars interactive.

• rules– Peer to Peer of the network structure applies the type of the

connecting network and each nodes offer the service of transformation.

– The Client/Server existed in the same IP address at the same time.

• memory– Record the short-term memory which is selected by browsing

several virtual space, and make the memory becoming a series connection of carriage memory.

– Transform the memory into personal experience and make them becoming carriage memory, principles and concepts.

– The visual feedback memory created by text, image, pictures and models.

• policy– Freedom navigation behaviours in the virtual space.– Virtual avatars users.– When virtual space exchange keeping

communication/information sharing.

I n t r o d u c t i o n O b j e c t i v e R e v i e w E x p e r i e n c e M o n t a g e C o n c l u s i o nExperience Montage

A System Framework for capturing Experience montage

I n t r o d u c t i o n O b j e c t i v e R e v i e w E x p e r i e n c e M o n t a g e C o n c l u s i o nExperience Montage

DemonstrationExperience montage

I n t r o d u c t i o n O b j e c t i v e R e v i e w E x p e r i e n c e M o n t a g e C o n c l u s i o nExperience Montage

Future work

• Generate the digital from from the experience.

• The media of connection virtual and physical world that can get the same experience montage phenomenon.

• Information share by the environment.

I n t r o d u c t i o n O b j e c t i v e R e v i e w E x p e r i e n c e M o n t a g e C o n c l u s i o nExperience Montage

Thanks your attend the presentationExperience Montage in the virtual space

Kai-Tzu Lu & Teng-Wen Chang CAADRIA2005

Graduate Institute of Architecture,

National Chiao Tung University, Taiwan.

Graduate School of Computational Design,

National Yunlin University of Science and Technology, Taiwan.