design as if your life depended on it! pioneering the future of experiential media

@Simiosys [email protected] Copyright © 2014

Design as if your life depended upon it!

Questions: #eXMedia @Simiosys

Christopher Stapleton!Creative Venture Catalyst Simiosys Real World Collaboratory

@Simiosys #eXMedia

ChristopherStapleton

Pioneering the Future of Experiential Media

mailto:[email protected]



Questions: #eXMedia @SimiosysChristopher Stapleton






What do I do?…Take Creative Leaps: Make Memories

1991 1995 20022001

2003 2008 2013 2014Converging media, technology, disciplines, culture, industries

across the “Virtuality Continuum”…





Film & Television

Interactive Computer GraphicsBroadwayTheater

Conventions & Conferences

1980’sFrom Presentation to Participation…





Resorts & Cruises

Food & Merchandise

Rides & Shows

Arcades & Playgrounds

1990’sFrom Presentation to Participation…





Can Media Be Experiential?

Reality

Virtuality

: Experience

: ImagineExperiencing!Media

Experiential!Media





IMAGINALITY: Dreams Memories Visions Hallucination Delusions

REALITY: All

Senses Directions

Dimensions Realities

VIRTUALITY (Cyberspace): A consensual hallucination experienced daily by billions of legitimate operators, in every nation… William Gibson

VIRTUALITY CONTINUUM

Can Media Be Experiential? Melting Boundaries…





HeartH

ead

Hands VIRTUAL

IMAGINEDREAL

STORYPLAY

GAMECan Media Be Experiential? Heads, Hands & Hearts..





Heart

Head

Han

ds

VIRTUAL

IMAGINEDREAL

STORYPLAY

GAME

ProcedureParticipatory

Pathos

Experiential Media Conventions

Can Media Be Experiential? Story, Play and Game…





IR

V

Book

VI R

Film

VI R

Game

IR VReal Virtual Imagined

Park

VI

R

Can Media Be Experiential? Mixing Realities…

Story Flow Game Flow Play Flow

3 Realities2 RealitiesExperiencing Media vs Experiential Media





Passive: Absorb

Engaging: Think/feel

Active: Participate

Reactive: Choose

Experiential: Lives

Interactive: Contribute

Can Media Be Experiential? User Experience (UX)

Experiencing Media vs Experiential Media3 Realities2 Realities





3 Dimensions5 Senses

360˚ Field of View2 Dimensions2 Senses

10˚-30˚ Field of View

Senses!Visual Audio

Dimensional FOV!Focal Stereo

Haptic Olfactory

Gastronomic Wonder

Peripheral Tangential

Creepy

Can Media Be Experiential? Sensory Perception…

Experiencing Media vs Experiential Media3 Realities2 Realities





Real World Lab: Technological playground of ideas & dreams !Experiential Make-Overs: Infinite Story in a Finite Space !Phydgital InterSpace: Smallest moments = Biggest memory !Innovation PlayTank: Like a think-tank, but with PLAY! !Human Experience Modeler: Measure transforms meaning !Promotypes: Science meets Fiction to shift paradigms !!






MELTING THE BOUNDARIES

ISMAR Symposium & Expo 2009 October� 19-‐22� •� Orlando,� Florida,� USA

ISMAR International Symposium on Mixed and Augmented Reality

REALITYDREAMS

MELTING THE BOUNDARIES

SPONSORED BY IEEE COMPUTER SOCIETY VISUALIZATION AND GRAPHICS TECHNICAL COMMITTEE Experiential Media Design Research

Real World Lab: Technological playground of ideas & dreams





Heart

Head

Han

ds

VIRTUAL

IMAGINEDREAL

STORYPLAY

GAME

AssessmentStrategy

Objectives

INTERPLAY Strategy

Experiential Learning

Experiential Make-Overs: Big experience in a small space





Experiential Make-Overs: Infinite Story in a Finite Space





Feel like a film, play like a game and immerse like a theme park

Experiential Movie Trailer






Virtual Showroom






Achieving vs Consuming Education

Phydgital InterSpace: Smallest moments = Biggest memory





DigitalFidget

Physical

InterFace

Alison Frank

White Verandah

Bruce On Games

Puddle

JunkYard

Simulation






DigitalFidgetPhysicalPhydgitalInterFaceInterSpace

Alison Frank

White Verandah

Bruce On Games

Riddle Keeper

Playing is Educational

Puddle

JunkYard

Simulation






GUI

Infinite Imagination

Sense of Wonder Summer Camp

Learner

Infinite StoryNASA Shuttle Launch

Virtuality






Visual Portal

Infinite Story


Learner

Focal Perception

Peripheral PerceptionPeripheral Perception

Tangential Perception

Visual Depth & DirectionAudio 360 degree SenseHaptic 2-way SenseOlfactory Direct MemoryTaste Publicly Sensual

REALITY






Visual Portal

Infinite Story


Learner

REALITY

VIRTUALITY

IMAGINALITY

Virtual Character

Imaginary Character

Interactor Co-Learner

Telepresent

Other Zone






Reference Portal

Infinite Story


Learner

REALITY

VIRTUALITY

IMAGINALITY

Simulation Portal

↑ Phydgital Scopes & Vials←InterSpace→ Vernal Pool

Virtual Biologist






Play-tested Phydgital InterSpace with an Innovation PlayTank in Storefront Laboratory

Innovation PlayTank: Like a think-tank, but with PLAY!





Human Experience Modeler: Measure transforms meaning


http://erix.tv/mcl/v2_b.php




Reality (Tools)

Virtuality (Media)

Imaginality (Mental Model)

Insights

Feedback

Skills

Act/Do

Plan/Decide Cognitive Skills

Know/Sense Communication

Team Skills

Technical Skills

InterPLAYSTOR

YPLA

YGAM

E






BehaviorSpaceTime

Machine

Methods

Measure

Context

Meaning

Simulate, Capture, Analyze, Adapt, Innovate…






Virtual Kitchen separate

CAVEHMD excludes therapist

VR HMD

Kitchen not familiar

LIVE

No natural gestures

VIRTUAL

TBI Cognitive

Rehabilitation SIMULATIONS






Interact with TherapistTHERAPIST

Capture home environment

HOME

Add personal appliancesAPPLIANCE

Apply to Module Kitchen

CLINIC

VS. MIXING REALITIES

Cognitive Rehabilitation SIMULATIONS






Total Time to Complete Cereal Making Task

240

158

315

177

236

379

341

0

50

100

150

200

250

300

350

400

Pre VE 1 VE 2 VE 3 VE 4 VE 5 Post

Session

Tota

l Tim

e (S

econ

ds)

Total Time

Location Target Pre VE 1 VE 2 VE 3 VE 4 VE 5 Post

Pantry Cereal 58 (1) 112 (4) 76 (4) 119 (4) 80 (2) 18 (3) 8 (4)

Cabinet Bowl 13 (2) 38 (1) 26 (1) 43 (1) 28 (3) 27 (1) 18 (1)

Refrigerator Milk 14 (3) 44 (3) 24 (3) 12 (3) 7 (1) 14 (4) 14 (3)

Drawer Spoon 3 (4) 15 (2) 15 (2) 3 (2) 6 (5) 5 (2) 3 (2)

Counter Make Cereal 73 (5) 120 (5) 84 (5) 41 (5) 40 (4) 37 (5) 51 (5) Total Time (s) 240 379 315 341 236 177 158 Total Time (m:s) 4:00 6:19 5:15 5:41 3:56 2:57 2:38

Retrieval OrderTime to Complete

Interact with TherapistTHERAPIST

Training Transfer to the Home






IDEATION

INVENTION

PromotypeRecognize

PrototypeValidate

ProductDiffuse

Practice

TheoryDesign

Opportunity

Industry Training

INNOVATION

Promotypes: Science meets Fiction to shift paradigms





Prod

uctiv

ity

Time

System Adoption Return on Investment

+Poor

Anticipated

Design Training

Mitigating

Current Transfer of Training Productivity Loss/Gain

Asse

ssm

ent

Asse

ssm

ent

Asse

ssm

ent

Asse

ssm

ent

Asse

ssm

ent

Poor

Industry Training Promotypes: Science meets Fiction to shift paradigms





Promotype

Design Research Tool: Aphasia Therapy Promotype






Aphasia Therapy

Reality (Tools)

Virtuality (Media)

Imaginality (Mental Model)





Experiential Media can… Save a life… Transform a life… Prepare a life… Enhance a life… Augment a life… Share a life to future lives… Give a second chance in life…

In Designing Experiential Media…The smallest moments can make the biggest memories!





Virtual World Society: At Home with Experiential MediaShowroom Classroom

Healing RoomGame room

Lifelong Learning Livingroom

@VRWorldSociety





Christopher Stapleton!Creative Venture Catalyst Simiosys Real World Collaboratory

@Simiosys #eXMedia

ChristopherStapleton


KEYNOTE: Immersion, Imagination & Innovation





To experience many of my designs, you will certainly need safety restraints. When designing thrill rides or creating training scenarios for surgeons and soldiers, I need to take you to the edge of death and back again. When simulated experiences are transformative, I have done my job. Translating the power of a brand’s significance into everyday experiences is the same challenge for companies. Your ability to provide memorable experiences has life and death consequences for brand loyalty. Brand experience can and must engage all senses, in all directions, dimensions and realities to make a memory for a lifetime. Now with experiential media and marketing, we transcend the 19th Century QWERTY keyboard, lose the 1960’s point and click mouse, expand beyond the keyhole displays of little devices with the full bandwidth of the social human experience. By melting the boundaries between reality, virtuality and imaginality, we enter a future that is experienced as more real than real. What does that mean for your brand? Design & usability are no longer “keeping it simple, stupid,” or “ease of use.” The InterPlay of Story, Games and Play becomes a new metaphor to challenge the user in more complex, but intuitive user experiences that are hard to forget.






My users have the lives of their users in their hands… Surgeons, soldiers, teachers, operators, roller coaster designers Their work is a matter of life and death… Hospitals, battlefields, factories, theme parks, classrooms That makes my design work a matter of life and death… Training, working, thrill-seeking, learning, rehabilitation, marketing This means the design methodology is different…






• Their work is complicated, so I can’t “Keep it simple, Stupid!” • Its not about “Ease of Use.” creative problem-solving is difficult! • I can’t compromise on quality, cost or time (some pick two). !Its about being intuitive, making failing fun, limits sparking creativity,

This is done with the next-generation of Experiential Media…






Real World CoLaboratory: Experience Design Research





B’way to Theme Parks: from presentation to participation Real World Laboratory: Down the Rabbit hole Experience Design Research: from participation to purpose Innovation PlayTank: Dialogue of Innovation Experiential Learning: from Purpose to Passion Experiential Make-Overs: Interplay of story, play & games Training/Rehabilitation: from Passion to Performance Human Experience Modeler: Measure is Meaning Mixed Reality: from Performance to Paradigm Shift Promotypes: Science meets Fiction User Experience Interface: from Paradigm Shift to Practice!Phydgital InterSpace: Transforming Lives

Paradigm Shifts Across the Virtuality Continuum…


design as if your life depended on it! pioneering the future of experiential media

Technology

simiosys christopher

experiential makeovers

converging media

infinite story

flow2 realities

finite spacequestions

big experience

human experience modeler