who's that girl? handheld augmented reality for printed photo books

38
Niels Henze Susanne Boll University of Oldenburg Media Informa<cs and Mul<media Systems Who's that girl? Handheld Augmented Reality for Printed Photo Books

Upload: niels-henze

Post on 25-Dec-2014

786 views

Category:

Technology


1 download

DESCRIPTION

Augmented reality on mobile phones has recently made major progress. Lightweight, markerless object recognition and tracking makes handheld Augmented Reality feasible for new application domains. As this field is technology driven the interface design has mostly been neglected. In this paper we investigate visualization techniques for augmenting printed documents using handheld Augmented Reality. We selected the augmentation of printed photo books as our application domain because photo books are enduring artefacts that often have online galleries containing further information as digital coun-terpart. Based on an initial study, we designed two augmentations and three techniques to select regions in photos. In an experiment, we compare an aug-mentation that is aligned to the phone's display with an augmentation aligned to the physical object. We conclude that an object aligned presentation is more us-able. For selecting regions we show that participants are more satisfied using simple touch input compared to Augmented Reality based input techniques.

TRANSCRIPT

Page 1: Who's that girl? Handheld augmented reality for printed photo books

Niels  Henze  Susanne  Boll  

 

University  of  Oldenburg  Media  Informa<cs  and    Mul<media  Systems  

Who's  that  girl?    

Handheld  Augmented  Reality  for  Printed  Photo  Books  

Page 2: Who's that girl? Handheld augmented reality for printed photo books

Augmented  Reality  

Page 3: Who's that girl? Handheld augmented reality for printed photo books

hFp://graphics.cs.columbia.edu/projects/mars/  

Page 4: Who's that girl? Handheld augmented reality for printed photo books

hFp://blog.etcenter.org/2009/01/prototype-­‐3d-­‐video-­‐eyeware-­‐from-­‐vuzix/  

Page 5: Who's that girl? Handheld augmented reality for printed photo books

Touch  me  How  can  it  be  Believe  me  The  sun  always  shines                        on  my  screen  

! ! [AHA] �

Page 6: Who's that girl? Handheld augmented reality for printed photo books

Chun

yuan  Liao,  Qiong  Liu:  P

ACER

:  Tow

ard  A  Camerapho

ne-­‐based

 Paper  

Interface  for  Fine

-­‐grained

 and

 Flexible  Interac<on

 with

 Docum

ents.  

Adjunct  P

roc.  ACM

 Mul<m

edia,  2009.  

Page 7: Who's that girl? Handheld augmented reality for printed photo books
Page 8: Who's that girl? Handheld augmented reality for printed photo books
Page 9: Who's that girl? Handheld augmented reality for printed photo books

   Approach  

 ask  poten<al  users  

Page 10: Who's that girl? Handheld augmented reality for printed photo books

   Approach  

 ask  poten<al  users    systemize  proposed  solu<ons  

 

Page 11: Who's that girl? Handheld augmented reality for printed photo books

   Approach  

 ask  poten<al  users    systemize  proposed  solu<ons    design  and  implement  prototypes  

   

Page 12: Who's that girl? Handheld augmented reality for printed photo books

   Approach  

 ask  poten<al  users    systemize  proposed  solu<ons    design  and  implement  prototypes    compara<ve  evalua<on  

     

Page 13: Who's that girl? Handheld augmented reality for printed photo books
Page 14: Who's that girl? Handheld augmented reality for printed photo books

aligned  to  the  phone  

Page 15: Who's that girl? Handheld augmented reality for printed photo books

aligned  to  the  phone  

aligned  to  the  content  

Page 16: Who's that girl? Handheld augmented reality for printed photo books
Page 17: Who's that girl? Handheld augmented reality for printed photo books

object-­‐centric  design  

Page 18: Who's that girl? Handheld augmented reality for printed photo books

18

Page 19: Who's that girl? Handheld augmented reality for printed photo books

display-­‐centric  design  

Page 20: Who's that girl? Handheld augmented reality for printed photo books

20

Page 21: Who's that girl? Handheld augmented reality for printed photo books

selec<ng  regions  

crosshair   augmented  touch   unaugmented  touch  

Page 22: Who's that girl? Handheld augmented reality for printed photo books

   Controlled  

experiment    14  par<cipants    within-­‐subject  design  

Page 23: Who's that girl? Handheld augmented reality for printed photo books

   Controlled  

experiment    14  par<cipants    within-­‐subject  design    2  tasks  

Page 24: Who's that girl? Handheld augmented reality for printed photo books

   Controlled  

experiment    14  par<cipants    within-­‐subject  design    2  tasks  

Task  1:  alignment  Answering  5  ques<ons  using  a  photo  book  Task-­‐comple<on  <me,  NASA  TLX,  QUIS  (general  part)  Qualita<ve  feedback  

Page 25: Who's that girl? Handheld augmented reality for printed photo books

   Controlled  

experiment    14  par<cipants    within-­‐subject  design    2  tasks  

Task  1:  alignment  Answering  5  ques<ons  using  a  photo  book  Task-­‐comple<on  <me,  NASA  TLX,  QUIS  (general  part)  Qualita<ve  feedback  

 Task  2:  selec<on  

Selec<ng  regions  in  5  photos  Task-­‐comple<on  <me,  NASA  TLX,  QUIS  (general  part)  Qualita<ve  feedback  

Page 26: Who's that girl? Handheld augmented reality for printed photo books

p<.05,  r=0.81  

Task  1:  NASA  TLX  

Page 27: Who's that girl? Handheld augmented reality for printed photo books

p<.001,  r=0.70    

Task  1:  QUIS  (general  part)  

Page 28: Who's that girl? Handheld augmented reality for printed photo books

Task  2:  NASA  TLX  

Page 29: Who's that girl? Handheld augmented reality for printed photo books

Task  2:  QUIS  (general  part)  

Page 30: Who's that girl? Handheld augmented reality for printed photo books

     So  what?  

 informa<on  should  be  shown  object-­‐centric  

Page 31: Who's that girl? Handheld augmented reality for printed photo books

     So  what?  

 informa<on  should  be  shown  object-­‐centric  

Page 32: Who's that girl? Handheld augmented reality for printed photo books

     So  what?  

 informa<on  should  be  shown  object-­‐centric    but  input  elements  shouldn’t  

Page 33: Who's that girl? Handheld augmented reality for printed photo books

     So  what?  

 informa<on  should  be  shown  object-­‐centric    but  input  elements  shouldn’t  

Page 34: Who's that girl? Handheld augmented reality for printed photo books

     So  what?  

 informa<on  should  be  shown  object-­‐centric    but  input  elements    shouldn’t    highligh<ng  is  your  friend

   

Page 35: Who's that girl? Handheld augmented reality for printed photo books

     So  what?  

 informa<on  should  be  shown  object-­‐centric    but  input  elements    shouldn’t    highligh<ng  is  your  friend

   

Page 36: Who's that girl? Handheld augmented reality for printed photo books

     So  what?  

 informa<on  should  be  shown  object-­‐centric    but  input  elements    shouldn’t    highligh<ng  is  your  friend        early  user  involvement  is  king      

Page 37: Who's that girl? Handheld augmented reality for printed photo books

     So  what?  

 informa<on  should  be  shown  object-­‐centric    but  input  elements    shouldn’t    highligh<ng  is  your  friend    early  user  involvement  is  king  

 

Page 38: Who's that girl? Handheld augmented reality for printed photo books

     So  what?  

 informa<on  should  be  shown  object-­‐centric    but  input  elements    shouldn’t    highligh<ng  is  your  friend    early  user  involvement  is  king      

Niels  Henze  niels.henze@uni-­‐oldenburg.de    

Susanne  Boll  susanne.boll@uni-­‐oldenburg.de    

Media  Informa<cs  and    Mul<media  Systems  University  of  Oldenburg  

Who's  that  girl?  

 

Handheld  Augmented  Reality  for  Printed  

Photo  Books