seven feiner's presentation at emerging communications conference & awards 2010 america
TRANSCRIPT
![Page 1: Seven Feiner's Presentation at Emerging Communications Conference & Awards 2010 America](https://reader033.vdocuments.mx/reader033/viewer/2022060206/55a22d441a28ab86378b457d/html5/thumbnails/1.jpg)
1
![Page 2: Seven Feiner's Presentation at Emerging Communications Conference & Awards 2010 America](https://reader033.vdocuments.mx/reader033/viewer/2022060206/55a22d441a28ab86378b457d/html5/thumbnails/2.jpg)
2
Where ARWhere ARWe Heading?We Heading?
Steven Feiner
Computer Graphics & User Interfaces LabDepartment of Computer ScienceColumbia University New York, NY 10027
Supported in part by NSF, ONR, USMC, and gifts fromMicrosoft, Google, Vuzix
Augmented Reality Conference / eComm America 2010 San Francisco Airport Marriott, April 19–21, 2010
![Page 3: Seven Feiner's Presentation at Emerging Communications Conference & Awards 2010 America](https://reader033.vdocuments.mx/reader033/viewer/2022060206/55a22d441a28ab86378b457d/html5/thumbnails/3.jpg)
3
Over 40 Years of AR Research,Over 40 Years of AR Research,…… Ivan Sutherland,
Head-tracked VR/AR(Late 60s–early 70s) Stereo, head-tracked, optical
see-through, head-worn display Graphics overlaid on real world
I. Sutherland, A Head-Mounted Three-Dimensional Display, Proc. AFIPS Fall Joint Comp. Conf., 757–764, 1968
![Page 4: Seven Feiner's Presentation at Emerging Communications Conference & Awards 2010 America](https://reader033.vdocuments.mx/reader033/viewer/2022060206/55a22d441a28ab86378b457d/html5/thumbnails/4.jpg)
4
Over 13 Years of Mobile AR Over 13 Years of Mobile AR Research,…Research,…
Columbia“Touring Machine” 1996–
AR Campus Tour, 1997
![Page 5: Seven Feiner's Presentation at Emerging Communications Conference & Awards 2010 America](https://reader033.vdocuments.mx/reader033/viewer/2022060206/55a22d441a28ab86378b457d/html5/thumbnails/5.jpg)
5
Over 13 Years of Mobile AR Over 13 Years of Mobile AR Research,…Research,…
Columbia“Touring Machine” 1996–
AR Historical Hypermedia Documentary, 1999
![Page 6: Seven Feiner's Presentation at Emerging Communications Conference & Awards 2010 America](https://reader033.vdocuments.mx/reader033/viewer/2022060206/55a22d441a28ab86378b457d/html5/thumbnails/6.jpg)
6
Over 13 Years of Mobile AR Over 13 Years of Mobile AR Research,…Research,…
Columbia“Touring Machine” 1996–
AR Restaurant Guide, 2001
![Page 7: Seven Feiner's Presentation at Emerging Communications Conference & Awards 2010 America](https://reader033.vdocuments.mx/reader033/viewer/2022060206/55a22d441a28ab86378b457d/html5/thumbnails/7.jpg)
7
Flash Forward to 2008, 9, 10,…Flash Forward to 2008, 9, 10,…
Commodity mobile devices Small Powerful Inexpensive Networked
Sensors Ubiquitous
Content Proliferating
Wikitude et al., 2008 –
Columbia MobileAugmented RealitySystem, 1996–
2001
2001
![Page 8: Seven Feiner's Presentation at Emerging Communications Conference & Awards 2010 America](https://reader033.vdocuments.mx/reader033/viewer/2022060206/55a22d441a28ab86378b457d/html5/thumbnails/8.jpg)
8
Consider Mobile AR,…Consider Mobile AR,…
Where are We Now?Where are We Now?
![Page 9: Seven Feiner's Presentation at Emerging Communications Conference & Awards 2010 America](https://reader033.vdocuments.mx/reader033/viewer/2022060206/55a22d441a28ab86378b457d/html5/thumbnails/9.jpg)
9
Issues: Inaccurate TrackingIssues: Inaccurate Tracking
A-GPS position inaccuracy
Compass orientation inaccuracy
![Page 10: Seven Feiner's Presentation at Emerging Communications Conference & Awards 2010 America](https://reader033.vdocuments.mx/reader033/viewer/2022060206/55a22d441a28ab86378b457d/html5/thumbnails/10.jpg)
10
Issues: Inaccurate TrackingIssues: Inaccurate Tracking
Phone CPU/GPU/display better in 2010, but,…
Backpack position and orientation tracking better in 1999 RTK GNSS Hybrid IMU
![Page 11: Seven Feiner's Presentation at Emerging Communications Conference & Awards 2010 America](https://reader033.vdocuments.mx/reader033/viewer/2022060206/55a22d441a28ab86378b457d/html5/thumbnails/11.jpg)
11
Issues: Inaccurate TrackingIssues: Inaccurate Tracking
Better sensors Different sensors
(vision,…) Sensor fusion
E.g., using abetter orientation tracker
Y. Tokusho, M. Sukan, et al., 2009
![Page 12: Seven Feiner's Presentation at Emerging Communications Conference & Awards 2010 America](https://reader033.vdocuments.mx/reader033/viewer/2022060206/55a22d441a28ab86378b457d/html5/thumbnails/12.jpg)
12
Issues: Incorrect Field of ViewIssues: Incorrect Field of View
Display FOV too small
Camera FOV too large Not 1:1
Not parallax free
http://flickr.com/photos/click-see/25803640/
![Page 13: Seven Feiner's Presentation at Emerging Communications Conference & Awards 2010 America](https://reader033.vdocuments.mx/reader033/viewer/2022060206/55a22d441a28ab86378b457d/html5/thumbnails/13.jpg)
13
Cult of the hand-out “Excuse me while I whip
out my phone, turn it on, hold it at arm’s length, wait until it’s started tracking…”
Issues: Handheld LifestyleIssues: Handheld Lifestyle
Y. Tokusho et al., 2009
S. Güven et al., 2006
http://labs.lastminute.com/nru/ Nokia
![Page 14: Seven Feiner's Presentation at Emerging Communications Conference & Awards 2010 America](https://reader033.vdocuments.mx/reader033/viewer/2022060206/55a22d441a28ab86378b457d/html5/thumbnails/14.jpg)
14
Issues: Handheld LifestyleIssues: Handheld Lifestyle
The promise of eyewear Hands-free
Always on
Must be Small
Light
Bright / high contrast
Comfortable
Visually appealing
Affordable
Lumus
Konica Minolta
Sony
Prototype optical see-through eyewear
![Page 15: Seven Feiner's Presentation at Emerging Communications Conference & Awards 2010 America](https://reader033.vdocuments.mx/reader033/viewer/2022060206/55a22d441a28ab86378b457d/html5/thumbnails/15.jpg)
15
Eyewear-Based Task AssistanceEyewear-Based Task Assistancegraphics.cs.columbia.edu/projects/armargraphics.cs.columbia.edu/projects/armar
S. Henderson & S. Feiner, 2009
![Page 16: Seven Feiner's Presentation at Emerging Communications Conference & Awards 2010 America](https://reader033.vdocuments.mx/reader033/viewer/2022060206/55a22d441a28ab86378b457d/html5/thumbnails/16.jpg)
16
Eyewear-Based Mobile GamesEyewear-Based Mobile Gamesgoblinxna.codeplex.comgoblinxna.codeplex.com
O. Oda & S. Feiner, 2009
![Page 17: Seven Feiner's Presentation at Emerging Communications Conference & Awards 2010 America](https://reader033.vdocuments.mx/reader033/viewer/2022060206/55a22d441a28ab86378b457d/html5/thumbnails/17.jpg)
17
Issues: UI Design for ARIssues: UI Design for AR
Design presentations dynamically Respect the real
world!
E.g., automated layout accounting for occlusion
B. Bell et al., 2001
![Page 18: Seven Feiner's Presentation at Emerging Communications Conference & Awards 2010 America](https://reader033.vdocuments.mx/reader033/viewer/2022060206/55a22d441a28ab86378b457d/html5/thumbnails/18.jpg)
18
WhatWhat’s Next?’s Next?
![Page 19: Seven Feiner's Presentation at Emerging Communications Conference & Awards 2010 America](https://reader033.vdocuments.mx/reader033/viewer/2022060206/55a22d441a28ab86378b457d/html5/thumbnails/19.jpg)
19
UbiquitousUbiquitous
When we stop asking
“What’s the Killer App?”
![Page 20: Seven Feiner's Presentation at Emerging Communications Conference & Awards 2010 America](https://reader033.vdocuments.mx/reader033/viewer/2022060206/55a22d441a28ab86378b457d/html5/thumbnails/20.jpg)
20
HeterogeneousHeterogeneous N. Dedual & S. Feiner, 2010 N. Dedual & S. Feiner, 2010
Surface Publicly
visible Multitouch
+ See-through
HWD Private Stereo
Benefit from advantages of complementary displays and devices
![Page 21: Seven Feiner's Presentation at Emerging Communications Conference & Awards 2010 America](https://reader033.vdocuments.mx/reader033/viewer/2022060206/55a22d441a28ab86378b457d/html5/thumbnails/21.jpg)
21
CollaborativeCollaborative
E.g.,
Collaborative Tracking/Modeling
![Page 22: Seven Feiner's Presentation at Emerging Communications Conference & Awards 2010 America](https://reader033.vdocuments.mx/reader033/viewer/2022060206/55a22d441a28ab86378b457d/html5/thumbnails/22.jpg)
22
Collaborative Tracking/ModelingCollaborative Tracking/Modeling
Users Want to know their location and “interesting
information”
System Wants to model the world (including users and
their “interesting information”)
![Page 23: Seven Feiner's Presentation at Emerging Communications Conference & Awards 2010 America](https://reader033.vdocuments.mx/reader033/viewer/2022060206/55a22d441a28ab86378b457d/html5/thumbnails/23.jpg)
23
Collaborative Tracking/ModelingCollaborative Tracking/Modeling
User: Provides Current
Sensor data: Imagery, audio, (A-)GPS, compass, inertial measurements, radio signal strength, GNSS carrier phase,…
Historic Known position/orientation Sensor data: …
Relevant “Interesting information” System
Uses sensor data and history from user and others to match against database
Returns User’s (precise) current position/orientation Relevant “Interesting information”
Updates database
![Page 24: Seven Feiner's Presentation at Emerging Communications Conference & Awards 2010 America](https://reader033.vdocuments.mx/reader033/viewer/2022060206/55a22d441a28ab86378b457d/html5/thumbnails/24.jpg)
24
UsersUsers
“Just plain folk”
http://jonathan.tenkely.org/wordpress/wp-content/gallery/gallery/VectorPeople.png
![Page 25: Seven Feiner's Presentation at Emerging Communications Conference & Awards 2010 America](https://reader033.vdocuments.mx/reader033/viewer/2022060206/55a22d441a28ab86378b457d/html5/thumbnails/25.jpg)
25
SystemSystem
“The usual suspects”
Individual providers for private sites might make agreements with larger organizations
![Page 26: Seven Feiner's Presentation at Emerging Communications Conference & Awards 2010 America](https://reader033.vdocuments.mx/reader033/viewer/2022060206/55a22d441a28ab86378b457d/html5/thumbnails/26.jpg)
26
ResultsResults
Up-to-the-second Street {View, Side,…} Current shop window
contents Current pedestrian
traffic Not just those who opt
in, but others through face/gait/… recognition “Publicly observable
behavior”
pedestrians
![Page 27: Seven Feiner's Presentation at Emerging Communications Conference & Awards 2010 America](https://reader033.vdocuments.mx/reader033/viewer/2022060206/55a22d441a28ab86378b457d/html5/thumbnails/27.jpg)
27
ResultsResults
Up-to-the-second world model Made possible by
uploaded sensor data Fine-grained history
Provides past record Makes predictions
possible The ultimate social
network And, you will be
part of it
![Page 28: Seven Feiner's Presentation at Emerging Communications Conference & Awards 2010 America](https://reader033.vdocuments.mx/reader033/viewer/2022060206/55a22d441a28ab86378b457d/html5/thumbnails/28.jpg)
28
Privacy Issues?Privacy Issues?
http://foursquare.com Where are you now?
http://plancast.com Where are you going?
http://blippy.com What are you buying?
http://everythingithink.com What are you thinking?
![Page 29: Seven Feiner's Presentation at Emerging Communications Conference & Awards 2010 America](https://reader033.vdocuments.mx/reader033/viewer/2022060206/55a22d441a28ab86378b457d/html5/thumbnails/29.jpg)
29
AcknowledgmentsAcknowledgments
Blaine Bell Hrvoje Benko Gábor Blaskó Franz Coriand Nick Dedual Steve Henderson Sinem Güven Tobias Höllerer Eddie Ishak Levi Lister Blair MacIntyre Ohan Oda
John Pavlik Mengu Sukan Yoshitaka Tokusho Tony Webster Sean White Lauren Wilcox Ryuji Yamamoto Supported in part by NSF,
ONR, USMC, and gifts from Microsoft, Google, Vuzix
Any opinions, findings and conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of the National Science Foundation
See you at ISMAR 2010, Oct 13-16Seoul, Korea, www.ismar10.org
![Page 30: Seven Feiner's Presentation at Emerging Communications Conference & Awards 2010 America](https://reader033.vdocuments.mx/reader033/viewer/2022060206/55a22d441a28ab86378b457d/html5/thumbnails/30.jpg)