augmented reality intro for mobile apps
TRANSCRIPT
Augmented Reality Intro for Mobile Apps
Heather Downing
@quorralyne
Heather Downing
@quorralyne
DigitalLightCycle.Blogspot.com
● Technical focus in .Net & mobile apps● Experience developing for Fortune 500
companies ● Speaker and entrepreneur ● Horseback Archery Competitor● Elven vocalist with 3 recorded albums● Semi-Professional photographer
@quorralyne
Overview✓ Why you should learn AR
✓ Reality Comparisons
✓ AR Subtypes
✓ AR Apps in the Wild
✓ Development Terminology
✓ Development Concepts
✓ Tango
✓ Frameworks
@quorralyne
Why dive into AR?
@quorralyne
Unity 3DA C# friend
@quorralyne
Augmented/Virtual Reality Report 2016 by Digi-Capital
@quorralyne
Augmented/Virtual Reality Forecast by Digi-Capital, Jan 2016
@quorralyne
$120 billionIndustry Revenue by 2020
@quorralyne
Reality Comparisons
@quorralyne
Augmented Reality
(AR)
Enhanced experience as viewed on a screen or other display.
Produced by overlaying computer-generated imagery on a real-world environment.
@quorralyne
Virtual Reality(VR)
Complete immersion into a virtual world where everything you see is computer generated.
The real world is blocked from your field of vision entirely.
@quorralyne
Mixed Reality(MR)
The merging of real world and virtual worlds to produce a new environment where physical and digital objects can coexist and interact.
@quorralyne
AR Subtypes
@quorralyne
Wearable AR @quorralyne
Projection AR @quorralyne
Device-based AR @quorralyne
AR Apps in the Wild
@quorralyne
Google Translate2D Transformative Overlay
Image Recognition
@quorralyne
Ingress2D Animated Overlay
Geo-based
@quorralyne
Pokemon GO2D Animated Overlay
Geo-basedSLAM
@quorralyne
Development Terminology
@quorralyne
AR Overlay
(Computer-generated Environment)
Augmented Reality that maps the physical environment real-time.
...while at the same time mapping the structure of that environment.
@quorralyne
Ronrik
@quorralyne
Image Target
The image recognized by the App, which launches the AR experience.
Also known as a Marker.
Images with high contrast and unique features with sharp edges are key pillars in supporting image recognition.
(Tracking)
@quorralyne
Hyundai Virtual Guide
@quorralyne
Markerless
(Dead Reckoning)
Augmented Reality that maps the physical environment real-time.
Often uses a smartphone camera and sensors to position a virtual object in a room without the need for Image Targets.
@quorralyne
X-Rift
@quorralyne
Simultaneous Localization and Mapping
(SLAM)
The attempt to simultaneously localise (i.e. find the position/orientation of) some sensor with respect to its surroundings...
...while at the same time mapping the structure of that environment.
@quorralyne
Development Concepts
@quorralyne
Anatomy
WORLD SIMULATION
VIDEO CAMERA
LOCATION & ORIENTATION
AUGMENTED VIEW
@quorralyne
Anatomy
WORLD SIMULATION
VIDEO CAMERA
LOCATION & ORIENTATION
AUGMENTED VIEW
@quorralyne
Video Camera
Goal to run at 60fps (30fps is default)
Retrieve the frame from the buffer
Retrieve the Field of View
@quorralyne
Location
GPS based
Returns Latitude & Longitude and sometimes Altitude
Slight accuracy issues (10m on a good day)
Not great indoors
Wifi improves it slightly
@quorralyne
Orientation
Need a reference orientationor known orientation from which to measure
Use True North
Pitch, Roll, Yaw
Quaternion
Rotation Matrix
@quorralyne
Augmented View
OVERLAY 2D OBJECTS
Heads Up Display
Depends on Field of View
Objects can be applied by spherical coordinates relative to device position
SHOW 3D VIRTUAL OBJECTS
Immersive interaction
Use 3D X, Y & Z coordinates convertedFrom Lat, Long, Altitude (Cartesian)
Orient virtual camera to match real camera
Augmented World maps larger than Field of View
@quorralyne
Tango
@quorralyne
TangoAndroid
A technology platform from Google that allows developers to create experiences that incorporate things like indoor navigation, 3D mapping, and augmented reality.
It uses computer vision to enable devices to see the world around them without relying on GPS.
@quorralyne
AR Mobile Frameworks
Vuforia
Wikitude (browser-based)
Kudan
ARToolkit
ARLab
Aurasma
Layar (browser-based)
OpenCV
...and many, many more
@quorralyne
DEMO
@quorralyne
Potential App Uses
Education
Potential App Uses
Education
Sports
Potential App Uses
Education
Sports
Medical
Potential App Uses
Education
Sports
Medical
Architectural
Potential App Uses
Education
Sports
Medical
Architectural
Security
Potential App Uses
Education
Sports
Medical
Architectural
Security
Scientific Research
Potential App Uses
Education
Sports
Medical
Architectural
Security
Scientific Research
Space Exploration
Potential App Uses
Education
Sports
Medical
Architectural
Security
Scientific Research
Space Exploration
Navigation
Potential App Uses
Education
Sports
Medical
Architectural
Security
Scientific Research
Space Exploration
Navigation
Foreign Communication
Potential App Uses
Education
Sports
Medical
Architectural
Security
Scientific Research
Space Exploration
Navigation
Foreign Communication
Games
ResourcesUnity 3D (unity.com)
Blender (blender.org)
Kudan framework (kudan.eu)
Wikitude framework (wikitude.com)
Project Tango (get.google.com/tango/)
Xamarin Augmented Reality - Frank A. Krueger (https://www.youtube.com/watch?v=HLFn7Y_y_HI)
Android (developer.android.com)
iOS (developer.apple.com)
@quorralyne
Stay curious.
Heather Downing@quorralyne
slideshare.net/quorralyne