qualcomm vuforia mobile vision platform: smart terrain for depth-sensing cameras
DESCRIPTION
Learn how to build breakthrough gaming and shopping experiences that take advantage of what the Smart Terrain™ feature of the Qualcomm® Vuforia™ mobile vision platform, a product of Qualcomm Connected Experiences, Inc. can offer. Intended for developers who have built at least one Vuforia app or who are proficient with Unity, this session provides a workflow overview and insights on how best to optimize for depth-sensing cameras. Watch this presentation on YouTube: https://www.youtube.com/watch?v=1RmyHZ2_vg0TRANSCRIPT
![Page 1: Qualcomm Vuforia Mobile Vision Platform: Smart Terrain for Depth-Sensing Cameras](https://reader033.vdocuments.mx/reader033/viewer/2022052507/557fa5a9d8b42ad60b8b4cd2/html5/thumbnails/1.jpg)
1
![Page 2: Qualcomm Vuforia Mobile Vision Platform: Smart Terrain for Depth-Sensing Cameras](https://reader033.vdocuments.mx/reader033/viewer/2022052507/557fa5a9d8b42ad60b8b4cd2/html5/thumbnails/2.jpg)
Smart Terrain™ feature for Depth Sensing Cameras
David Beard Developer Evangelist, Qualcomm Connected Experiences, Inc.
Smart Terrain is a feature of the Qualcomm Vuforia SDK. Qualcomm Vuforia is a product of Qualcomm Connected Experiences, Inc.
![Page 3: Qualcomm Vuforia Mobile Vision Platform: Smart Terrain for Depth-Sensing Cameras](https://reader033.vdocuments.mx/reader033/viewer/2022052507/557fa5a9d8b42ad60b8b4cd2/html5/thumbnails/3.jpg)
3 3
Smart Terrain
Reconstructs the environment
Awareness of your environment
Intelligence to interact with objects and surfaces
![Page 4: Qualcomm Vuforia Mobile Vision Platform: Smart Terrain for Depth-Sensing Cameras](https://reader033.vdocuments.mx/reader033/viewer/2022052507/557fa5a9d8b42ad60b8b4cd2/html5/thumbnails/4.jpg)
4
Overview
Smart Terrain for standard device cameras
Advantages of Depth Sensing
How it works
Developing with Smart Terrain
![Page 5: Qualcomm Vuforia Mobile Vision Platform: Smart Terrain for Depth-Sensing Cameras](https://reader033.vdocuments.mx/reader033/viewer/2022052507/557fa5a9d8b42ad60b8b4cd2/html5/thumbnails/5.jpg)
5
Smart Terrain for Standard Device Cameras
![Page 6: Qualcomm Vuforia Mobile Vision Platform: Smart Terrain for Depth-Sensing Cameras](https://reader033.vdocuments.mx/reader033/viewer/2022052507/557fa5a9d8b42ad60b8b4cd2/html5/thumbnails/6.jpg)
6
Supported Environments
Simulated images
![Page 7: Qualcomm Vuforia Mobile Vision Platform: Smart Terrain for Depth-Sensing Cameras](https://reader033.vdocuments.mx/reader033/viewer/2022052507/557fa5a9d8b42ad60b8b4cd2/html5/thumbnails/7.jpg)
7
Initializing Smart Terrain
Simulated images
![Page 8: Qualcomm Vuforia Mobile Vision Platform: Smart Terrain for Depth-Sensing Cameras](https://reader033.vdocuments.mx/reader033/viewer/2022052507/557fa5a9d8b42ad60b8b4cd2/html5/thumbnails/8.jpg)
8
Builds Primary Surface
Simulated images
![Page 9: Qualcomm Vuforia Mobile Vision Platform: Smart Terrain for Depth-Sensing Cameras](https://reader033.vdocuments.mx/reader033/viewer/2022052507/557fa5a9d8b42ad60b8b4cd2/html5/thumbnails/9.jpg)
9
Detects Props
Simulated images
![Page 10: Qualcomm Vuforia Mobile Vision Platform: Smart Terrain for Depth-Sensing Cameras](https://reader033.vdocuments.mx/reader033/viewer/2022052507/557fa5a9d8b42ad60b8b4cd2/html5/thumbnails/10.jpg)
10
Approximates Objects & Surfaces
Simulated images
![Page 11: Qualcomm Vuforia Mobile Vision Platform: Smart Terrain for Depth-Sensing Cameras](https://reader033.vdocuments.mx/reader033/viewer/2022052507/557fa5a9d8b42ad60b8b4cd2/html5/thumbnails/11.jpg)
11
Smart Terrain for Depth Sensing Cameras
![Page 12: Qualcomm Vuforia Mobile Vision Platform: Smart Terrain for Depth-Sensing Cameras](https://reader033.vdocuments.mx/reader033/viewer/2022052507/557fa5a9d8b42ad60b8b4cd2/html5/thumbnails/12.jpg)
12
Advantages of Depth Sensing Devices
Standard Device Cameras Uses an initialization target Requires user motion Approximates objects
Infrared Depth Sensors Automatic initialization No motion required Faster and richer results
![Page 13: Qualcomm Vuforia Mobile Vision Platform: Smart Terrain for Depth-Sensing Cameras](https://reader033.vdocuments.mx/reader033/viewer/2022052507/557fa5a9d8b42ad60b8b4cd2/html5/thumbnails/13.jpg)
13
Depth Sensing Cameras
Standard Device Cameras Uses visible light Senses contrast
Infrared Depth Sensors Projects Infrared light Fuses RGB image & depth map
![Page 14: Qualcomm Vuforia Mobile Vision Platform: Smart Terrain for Depth-Sensing Cameras](https://reader033.vdocuments.mx/reader033/viewer/2022052507/557fa5a9d8b42ad60b8b4cd2/html5/thumbnails/14.jpg)
14
Automatic initialization
Simulated images
![Page 15: Qualcomm Vuforia Mobile Vision Platform: Smart Terrain for Depth-Sensing Cameras](https://reader033.vdocuments.mx/reader033/viewer/2022052507/557fa5a9d8b42ad60b8b4cd2/html5/thumbnails/15.jpg)
15
Faster and richer results
Simulated images
![Page 16: Qualcomm Vuforia Mobile Vision Platform: Smart Terrain for Depth-Sensing Cameras](https://reader033.vdocuments.mx/reader033/viewer/2022052507/557fa5a9d8b42ad60b8b4cd2/html5/thumbnails/16.jpg)
16
Surface reconstruction
Simulated images
![Page 17: Qualcomm Vuforia Mobile Vision Platform: Smart Terrain for Depth-Sensing Cameras](https://reader033.vdocuments.mx/reader033/viewer/2022052507/557fa5a9d8b42ad60b8b4cd2/html5/thumbnails/17.jpg)
17
Object reconstruction
Simulated images
![Page 18: Qualcomm Vuforia Mobile Vision Platform: Smart Terrain for Depth-Sensing Cameras](https://reader033.vdocuments.mx/reader033/viewer/2022052507/557fa5a9d8b42ad60b8b4cd2/html5/thumbnails/18.jpg)
18
Automatic scale estimation
Simulated images
![Page 19: Qualcomm Vuforia Mobile Vision Platform: Smart Terrain for Depth-Sensing Cameras](https://reader033.vdocuments.mx/reader033/viewer/2022052507/557fa5a9d8b42ad60b8b4cd2/html5/thumbnails/19.jpg)
19
![Page 20: Qualcomm Vuforia Mobile Vision Platform: Smart Terrain for Depth-Sensing Cameras](https://reader033.vdocuments.mx/reader033/viewer/2022052507/557fa5a9d8b42ad60b8b4cd2/html5/thumbnails/20.jpg)
20
Developing with Smart Terrain
![Page 21: Qualcomm Vuforia Mobile Vision Platform: Smart Terrain for Depth-Sensing Cameras](https://reader033.vdocuments.mx/reader033/viewer/2022052507/557fa5a9d8b42ad60b8b4cd2/html5/thumbnails/21.jpg)
21
Best Practices Recommendations for the best user experiences
Supported Environments
User Experience
Designing content
Managing meshes
![Page 22: Qualcomm Vuforia Mobile Vision Platform: Smart Terrain for Depth-Sensing Cameras](https://reader033.vdocuments.mx/reader033/viewer/2022052507/557fa5a9d8b42ad60b8b4cd2/html5/thumbnails/22.jpg)
22
Near range experiences Stages with visually distince borders Opaque non-reflective surfaces Stable room lighting
Supported Environments
![Page 23: Qualcomm Vuforia Mobile Vision Platform: Smart Terrain for Depth-Sensing Cameras](https://reader033.vdocuments.mx/reader033/viewer/2022052507/557fa5a9d8b42ad60b8b4cd2/html5/thumbnails/23.jpg)
23
Designing Content
Simulated images
![Page 24: Qualcomm Vuforia Mobile Vision Platform: Smart Terrain for Depth-Sensing Cameras](https://reader033.vdocuments.mx/reader033/viewer/2022052507/557fa5a9d8b42ad60b8b4cd2/html5/thumbnails/24.jpg)
24
Managing Meshes
Simulated images
![Page 25: Qualcomm Vuforia Mobile Vision Platform: Smart Terrain for Depth-Sensing Cameras](https://reader033.vdocuments.mx/reader033/viewer/2022052507/557fa5a9d8b42ad60b8b4cd2/html5/thumbnails/25.jpg)
25
Abstracts the features of the hardware
Consistent life cycle management
Consistent event handling
Easy portability
Smart Terrain API A universal API for depth aware devices
![Page 26: Qualcomm Vuforia Mobile Vision Platform: Smart Terrain for Depth-Sensing Cameras](https://reader033.vdocuments.mx/reader033/viewer/2022052507/557fa5a9d8b42ad60b8b4cd2/html5/thumbnails/26.jpg)
26
Smart Terrain call flow
SmartTerrainTracker.StartMeshUpdates()
SmartTerrainTracker.StopMeshUpdates()
OnPropUpdated(Prop prop)
OnSurfaceUpdated(SurfaceAbstractBehaviour surfaceBehaviour)
OnPropCreated(Prop prop)
SmartTerrainManager.AssociateProp(PropTemplate, prop)
OnPropDeleted(Prop prop)
![Page 27: Qualcomm Vuforia Mobile Vision Platform: Smart Terrain for Depth-Sensing Cameras](https://reader033.vdocuments.mx/reader033/viewer/2022052507/557fa5a9d8b42ad60b8b4cd2/html5/thumbnails/27.jpg)
27
Initialize Smart Terrain
Simulated images
![Page 28: Qualcomm Vuforia Mobile Vision Platform: Smart Terrain for Depth-Sensing Cameras](https://reader033.vdocuments.mx/reader033/viewer/2022052507/557fa5a9d8b42ad60b8b4cd2/html5/thumbnails/28.jpg)
28
Initialize Smart Terrain
StartMeshUpdates()
![Page 29: Qualcomm Vuforia Mobile Vision Platform: Smart Terrain for Depth-Sensing Cameras](https://reader033.vdocuments.mx/reader033/viewer/2022052507/557fa5a9d8b42ad60b8b4cd2/html5/thumbnails/29.jpg)
29
Build Mesh
Simulated images
![Page 30: Qualcomm Vuforia Mobile Vision Platform: Smart Terrain for Depth-Sensing Cameras](https://reader033.vdocuments.mx/reader033/viewer/2022052507/557fa5a9d8b42ad60b8b4cd2/html5/thumbnails/30.jpg)
30
Build Mesh
OnSurfaceUpdated(SurfaceAbstractBehaviour surfaceBehaviour)
![Page 31: Qualcomm Vuforia Mobile Vision Platform: Smart Terrain for Depth-Sensing Cameras](https://reader033.vdocuments.mx/reader033/viewer/2022052507/557fa5a9d8b42ad60b8b4cd2/html5/thumbnails/31.jpg)
31
Detect Props
Simulated images
![Page 32: Qualcomm Vuforia Mobile Vision Platform: Smart Terrain for Depth-Sensing Cameras](https://reader033.vdocuments.mx/reader033/viewer/2022052507/557fa5a9d8b42ad60b8b4cd2/html5/thumbnails/32.jpg)
32
OnPropUpdated(Prop prop)
Detect Props
![Page 33: Qualcomm Vuforia Mobile Vision Platform: Smart Terrain for Depth-Sensing Cameras](https://reader033.vdocuments.mx/reader033/viewer/2022052507/557fa5a9d8b42ad60b8b4cd2/html5/thumbnails/33.jpg)
33
StopMeshUpdates(Prop prop)
Stop Reconstruction
![Page 34: Qualcomm Vuforia Mobile Vision Platform: Smart Terrain for Depth-Sensing Cameras](https://reader033.vdocuments.mx/reader033/viewer/2022052507/557fa5a9d8b42ad60b8b4cd2/html5/thumbnails/34.jpg)
34
Smart Terrain call flow
SmartTerrainTracker.StartMeshUpdates()
SmartTerrainTracker.StopMeshUpdates()
OnPropUpdated(Prop prop)
OnSurfaceUpdated(SurfaceAbstractBehaviour surfaceBehaviour)
OnPropCreated(Prop prop)
SmartTerrainManager.AssociateProp(PropTemplate, prop)
OnPropDeleted(Prop prop)
![Page 35: Qualcomm Vuforia Mobile Vision Platform: Smart Terrain for Depth-Sensing Cameras](https://reader033.vdocuments.mx/reader033/viewer/2022052507/557fa5a9d8b42ad60b8b4cd2/html5/thumbnails/35.jpg)
35
Creating a Smart Terrain App in Unity
![Page 36: Qualcomm Vuforia Mobile Vision Platform: Smart Terrain for Depth-Sensing Cameras](https://reader033.vdocuments.mx/reader033/viewer/2022052507/557fa5a9d8b42ad60b8b4cd2/html5/thumbnails/36.jpg)
36
For more information on Qualcomm, visit us at: www.qualcomm.com & www.qualcomm.com/blog
©2013-2014 Qualcomm Technologies, Inc. and/or its affiliated companies. All Rights Reserved. Qualcomm is a trademark of Qualcomm Incorporated, registered in the United States and other countries,. Uplinq and Smart Terrain are trademarks of Qualcomm Incorporated. Alll Qualcomm Incorporated trademarks are used with permission.Other products and brand names may be trademarks or registered trademarks of their respective owners.of their respective owners. References in this presentation to “Qualcomm” may mean Qualcomm Incorporated, Qualcomm Technologies, Inc., and/or other subsidiaries or business units within the Qualcomm corporate structure, as applicable. Qualcomm Incorporated includes Qualcomm’s licensing business, QTL, and the vast majority of its patent portfolio. Qualcomm Technologies, Inc., a wholly-owned subsidiary of Qualcomm Incorporated, operates, along with its subsidiaries, substantially all of Qualcomm’s engineering, research and development functions, and substantially all of its product and services businesses, including its semiconductor business, QCT.
Thank you FOLLOW US ON: