powerpoint presentation...2/20/2017 6 drones fixed wing multi-rotors 1. dji 2. sensefly 3. trimble...
TRANSCRIPT
2/20/2017
1
Drones, Cameras, and Surveying
©2016 PixElement | Confidential & Proprietary Information
What is PixElement?
In-Browser, Cloud-Based image
processing software
Any Camera turns into a 3D
measurement tool
Quickly & Accurately generates 3D
models and data
Scalable to massive data
SaaS (billed monthly)
About the Product
2/20/2017
2
©2016 PixElement | Confidential & Proprietary Information
Industrial 3D Data, Anywhere on the Planet
Visualize.
Exploit.
Measure.
Extract actionable information from imagery.
Create accurate maps at scale in record time.
Line | Volume | Asset Extraction
©2016 PixElement | Confidential & Proprietary Information
Orthomosaic (mapview)
©2016 PixElement | Confidential & Proprietary Information
Drape imageryand interact.
Detect changes over time
2/20/2017
3
©2016 PixElement | Confidential & Proprietary Information
t
What sets PixElement apart
©2016 PixElement | Confidential & Proprietary Information
The Problem...
Too many steps.Too many providers.
COLLECT PROCESS ANALYZE STORE & TRANSFER
COLLABORATE& VIEW
CURRENT PROCESS:
2/20/2017
4
©2016 PixElement | Confidential & Proprietary Information
The PixElement Solution
Streamlined process.Cloud access.
COLLECT COLLABORATE& VIEW
Pix Element
Process, store, analyze, and share. Anywhere on the planet.
Pix Element
©2016 PixElement | Confidential & Proprietary Information
Customer Benefits
2/20/2017
5
100% Automated
Faster
Better Security
No Backup
©2016 PixElement | Confidential & Proprietary Information
No Storage Limits
Always Working
Better Scalability
Real-Time Collaboration
What makes up a drone?
Overview
Platforms
Mission Planning
Cameras (important)
Lenses (more important)UMAPAV Corp. Confidential and Proprietary Information
2/20/2017
6
Drones Multi-RotorsFixed Wing
1. DJI
2. Sensefly
3. Trimble
4. 3DR
5. Parrot
6. Aeryon
7. Etc
©2016 PixElement | Confidential & Proprietary Information
Multi-
Rotor- Less
Endurance
- VTOL
capability
- Variable
speed
speed
- Easily
Maneuverab
le©2016 PixElement | Confidential & Proprietary Information
Fixed-
Wing
- Longer Endurance
- No VTOL
capability
- Maintains a
cruising speed
- Wear and Tear on
body
©2016 PixElement | Confidential & Proprietary Information
2/20/2017
7
Mission
PlanningMission planning is
a simple as
drawing a
polygon over the
accident area
and uploading
the mission to
the drone’s
autopilot
Low-cost image
processing ©2016 PixElement | Confidential & Proprietary Information
Mission
PlanningMission planning is
a simple as
drawing a
polygon over the
accident area
and uploading
the mission to
the drone’s
autopilot
Low-cost image
processing ©2016 PixElement | Confidential & Proprietary Information
Cameras
Do cameras
matter?
Why should i get a
good camera?
Image
Quality Price
Low
High
©2016 PixElement | Confidential & Proprietary Information
2/20/2017
8
Lenses
Do lenses matter?
Why should i get a
good lens?
©2016 PixElement | Confidential & Proprietary Information
Lenses
“Zoom”
(Multiple focal
lengths)
“Prime”
(One focal
length)
©2016 PixElement | Confidential & Proprietary Information
Lens Distortion - GoProImages courtesy of Jim Bethel
2/20/2017
9
Data Collection
Nadir
Low
Oblique
2/20/2017
10
Really
Oblique!
Summary
Get the platform the works best for you
(Or maybe you don’t do the flying)
Cameras
Spend the extra 300 for a good camera (Zenmuse)
Lenses (more important)
Prime lenses > Zoom
Lens Quality is important
Different lenses for different jobs! (Interchangeable system)
UMAPAV Corp. Confidential and Proprietary Information
©2016 PixElement | Confidential & Proprietary Information
Platform SensorGPS
2/20/2017
11
©2016 PixElement | Confidential & Proprietary Information
Platform SensorGPS
?
©2016 PixElement | Confidential & Proprietary Information
Geotagging Tips and Tricks
● Time is very important!
● If your GPS logger isn’t
triggered by the shutter,
make sure that the time on
the logger and the camera
are synced BEFORE flight.
● Think about how fast the
plane is flying....convert
that to error
©2016 PixElement | Confidential & Proprietary Information
N
Z
E
Position Error
2/20/2017
12
©2016 PixElement | Confidential & Proprietary Information
N
Z
E
Position Error
©2016 PixElement | Confidential & Proprietary Information
How does the software take all of this into account?
Include a text file during the upload with the following information
Photo_Name, Lat, Lon, Ht, Error X, Error Y, Error Z
©2016 PixElement | Confidential & Proprietary Information
Large Sensors
High Flying Heights $1,000,000
2/20/2017
13
©2016 PixElement | Confidential & Proprietary Information
DSLR
Medium Flying Heights$10,000
©2016 PixElement | Confidential & Proprietary Information
Short Focal Length
Low Flying Height$500-$1000
©2016 PixElement | Confidential & Proprietary Information
How to get 3D from Photos
2/20/2017
14
©2016 PixElement | Confidential & Proprietary Information
How to get 3D from Photos
Use Cases for Land Surveyors/Engineers
©2016 PixElement | Confidential & Proprietary Information
Rockville Quarry
2/20/2017
15
©2016 PixElement | Confidential & Proprietary Information
©2016 PixElement | Confidential & Proprietary Information
©2016 PixElement | Confidential & Proprietary Information
Rockville Quarry (Steve)
2/20/2017
16
©2016 PixElement | Confidential & Proprietary Information
Utah Quarry (Allan)
©2016 PixElement | Confidential & Proprietary Information
©2016 PixElement | Confidential & Proprietary Information
2/20/2017
17
©2016 PixElement | Confidential & Proprietary Information
Utah Quarry
©2016 PixElement | Confidential & Proprietary Information
Quarry (Steve)
©2016 PixElement | Confidential & Proprietary Information
Quarry (Steve)
2/20/2017
18
©2016 PixElement | Confidential & Proprietary Information
Quarry (Steve)
©2016 PixElement | Confidential & Proprietary Information
Quarry (Steve)
©2016 PixElement | Confidential & Proprietary Information
College Campus (WaldoAir)
2/20/2017
19
©2016 PixElement | Confidential & Proprietary Information
College Campus (WaldoAir )
©2016 PixElement | Confidential & Proprietary Information
Richmond (Tom Stiles)
©2016 PixElement | Confidential & Proprietary Information
Richmond
2/20/2017
20
Applications
Construction
Mining
Planning
Civil Engineering
©2016 PixElement | Confidential & Proprietary Information
Energy
Transportation
Utilities
Disaster Management
Photogrammetry: Then and Now
2/20/2017
21
©2016 PixElement | Confidential & Proprietary Information
Principles of
Photogrammetry
1. Object is stationary
1. Camera is moving
1. Overlap between
images
1. Scale (e.g. GNSS)
Image credit - Alnozom
Tiepoints
UMAPAV Corp. Confidential and Proprietary Information
3D
Surface
Known
X, Y, Z
Known
X, Y, Z
Unknown
X, Y, Z
Use Cases for Aerial Photographers
2/20/2017
22
Use Cases for Aerial Photographers
Use Cases for Aerial Photographers
Stereoplotte
rs
1. Object is stationary
1. Camera is moving
1. Overlap between
images
1. Scale (e.g. GNSS)
Image credit - Alnozom
©2016 PixElement | Confidential & Proprietary Information
2/20/2017
23
Softcopy
Photogrammet
ry
1. No more heavy
equipment training
1. Use existing
workstation
1. Still manually intensive
1. Need to wear those
funny 3D glasses Image credit - Cardinal Systems©2016 PixElement | Confidential & Proprietary Information
Multi-View
Stereo
1. Object is stationary
1. Camera is moving
1. Overlap between
images
1. Scale (e.g. GNSS)
Image credit - Clemson University©2016 PixElement | Confidential & Proprietary Information
Tiepoints
UMAPAV Corp. Confidential and Proprietary Information
3D
SurfaceAll Tie Point
Extraction Is Fully
Automated!
2/20/2017
24
Speed and Efficiency
Efficiency + Safety?How long do you spend at a
site collecting 3D data?
Are there instances where
you may not be safe while
working?
UMAPAV Corp. Confidential and Proprietary Information
Flight Times for Sites
Residential Topo
Construction Sites
Stockpiles Yards
Quarries
Landfills
UMAPAV Corp. Confidential and Proprietary Information
Any
guesses?
2/20/2017
25
Flight Times for Sites
Residential Topo
Construction Sites
Stockpiles Yards
Quarries
Landfills
UMAPAV Corp. Confidential and Proprietary Information
8 minutes
12 minutes
20 minutes
35 minutes
65 minutes
Surveying Applications
Applications
Topographic Surveying
Stockpile/Volume Measurements
Utility/Transmission Line Measurements
Road Construction
Transportation Corridors
Roof Inspections
Crime Scene Investigation
UMAPAV Corp. Confidential and Proprietary Information
2/20/2017
26
Topographic Data Collection
UMAPAV Corp. Confidential and Proprietary Information
UMAPAV Corp. Confidential and Proprietary Information
2/20/2017
27
Stockpile Volume Measurement
Applications
UMAPAV Corp. Confidential and Proprietary Information
How would
measure a
site like this?
Applications
UMAPAV Corp. Confidential and Proprietary Information
How would
measure a
site like this?
2/20/2017
28
Standard
Workflow
- Feature Detection
- Feature Matching
- SFM/Bundle
Adjustment
- Densification
- Surface Generation
- Orthophoto
Generation
Sparse
Dense
Surface
/ TIN
TIN/Surface
Generation
Mesh - Sample facets
individually
Convert to grid/raster
Sample Mesh
Weighted
Sum of
vertices
s= u*A + v*B + w*C
Select Polygon
(Mapview)
Define a convex hull.
Each pixel/vertex defines
that X,Y,Z
Extract all pixel elements
within polygon
2/20/2017
29
Quarries, the
inverse of
stockpiles
Accuracy vs
Conventional
Methods
Delaunay Triangulation
Constrained Delaunay
Triangulation
Lowest surface?
Laser Scanning Photogrammetry
Volume Estimate
(Plane)
16126 16119
Volume Estimate
(Delaunay)
16126 15676.86
Photogrammetry
- Faster
- 97% accuracy
(who’s right?)
- Overhead perspective
Utility/Transmission
2/20/2017
30
Dense 3D point clouds of wires, vegetation, ground surface
- Common data product utilized in T-Line measurement and modeling
- Horizontal Precision
Vertical Precision
2/20/2017
31
Proving the Accuracy: Catenary Fitting
Each transmission line can be geometrically described as a 2D curve, but placed in 3D space.
Horizontally it is a line: y = a∙x+b
a, b = parameters of the line
x, y = horizontal coordinates
Vertically it is a catenary: 2D curve representing wire sag
z = cos(u/s)
where s = catenary parameter
z = height
u = point coordinates along wire
Vertical
Horizontal
Proving the Accuracy: Catenary Fitting
Accuracy dependant on flying
height
- 0.1 ft RMSE (absolute)
- 0.05 - 0.1 ft (relative)
Like Lidar, Ground Control
Points can be used
- improve the absolute
accuracy of the 3D model
Wire L1 L2 L3 U1 U2
Horizontal
RMSE [cm] 8.5 8.5 8.6 8.2 8.4
Azimuth [°] -47.1291 -47.1271 -47.1286 -47.0985 -46.7505
Azimuth
RMSE [“] 2.7 3.2 2.6 3.4 6.5
Vertical
RMSE [cm] 5 5.2 4.9 5.9 7.7
s [m] 1397.1 1413.2 1422.3 1789.7 1242.4
s RMSE [m] 0.24 0.35 0.28 0.9 23.21
Asset Monitoring / Management
- Collect high resolution
imagery of T-Line
structures
- Examine for
- Damages
- As-Built Fly-Throughs
- Preliminary cost
estimates for site
design
- Cut
- Fill
- Etc
2/20/2017
32
Accuracy
What affects the accuracy?
Flying height
Photogrammetric block
Ground control
Air control
Sensor Quality/Calibration
UMAPAV Corp. Confidential and Proprietary Information
Flying Height
2/20/2017
33
Flying Height +
Sensor Width
The higher the flying
height, the lesser the
accuracy/precision
Image Block
Photogrammetric
Block
Convergence Angle
Multiple Camera Views
Overlap + Sidelap
Strong Geometry
2/20/2017
34
Photogrammetric
Block
1. Irregular Flight
Coverage
2. Ascending Photos
a. High correlation
between parameters
b. Poor geometry
c. Overlap
Weak Geometry
Camera
Trajectory
3D Ground Scene
Georeferencing
(Ground Control)
Air Control
Dual Frequency GNSS
Receiver
- On the drone
- Camera Position (WGS84)
2/20/2017
35
Georeferencing
(Ground Control)
Ground
Control
Targets in the image
that are observed
with high accuracy
X, Y, Z
dX,dY, dZ
Estimated Surface
True Surface (w/ GCPs
Ground
Control
Good - Pixel
measurements are
incorporated into the
Bundle Adjustment
Bad - Point cloud is
fit to the ground
control points
X, Y, Z
dX,dY, dZ
- - - Estimated Surface
True Surface (w/ GCPs
2/20/2017
36
Ground
Control
“Bowing Effect”
- Transmission Line
- Ground Control Points
are the “Posts”
X, Y, Z
dX,dY, dZ
- - - Estimated Surface
True Surface (w/ GCPs
“Bow Effect”
(Poor Camera/Lens)
Ground
Control
“Bowing Effect”
You CANNOT and
SHOULD NOT solely
use “On-The-Fly”
Self-Calibration
Camera Calibration
2/20/2017
37
Camera
Calibration
Lenses/Cameras
have errors that
need to be
corrected
Self-Calibration vs Lab-
Calibration“I don’t need to calibrate my camera”
Sensor Quality
Sensor Quality
- The larger the
pixel, the better
the sampling\
- More dynamic
images result in
more accurate
point clouds
2/20/2017
38
New Frontier for Mapping
(In the Cloud)
Cloud Based
Mapping/Photogrammetry
Desktop vs Cloud-based
What are the benefits?
UMAPAV Corp. Confidential and Proprietary Information
User Interface
2/20/2017
39
Orthomosaic
(Mapview)
Drape imagery and
interact.
Line / Feature /
Polygon
Extraction
Extract actionable
information from imagery.
Create accurate maps at
scale in record time.
Point Cloud
Display
Visualize.
Exploit.
Measure.
2/20/2017
40
Looking for Big Data Opportunities
Create
- No more licenses of beefy
workstations
Share
- No more mailing hard drives.
Collaborate
- No disconnected workflows.
Bigger Picture
UMAPAV Corp. Confidential and Proprietary Information
©2016 PixElement | Confidential & Proprietary Information
What will you do with your imagery?
www.pixelement.com
(p.s. It’s free right now! )
2/20/2017
41
Questions?
Roofing
Roof Metrics
Ridges = 54’
Valley = 36’
Hips = 0’
Eaves = 224’
2/20/2017
42
Total Area + Facets
Facets - 10
Total Area -
(More than my house)
UMAPAV Corp. Confidential and Proprietary Information
Shingle Scale > Roof Scale
Orthophoto
Generation
- Tile based approach
doesn’t always work
- Sample pixels
individually?
- Blending without
seams
Tile
2/20/2017
43
Error
Propagation?
Error Factors to
Consider
1. Photogrammetric
Reconstruction (Surface
Height)
Simple Case of Error Propagation
1. Error only associated with vertical estimation
(z) estimation of the 3D surface
1. How accurate is the z measurement?
a. Function of GSD
True Surface
Formula - GSD * GSD * Error (2*GSD)
Error
Propagation?
Error Factors to
Consider
1. Surface Height
2. Base Height
True Surface
Estimated Base Surface
More Complicated
1. Error associated with vertical
estimation (z) estimation of the
3D surface
1. Error associated with vertical
estimation (z) estimation of the
3D base
Error
Propagation?
Error Factors to
Consider
1. Surface Height
2. Base Height
3. Horizontal (X,Y)
True Surface
More Complicated
1. Estimates ?
2. Estimate error with plane base surface?
3. Estimate error in unit weight
What about unit weight?
2/20/2017
44
Intro : Why are we here?
Why am i
learning about
drones at a
surveying
conference?
1. Fly Drones?
1. Have Fun?
1. Spy on our neighbors?
1. Collect Dense, Accurate 3D Data
with unprecedented speed
What are drones
not going to
do? 1. Boundaries
1. ALTA
1. Control Networks
1. Appear in Court as an expert witness
1. Collect Dense, Accurate 3D Data
with unprecedented speed
2/20/2017
45
THANKS FOR YOUR TIME!