working smart with point cloud big data - ky association of … · working smart with point cloud...

41
Working Smart with Point Cloud BIG Data Demetrio P. Zourarakis, PhD, GISP (GISCI ) , CMS-GIS/LIS (ASPRS ) , CMS-RS (ASPRS ) GIS and Remote Sensing Analyst, DGI [email protected] 502-564-6246 http://gis.ky.gov KAMM ANNUAL CONFERENCE Wednesday August 24 th , 2016 Kentucky Dam Village State Resort Park Gilbertsville KY

Upload: dinhdiep

Post on 19-Apr-2018

220 views

Category:

Documents


4 download

TRANSCRIPT

Page 1: Working Smart with Point Cloud BIG Data - Ky Association of … · Working Smart with Point Cloud BIG Data Demetrio P. Zourarakis, PhD, GISP (GISCI ), CMS-GIS/LIS ASPRS, CMS-RS(ASPRS)

Working Smart with Point Cloud BIG Data

Demetrio P. Zourarakis, PhD, GISP(GISCI), CMS-GIS/LIS(ASPRS), CMS-RS(ASPRS)

GIS and Remote Sensing Analyst, [email protected]

502-564-6246http://gis.ky.gov

KAMM ANNUAL CONFERENCEWednesday August 24th, 2016

Kentucky Dam Village State Resort ParkGilbertsville KY

Page 2: Working Smart with Point Cloud BIG Data - Ky Association of … · Working Smart with Point Cloud BIG Data Demetrio P. Zourarakis, PhD, GISP (GISCI ), CMS-GIS/LIS ASPRS, CMS-RS(ASPRS)

Justification• Sensors proliferate!

– Laser altimetry/elevation (LiDAR)• Linear scanner: THIS PRESENTATION• Geiger Mode, photon counting, flash LiDAR, etc.

• Platforms proliferate!– Aerial

• Fixed wing• UAV/sUAS >>>>> THEIR OWN LAS, NON-LiDAR files...

– Satellite

• Software proliferates!– Commercial-Off-The-Shelf (COTS)– Open Source

• Standards proliferate!– LAS formats 1.1, 1.2, 1.4 and counting...– USGS’s QL for 3DEP

• Applications proliferate!– “Traditional” ones– New ones

Page 3: Working Smart with Point Cloud BIG Data - Ky Association of … · Working Smart with Point Cloud BIG Data Demetrio P. Zourarakis, PhD, GISP (GISCI ), CMS-GIS/LIS ASPRS, CMS-RS(ASPRS)

Outline

• DATA (examples)

• TOOLS (examples)

• PRELIMINARY RESULTS (examples)

• CONCLUSIONS

Page 4: Working Smart with Point Cloud BIG Data - Ky Association of … · Working Smart with Point Cloud BIG Data Demetrio P. Zourarakis, PhD, GISP (GISCI ), CMS-GIS/LIS ASPRS, CMS-RS(ASPRS)

Open Source Data• Clark County (KY) GIS:

http://www.ccgisonline.com/#!lidar/ci0q

Page 5: Working Smart with Point Cloud BIG Data - Ky Association of … · Working Smart with Point Cloud BIG Data Demetrio P. Zourarakis, PhD, GISP (GISCI ), CMS-GIS/LIS ASPRS, CMS-RS(ASPRS)

Open Source Data• Clark County (KY) GIS:

http://www.ccgisonline.com/#!lidar/ci0q

Page 6: Working Smart with Point Cloud BIG Data - Ky Association of … · Working Smart with Point Cloud BIG Data Demetrio P. Zourarakis, PhD, GISP (GISCI ), CMS-GIS/LIS ASPRS, CMS-RS(ASPRS)
Page 7: Working Smart with Point Cloud BIG Data - Ky Association of … · Working Smart with Point Cloud BIG Data Demetrio P. Zourarakis, PhD, GISP (GISCI ), CMS-GIS/LIS ASPRS, CMS-RS(ASPRS)

• Open Topography: http://www.opentopography.org/

Open Source Data (cont.)

Page 8: Working Smart with Point Cloud BIG Data - Ky Association of … · Working Smart with Point Cloud BIG Data Demetrio P. Zourarakis, PhD, GISP (GISCI ), CMS-GIS/LIS ASPRS, CMS-RS(ASPRS)

Open Source Data (cont.)• US Interagency Elevation Inventory:

https://coast.noaa.gov/inventory/

Page 9: Working Smart with Point Cloud BIG Data - Ky Association of … · Working Smart with Point Cloud BIG Data Demetrio P. Zourarakis, PhD, GISP (GISCI ), CMS-GIS/LIS ASPRS, CMS-RS(ASPRS)

Open Source Data (cont.)• USGS Earth Explorer:

https://earthexplorer.usgs.gov/

Page 10: Working Smart with Point Cloud BIG Data - Ky Association of … · Working Smart with Point Cloud BIG Data Demetrio P. Zourarakis, PhD, GISP (GISCI ), CMS-GIS/LIS ASPRS, CMS-RS(ASPRS)

Open Source Data (cont.)• USGS Earth Explorer:

https://earthexplorer.usgs.gov/

Page 11: Working Smart with Point Cloud BIG Data - Ky Association of … · Working Smart with Point Cloud BIG Data Demetrio P. Zourarakis, PhD, GISP (GISCI ), CMS-GIS/LIS ASPRS, CMS-RS(ASPRS)

Kentucky from Above!

The Kentucky Aerial Photography &

Elevation Data Program

(KYAPED)

Page 12: Working Smart with Point Cloud BIG Data - Ky Association of … · Working Smart with Point Cloud BIG Data Demetrio P. Zourarakis, PhD, GISP (GISCI ), CMS-GIS/LIS ASPRS, CMS-RS(ASPRS)

• Acquires current leaf-off color aerial photography for the entire

Commonwealth

• Acquires current elevation data for the entire Commonwealth

• Partners with entities at all levels of government (economies of

scale)

• Distributes data to state agencies and in the public domain

• Utilizes Kentucky-based firms for acquisition and control work

What is KY From Above?

A Program that . . .

Page 13: Working Smart with Point Cloud BIG Data - Ky Association of … · Working Smart with Point Cloud BIG Data Demetrio P. Zourarakis, PhD, GISP (GISCI ), CMS-GIS/LIS ASPRS, CMS-RS(ASPRS)

KY From Above Program Status

• 2012 – “Golden Triangle”

• 2013 – “Purchase”

• 2014 – “Western Kentucky”

• 2015 – “Central Kentucky”

• 2016 – “South Central Kentucky”

Data is available for download or via service for all acquisition

periods through 2016. Data acquired in 2016 should be available

before the end of the calendar year.

Page 14: Working Smart with Point Cloud BIG Data - Ky Association of … · Working Smart with Point Cloud BIG Data Demetrio P. Zourarakis, PhD, GISP (GISCI ), CMS-GIS/LIS ASPRS, CMS-RS(ASPRS)

Elevation Data Status

Page 15: Working Smart with Point Cloud BIG Data - Ky Association of … · Working Smart with Point Cloud BIG Data Demetrio P. Zourarakis, PhD, GISP (GISCI ), CMS-GIS/LIS ASPRS, CMS-RS(ASPRS)

Elevation Data Status

Page 16: Working Smart with Point Cloud BIG Data - Ky Association of … · Working Smart with Point Cloud BIG Data Demetrio P. Zourarakis, PhD, GISP (GISCI ), CMS-GIS/LIS ASPRS, CMS-RS(ASPRS)

2017 LiDAR Acquisition Plan

Page 17: Working Smart with Point Cloud BIG Data - Ky Association of … · Working Smart with Point Cloud BIG Data Demetrio P. Zourarakis, PhD, GISP (GISCI ), CMS-GIS/LIS ASPRS, CMS-RS(ASPRS)

Aerial Photography Status

Page 18: Working Smart with Point Cloud BIG Data - Ky Association of … · Working Smart with Point Cloud BIG Data Demetrio P. Zourarakis, PhD, GISP (GISCI ), CMS-GIS/LIS ASPRS, CMS-RS(ASPRS)

Website

http://kygeonet.ky.gov/kyfromabove/

Page 19: Working Smart with Point Cloud BIG Data - Ky Association of … · Working Smart with Point Cloud BIG Data Demetrio P. Zourarakis, PhD, GISP (GISCI ), CMS-GIS/LIS ASPRS, CMS-RS(ASPRS)

http://kyraster.ky.gov/arcgis/rest/services/ElevationServices

Page 20: Working Smart with Point Cloud BIG Data - Ky Association of … · Working Smart with Point Cloud BIG Data Demetrio P. Zourarakis, PhD, GISP (GISCI ), CMS-GIS/LIS ASPRS, CMS-RS(ASPRS)

Questions?

Kent Anness

Division of Geographic Information (DGI)

[email protected]

Website: http://kygeonet.ky.gov/kyfromabove/

Page 21: Working Smart with Point Cloud BIG Data - Ky Association of … · Working Smart with Point Cloud BIG Data Demetrio P. Zourarakis, PhD, GISP (GISCI ), CMS-GIS/LIS ASPRS, CMS-RS(ASPRS)

• Idaho LiDAR Consortium:

https://www.idaholidar.org/free-lidar-tools/

Open Source Software

Page 22: Working Smart with Point Cloud BIG Data - Ky Association of … · Working Smart with Point Cloud BIG Data Demetrio P. Zourarakis, PhD, GISP (GISCI ), CMS-GIS/LIS ASPRS, CMS-RS(ASPRS)

• Idaho LiDAR Consortium:

https://www.idaholidar.org/free-lidar-tools/

Open Source Software (cont.)

Page 23: Working Smart with Point Cloud BIG Data - Ky Association of … · Working Smart with Point Cloud BIG Data Demetrio P. Zourarakis, PhD, GISP (GISCI ), CMS-GIS/LIS ASPRS, CMS-RS(ASPRS)

• Rapid Lasso: https://rapidlasso.com/

Open Source Software (cont.)

Page 24: Working Smart with Point Cloud BIG Data - Ky Association of … · Working Smart with Point Cloud BIG Data Demetrio P. Zourarakis, PhD, GISP (GISCI ), CMS-GIS/LIS ASPRS, CMS-RS(ASPRS)

• RapidLasso Tools for QGIS: https://rapidlasso.com/2013/09/30/rapidlasso-adds-lastools-toolbox-to-qgis/

Open Source Software (cont.)

Page 25: Working Smart with Point Cloud BIG Data - Ky Association of … · Working Smart with Point Cloud BIG Data Demetrio P. Zourarakis, PhD, GISP (GISCI ), CMS-GIS/LIS ASPRS, CMS-RS(ASPRS)

• RapidLasso Tools for ArcGIS (pipelines)https://rapidlasso.com/2014/04/03/new-lastools-production-and-lastools-pipelines-for-arcgis/

Open Source Software (cont.)

Page 26: Working Smart with Point Cloud BIG Data - Ky Association of … · Working Smart with Point Cloud BIG Data Demetrio P. Zourarakis, PhD, GISP (GISCI ), CMS-GIS/LIS ASPRS, CMS-RS(ASPRS)

• Esri Tools – LAS Optimizer/Compressor (version 1.2.3):https://www.arcgis.com/home/item.html?id=787794cdbd384261bc9bf99a860a374f

Open Source Software (cont.)

Page 27: Working Smart with Point Cloud BIG Data - Ky Association of … · Working Smart with Point Cloud BIG Data Demetrio P. Zourarakis, PhD, GISP (GISCI ), CMS-GIS/LIS ASPRS, CMS-RS(ASPRS)

Commercial-Off-The-Shelf• LP360 (GeoQue): http://qcoherent.com/

– Viewer– Basic/Advanced

• ArcGIS for Desktop: http://esri.com– 3D Analyst – Spatial Analyst

*** LAS Dataset*** zLAS (Optimized LAS)*** Point to TIN/Raster Conversion Tools

• Others– Terrasolid– Bentley– AutoCAD– ERDAS Imagine– ENVI– etc. etc. etc.

Page 28: Working Smart with Point Cloud BIG Data - Ky Association of … · Working Smart with Point Cloud BIG Data Demetrio P. Zourarakis, PhD, GISP (GISCI ), CMS-GIS/LIS ASPRS, CMS-RS(ASPRS)
Page 29: Working Smart with Point Cloud BIG Data - Ky Association of … · Working Smart with Point Cloud BIG Data Demetrio P. Zourarakis, PhD, GISP (GISCI ), CMS-GIS/LIS ASPRS, CMS-RS(ASPRS)
Page 30: Working Smart with Point Cloud BIG Data - Ky Association of … · Working Smart with Point Cloud BIG Data Demetrio P. Zourarakis, PhD, GISP (GISCI ), CMS-GIS/LIS ASPRS, CMS-RS(ASPRS)

Intensity Image (1st Return – All Classes)

Page 31: Working Smart with Point Cloud BIG Data - Ky Association of … · Working Smart with Point Cloud BIG Data Demetrio P. Zourarakis, PhD, GISP (GISCI ), CMS-GIS/LIS ASPRS, CMS-RS(ASPRS)

Quality vs. (&!) Quantity

Page 32: Working Smart with Point Cloud BIG Data - Ky Association of … · Working Smart with Point Cloud BIG Data Demetrio P. Zourarakis, PhD, GISP (GISCI ), CMS-GIS/LIS ASPRS, CMS-RS(ASPRS)

KYAPED Elevation Data Status

Page 33: Working Smart with Point Cloud BIG Data - Ky Association of … · Working Smart with Point Cloud BIG Data Demetrio P. Zourarakis, PhD, GISP (GISCI ), CMS-GIS/LIS ASPRS, CMS-RS(ASPRS)

3DEP >> QL

https://pubs.usgs.gov/tm/11b4/pdf/tm11-B4.pdf

Page 34: Working Smart with Point Cloud BIG Data - Ky Association of … · Working Smart with Point Cloud BIG Data Demetrio P. Zourarakis, PhD, GISP (GISCI ), CMS-GIS/LIS ASPRS, CMS-RS(ASPRS)
Page 35: Working Smart with Point Cloud BIG Data - Ky Association of … · Working Smart with Point Cloud BIG Data Demetrio P. Zourarakis, PhD, GISP (GISCI ), CMS-GIS/LIS ASPRS, CMS-RS(ASPRS)

0.00

2.00

4.00

6.00

8.00

10.00

12.00

14.00

0.00 0.50 1.00 1.50 2.00 2.50

UN

CLA

SSIF

IED

(b

illio

ns

of

po

ints

)

GROUND + MODEL KEY (billions of points)

KYAPED LiDAR Point Class and 3DEP Quality Level

QL1

QL2

QL3

Page 36: Working Smart with Point Cloud BIG Data - Ky Association of … · Working Smart with Point Cloud BIG Data Demetrio P. Zourarakis, PhD, GISP (GISCI ), CMS-GIS/LIS ASPRS, CMS-RS(ASPRS)
Page 37: Working Smart with Point Cloud BIG Data - Ky Association of … · Working Smart with Point Cloud BIG Data Demetrio P. Zourarakis, PhD, GISP (GISCI ), CMS-GIS/LIS ASPRS, CMS-RS(ASPRS)

0.00

0.10

0.20

0.30

0.40

0.50

0.60

0.70

0.80

0.90

1.00

0 50,000 100,000 150,000 200,000 250,000 300,000 350,000 400,000 450,000

NO

MIN

AL

PO

INT

SPA

CIN

G (

m)

WEIGHTED CANOPY CLOSURE (Acres)

KYAPED LiDAR NPS and 2011 NLCD Canopy Closure (Weighted)

QL1

QL2

QL3

Page 38: Working Smart with Point Cloud BIG Data - Ky Association of … · Working Smart with Point Cloud BIG Data Demetrio P. Zourarakis, PhD, GISP (GISCI ), CMS-GIS/LIS ASPRS, CMS-RS(ASPRS)

0%

5%

10%

15%

20%

25%

30%

35%

40%

45%

0 50,000 100,000 150,000 200,000 250,000 300,000 350,000 400,000 450,000

PER

CEN

T U

NC

LASS

IFIE

D P

OIN

TS

WEIGHTED CANOPY CLOSURE (Acres)

KYAPED LiDAR Unclassified Points and 2011 NLCD Canopy Closure (Weighted)

QL1

QL2

QL3

Page 39: Working Smart with Point Cloud BIG Data - Ky Association of … · Working Smart with Point Cloud BIG Data Demetrio P. Zourarakis, PhD, GISP (GISCI ), CMS-GIS/LIS ASPRS, CMS-RS(ASPRS)

Conclusions

• Abundant sources and tools

(Some are free! Some are good!)

• KYAPED program seeks completion!

(with everyone’s help)

• Understanding Data Structure= one challenge

• Assessing Quality in Quantity: A Changing Landscape (Standards and Data)= another challenge

• Data Mining= an opportunity!

Page 40: Working Smart with Point Cloud BIG Data - Ky Association of … · Working Smart with Point Cloud BIG Data Demetrio P. Zourarakis, PhD, GISP (GISCI ), CMS-GIS/LIS ASPRS, CMS-RS(ASPRS)
Page 41: Working Smart with Point Cloud BIG Data - Ky Association of … · Working Smart with Point Cloud BIG Data Demetrio P. Zourarakis, PhD, GISP (GISCI ), CMS-GIS/LIS ASPRS, CMS-RS(ASPRS)

Thank You!Questions?

Demetrio P. Zourarakis [email protected]://gis.ky.gov502-564-6246