science data systems for satellite and airborne lidar data aka – nasa lidar access system (nlas)...
TRANSCRIPT
Science Data Systems for Satellite and Airborne LiDAR DataAKA – NASA LiDAR Access System (NLAS)
NASA ROSES Access project
Chuck MeertensChris CrosbyJeff McWhirter
Siri Jodha Singh KhalsaMike ZuckerBob Stockwell
Chaitan Baru Minh Phan,Vishu Nandigam
Bryan BlairMichelle HoftonDavid HardingClaudia Carabajal
OpenTopography booth
IN31A-1499. Wednesday morning poster session. Increasing the Impact of High-Resolution Lidar Topography Through Online Data Access and ProcessingChristopher J. Crosby, et. al.
IN41C-1632. Thursday morning poster sessionRich Support for Heterogeneous Polar Data in RAMADDAJeff McWhirter, et. al.
More Information
NLAS Objectives
• Integrated and simplified access to existing LiDAR data archives– Airborne (OpenTopography)– Terrestrial (UNAVCO & OpenTopography)– Large footprint airborne (NASA LVIS)– Satellite (NASA GLAS (ICESat) at NSIDC)
• Provide users access to point cloud LiDAR data, on-demand digital elevation models (DEMs) generation, and derivative products.
• Define enhanced quality control (QC) metrics data formats for IceSAT/GLAS data.
-2313174.974,-3717949.974,4622885.034,4,4,4,1166-2313175.009,-3717949.961,4622885.028,2,2,2,1799-2313175.001,-3717950.058,4622884.669,2,2,2,1196-2313175.012,-3717949.889,4622884.824,4,4,4,2659
44882.2501 83.394029 302.947372 21.9063 .0003646 .0018514 9.22 260 0 109. 1 44882.2501 83.394876 302.937145 22.4024 .0018851 .0008321 23.13 349 5 -52. 3 44882.5001 83.394258 302.948768 22.0837 .0034534 .0006233 11.47 244 5 109. 1 44882.5001 83.395109 302.938469 22.1232 .0020132 -.0086983 28.39 346 2 -54. 3 44882.7501 83.394491 302.950113 21.7597 -.0048649 .0073749 12.28 244 0 107. 1
64.02431712 -41.93081856 50825.580082 0.0 1141.57328053 264.025238415 -41.929758005 50826.655015 0.0 1138.42328053 264.025546193 -41.9294137367 50827.013328 0.0 1125.4192999 2LAT LON TIME THICK
-80.799058 -93.513982 62726.2582 NaN-80.799646 -93.515586 62726.5665 NaN-80.800232 -93.517186 62726.8740 NaN
#YY MM DD hh mm DEPTH OTMP COND SAL O2% O2PPM CLCON TURB PH EH#yr mo dy hr mn m degC mS/cm psu % ppm ug/l FTU - mv2012 01 01 00 00 1.0 20.70 999.00 35.30 999.0 99.00 999.00 99 99.00 99.002012 01 01 01 00 1.0 20.70 999.00 35.30 999.0 99.00 999.00 99 99.00 99.00
Freshwater Switchyard of the Arctic Ocean 2005 Helicopter CTD ProfileCast 1 Station Alpha 29 April 2005 0829 UTC 84 deg 00.26 min North 65 deg 03.11 min West In situ Potential Depth Pres Temp Temp Cond Salinity Sigma (m) (dbar) (degC) (degC) (S/m) (psu) -theta# 3.196 3.220 -1.7430 -1.7430 2.52405 31.7839 25.5652
# data_fields: site year month day hour value unc n flag intake_ht instBRW 1973 01 01 00 -999.990 -99.990 0 I.. 0.00 N/ABRW 1973 01 01 01 -999.990 -99.990 0 I.. 0.00 N/ABRW 1973 01 01 02 -999.990 -99.990 0 I.. 0.00 N/A
Year: 2011 Month: 01 ID: BAL ARGOS: 9116 Name: Baldrick Lat: 82.78S Lon: 13.06W Elev: 1968m2011 1 1 1 0000 -18.1 765.3 3.7 281.0 83.8 444.02011 1 1 1 0300 -20.4 765.6 2.6 326.0 80.3 444.0#WOA09 JANUARY temperature Statistical mean
#COMMA SEPARATED LATITUDE, LONGITUDE, AND VALUES AT DEPTHS (M):0,5,10,15,20,25,30,35,40,45,50,55,60,65,70,75,80,85,90,95,100,125,150,175,200,225,250,275,300,325,350,375,400,425,450,475,500,550,600,650,700,750,800,850,900,950,1000,1050,1100,1150,1200,1250,1300,1350,1400,1450,150059.500,-179.500,2.799,2.808,2.816,2.826,2.834,2.833,2.830,2.827,2.824,2.820,2.813,2.802,2.786,2.768,2.734,2.680,2.641,2.608,2.574,2.523,2.526,2.534,2.491,2.588,2.576,3.051,3.419,3.683,3.766,3.781,3.768,3.737,3.727,3.696,3.668,3.643,3.615,3.549,3.476,3.405,3.333,3.253,3.180,3.110,3.041,2.957,,,,,,,,,,,
"TOA5","CapeBird","CR1000","38966","CR1000.Std.22","CPU:newawsFWv31_CB.CR1","42171","OutCard""TIMESTAMP","RECORD","TavgUpper","T_RTD","TavgLower","T_RTDLower","presRead","T_HMP","U_HMP","wspd_avg","wspd_res","wdir_res","wdir_std","maxws","wdirMaxWspd","TpanelAvg","solarAvg","wspdRead","wdirRead","T_panel","RawDist","SignalQuality","Dist","battVolt","Pres_us","Temp_us""TS","RN","","","","","","","","","","","","","","","","","","","","","","","","""","","Smp","Smp","Smp","Smp","Smp","Smp","Smp","Smp","Smp","Smp","Smp","Smp","Smp","Smp","Smp","Smp","Smp","Smp","Smp","Smp","Smp","Smp","Smp","Smp""2011-12-02 00:20:00",0,-3.262555,-3.313211,0,0,367.8989,-2.904,80.1,2.98,2.943,242,8.77,3.704,249.6,-0.492,0,2.911,231.6,-0.522,2.534,202,2.519,13.13,30.18693,5.819439
PBO Station Position Time Series. Reference Frame : IGS08Format Version,1.0.44-character ID,P101Station name,RandolphLLUT2005Begin Date, 2005-09-03End Date, 2012-09-29Release Date, 2012-09-30Reference position, 41.6922736024 North Latitude, -111.2360162488 East Longitude, 2016.12225 meters elevation,Date, North (mm), East (mm), Vertical (mm), North Std. Deviation (mm), East Std. Deviation (mm), Vertical Std. Deviation (mm), Quality,2005-09-03,22.68, 42.87, 15.8, 1.5, 1.31, 5.23, final,
An “Information-Centric” approach – Moves us from managing “documents” to managing discrete pieces of open data and
A “Shared Platform” approach –… to reduce costs, streamline development, apply consistent standards, and ensure consistency in how we create and deliver information.
A “Customer-Centric” approach – Influences how we create, manage, and present data through websites, mobile applications, raw data sets, and other modes of delivery.
1 DATA AS A SERVICE (DAAS).
DaaS is clearly a common denominator and should be emphasized in program opportunities within the next two years. The goals are to provide on-demand data sharing through discovery, access, transportation, and delivery to the end user. … this should be viewed, managed, and implemented according to system engineering best practices to ensure openness and platform independence.
LiDAR Data
Terrestrial LiDAR ScanningTLS
100-500 million points/daytripod1 cm footprint
Satellite - Icesat
~500 thousand points/day600 km altitude70 m footprint Airborne - LVIS
5 million points/day10 km altitude10 m footprint
Consolidation of parameters from 8 GLA product files•Eliminating numerous redundant, invalid and unused parameters•Producing a single data record for each laser shotSelection of subsets from full ICESat GLA product files•Currently ~160 unique parameters in products•NLAS/GLANL 100 parameters in “long” subset for advanced users•NLAS/GLANL 18 parameters in “short” subset for casual usersDefinition of 25 additional derived parameters for improved ease of use•e.g., Conversion of waveform-derived relative range offsets to elevations Definition of 6 QA/QC parameters to guide selection of appropriate data •Source of return: Earth surface, cloud, noise, indeterminate•Cause when no geolocation result reported: no return detected, instrument anomaly•Non-nadir data acquired during spacecraft maneuver•Possible presence of forward scattering range delay•Qualitative range precision assessment from S/N and signal fitting residual•Data reliability: composite yes/no flag for 8 parameters effecting quality
ICESat Consolidated and Enhanced Altimetry Data
Open Topography
NLAS Web Service
NSIDC
UNAVCO
Collection queries (ATOM)
Data access- subset, aggregation, etc
RAMADDA• Data repository framework
– Freely available Java open source package– Extensible plugin architecture
• Basic content management functionality:– Create, Read, Update, Delete (CRUD)
• Access control, rich metadata, search, etc.
• Numerous output formats: RSS / ATOM, DIFF, KML, etc.
NLAS Interoperabilty
NLAS/RAMADDA
Open Topography Visualization/Analysis Clients
NLAS Web Service
HTML Interface
NLAS Web Service
RAMADDA Point Services Stack
LVIS IceSAT
Discrete observation data model – aggregation, subset, filtering, conversion, products
File reading framework Code generation, binary records, text formats
Data ingestMetadata
harvest
Browse, charting, mapping
NLAS data API
ATM Paris TLSMcORDS
NLAS tools – conversion, tiling
Other Point FormatsAmeriflux flux towerAntarctic Meteorology Research Center (AMRC) AWS Greenland GC-NET met dataUNAVCO PBO position time seriesNOAA GMD carbon observatory and towerNOAA climate indicesCF-NetCDF point and track dataOceanographic data – Seabird CNV, glider, buoy, etcHydrology – WaterMLEtc…
UNAVCO TLS Field Project Archive
NASA’s ABoVE Project
NSF EarthCube
IRIS Simple Web Services Building Block Project
Demo