using arcgis as a scientific data platform
TRANSCRIPT
![Page 1: Using ArcGIS as a Scientific Data Platform](https://reader031.vdocuments.mx/reader031/viewer/2022013005/58a2ce791a28ab32438bbffc/html5/thumbnails/1.jpg)
Copyright © Esri. All rights reserved.
Using ArcGIS as a Scient if ic Dat a Plat form
· Feroz Kadar Sudhir Raj Shrest ha
![Page 2: Using ArcGIS as a Scientific Data Platform](https://reader031.vdocuments.mx/reader031/viewer/2022013005/58a2ce791a28ab32438bbffc/html5/thumbnails/2.jpg)
Copyright © Esri. All rights reserved.
Topics· Introduction
· Ingesting and managing
· Visualizing and analyzing
· Disseminating and consuming
· The road ahead
![Page 3: Using ArcGIS as a Scientific Data Platform](https://reader031.vdocuments.mx/reader031/viewer/2022013005/58a2ce791a28ab32438bbffc/html5/thumbnails/3.jpg)
Copyright © Esri. All rights reserved.
Scient if ic Dat a
Oceanographic
• Salinity
• Sea Temperature
• Ocean current
Met eorological
• Temperature
• Humidity
• Wind speed/direction
Ter rest r ial
• Soil moisture
• NDVI
• Land cover
![Page 4: Using ArcGIS as a Scientific Data Platform](https://reader031.vdocuments.mx/reader031/viewer/2022013005/58a2ce791a28ab32438bbffc/html5/thumbnails/4.jpg)
Copyright © Esri. All rights reserved.
Challenges
variety of formats
volume & velocity
redundancy
portability
scalability
reproducibility
integration
standards
accessibility
Analyze ShareManage
![Page 5: Using ArcGIS as a Scientific Data Platform](https://reader031.vdocuments.mx/reader031/viewer/2022013005/58a2ce791a28ab32438bbffc/html5/thumbnails/5.jpg)
Copyright © Esri. All rights reserved.
Mult idim ensional Rast ers
Gridded
Multidimensional
Multivariate
![Page 6: Using ArcGIS as a Scientific Data Platform](https://reader031.vdocuments.mx/reader031/viewer/2022013005/58a2ce791a28ab32438bbffc/html5/thumbnails/6.jpg)
Copyright © Esri. All rights reserved.
Dem oUsing data & information products in a WebGIS
![Page 7: Using ArcGIS as a Scientific Data Platform](https://reader031.vdocuments.mx/reader031/viewer/2022013005/58a2ce791a28ab32438bbffc/html5/thumbnails/7.jpg)
Copyright © Esri. All rights reserved.
Ingest ing and Managing Dat a
![Page 8: Using ArcGIS as a Scientific Data Platform](https://reader031.vdocuments.mx/reader031/viewer/2022013005/58a2ce791a28ab32438bbffc/html5/thumbnails/8.jpg)
Copyright © Esri. All rights reserved.
Mult idim ensional Mosaic Dat aset
mosaic
table
raster pixels
Representing multivariate collection of multidimensional rasters in ArcGIS
m osaic dat aset
spa tia lly-indexed ca ta log
m ulti-re solu tion , m ultivaria te , m ultid im ensiona l
reduce storage redundancy & p ixe l re sam pling
defines in form ation products
on-dem and processing
HDF
GRIB
ne tCDF
d-aware raste rs
![Page 9: Using ArcGIS as a Scientific Data Platform](https://reader031.vdocuments.mx/reader031/viewer/2022013005/58a2ce791a28ab32438bbffc/html5/thumbnails/9.jpg)
Copyright © Esri. All rights reserved.
Tabular View
Tabular view of items in a multivariate multidimensional mosaic dataset
Raster Shape Variable StdTime StdZ
… … Temperature 3/22/2016 -10
… … Temperature 3/23/2016 -10
… … Temperature 3/24/2016 -10
… … Salinity 3/22/2016 -10
… … Salinity 3/23/2016 -10
… … Salinity 3/24/2016 -10
… … Temperature 3/22/2016 -20
… … Temperature 3/23/2016 -20
… … … … …
![Page 10: Using ArcGIS as a Scientific Data Platform](https://reader031.vdocuments.mx/reader031/viewer/2022013005/58a2ce791a28ab32438bbffc/html5/thumbnails/10.jpg)
Copyright © Esri. All rights reserved.
Met adat a
· Variables
· Dimensions
· Values
· Statistics
Describing the structure of a multivariate multidimensional mosaic dataset
![Page 11: Using ArcGIS as a Scientific Data Platform](https://reader031.vdocuments.mx/reader031/viewer/2022013005/58a2ce791a28ab32438bbffc/html5/thumbnails/11.jpg)
Copyright © Esri. All rights reserved.
Rast er Types
Format-agnostic direct ingestion of rasters into a mosaic dataset
rast er t ype
crawls disk
identifies rasters
extracts metadata
attaches processing
dat a on disk m osaic dat aset
netCDF
HDF
GRIB
d-aware raste rs
stores no p ixe ls
re fe rences raste rs
stores p rocessing & m etada ta
![Page 12: Using ArcGIS as a Scientific Data Platform](https://reader031.vdocuments.mx/reader031/viewer/2022013005/58a2ce791a28ab32438bbffc/html5/thumbnails/12.jpg)
Copyright © Esri. All rights reserved.
Geoprocessing
Managing a mosaic dataset
· Tools—building blocks for managing data
· Data Management ≻ Raste r ≻ Mosaic Datase t
· In tu itive UI for in te ractive workflows
· Mode lBuilde r: com posite opera tions
· Python : au tom ate or extend
![Page 13: Using ArcGIS as a Scientific Data Platform](https://reader031.vdocuments.mx/reader031/viewer/2022013005/58a2ce791a28ab32438bbffc/html5/thumbnails/13.jpg)
Copyright © Esri. All rights reserved.
Dem oMake a netCDF raster layer
![Page 14: Using ArcGIS as a Scientific Data Platform](https://reader031.vdocuments.mx/reader031/viewer/2022013005/58a2ce791a28ab32438bbffc/html5/thumbnails/14.jpg)
Copyright © Esri. All rights reserved.
Dem oMake a netCDF raster layer
Populate a mosaic dataset using a raster typeProperties of a multidimensional mosaic dataset
Attribute table of a mosaic layer
![Page 15: Using ArcGIS as a Scientific Data Platform](https://reader031.vdocuments.mx/reader031/viewer/2022013005/58a2ce791a28ab32438bbffc/html5/thumbnails/15.jpg)
Copyright © Esri. All rights reserved.
… On ArcGIS for Server
Make your mosaic dataset accessible to other users as a web-enabled dynamic image service
m osaic dat aset im age service
dynamic, on-demand
web-based access to data
rich information model
![Page 16: Using ArcGIS as a Scientific Data Platform](https://reader031.vdocuments.mx/reader031/viewer/2022013005/58a2ce791a28ab32438bbffc/html5/thumbnails/16.jpg)
Copyright © Esri. All rights reserved.
Visualizing and Analyzing
![Page 17: Using ArcGIS as a Scientific Data Platform](https://reader031.vdocuments.mx/reader031/viewer/2022013005/58a2ce791a28ab32438bbffc/html5/thumbnails/17.jpg)
Copyright © Esri. All rights reserved.
Fi l t er ing
slicing & dicing a multivariate multidimensional mosaic dataset
variables
value range(s) per dimension
SQL WHERE clause
dimension-orthogonal cutting & chopping
m ult idim ensional f i l t er
![Page 18: Using ArcGIS as a Scientific Data Platform](https://reader031.vdocuments.mx/reader031/viewer/2022013005/58a2ce791a28ab32438bbffc/html5/thumbnails/18.jpg)
Copyright © Esri. All rights reserved.
Fi l t er ing in ArcMap
net CDF rast er layer proper t ies
Select by Dim ension GP t ool
Mult idim ensional m osaic layer proper t ies
![Page 19: Using ArcGIS as a Scientific Data Platform](https://reader031.vdocuments.mx/reader031/viewer/2022013005/58a2ce791a28ab32438bbffc/html5/thumbnails/19.jpg)
Copyright © Esri. All rights reserved.
Render ing
![Page 20: Using ArcGIS as a Scientific Data Platform](https://reader031.vdocuments.mx/reader031/viewer/2022013005/58a2ce791a28ab32438bbffc/html5/thumbnails/20.jpg)
Copyright © Esri. All rights reserved.
Render ing
· Choose and customize
· Scalar or vector field
· Export and reuse
Control how original or transformed data is presented on a map
![Page 21: Using ArcGIS as a Scientific Data Platform](https://reader031.vdocuments.mx/reader031/viewer/2022013005/58a2ce791a28ab32438bbffc/html5/thumbnails/21.jpg)
Copyright © Esri. All rights reserved.
Dem oVector-field mosaic dataset
Multidimensional mosaic layer on mapDimensional slicing & animation
![Page 22: Using ArcGIS as a Scientific Data Platform](https://reader031.vdocuments.mx/reader031/viewer/2022013005/58a2ce791a28ab32438bbffc/html5/thumbnails/22.jpg)
Copyright © Esri. All rights reserved.
Dem oVector-field mosaic dataset
Multidimensional mosaic layer on mapDimensional slicing & animation
![Page 23: Using ArcGIS as a Scientific Data Platform](https://reader031.vdocuments.mx/reader031/viewer/2022013005/58a2ce791a28ab32438bbffc/html5/thumbnails/23.jpg)
Copyright © Esri. All rights reserved.
Tool-based Analyt ic Models
… using Geoprocessing
![Page 24: Using ArcGIS as a Scientific Data Platform](https://reader031.vdocuments.mx/reader031/viewer/2022013005/58a2ce791a28ab32438bbffc/html5/thumbnails/24.jpg)
Copyright © Esri. All rights reserved.
Transform ing Rast er Dat a
… using raster functions for on-the-fly processing
raster-valued transformation
piecewise, scale-aware
local / focal
on-demand processing
arity: unary, binary, …, n-a ry, polyadicinpu t raste rs
outpu t raste rrast er funct ion
![Page 25: Using ArcGIS as a Scientific Data Platform](https://reader031.vdocuments.mx/reader031/viewer/2022013005/58a2ce791a28ab32438bbffc/html5/thumbnails/25.jpg)
Copyright © Esri. All rights reserved.
Chaining Rast er Funct ions
… to compose a complex analytic model
![Page 26: Using ArcGIS as a Scientific Data Platform](https://reader031.vdocuments.mx/reader031/viewer/2022013005/58a2ce791a28ab32438bbffc/html5/thumbnails/26.jpg)
Copyright © Esri. All rights reserved.
Dem oApplying a simple transformation
![Page 27: Using ArcGIS as a Scientific Data Platform](https://reader031.vdocuments.mx/reader031/viewer/2022013005/58a2ce791a28ab32438bbffc/html5/thumbnails/27.jpg)
Copyright © Esri. All rights reserved.
Dim ensional Aggregat ion
Multidimensional filtering followed by aggregation using a raster function
dimensional
filtering
aggregating
function
![Page 28: Using ArcGIS as a Scientific Data Platform](https://reader031.vdocuments.mx/reader031/viewer/2022013005/58a2ce791a28ab32438bbffc/html5/thumbnails/28.jpg)
Copyright © Esri. All rights reserved.
Ext ending Analyt ic Capabil i t ies
Choose from dozens of built-in functions or implement your own algorithm using Python
Learn more at: github.com/Esri/rast er -funct ions
![Page 29: Using ArcGIS as a Scientific Data Platform](https://reader031.vdocuments.mx/reader031/viewer/2022013005/58a2ce791a28ab32438bbffc/html5/thumbnails/29.jpg)
Copyright © Esri. All rights reserved.
Rast er Models
A portable & reusable chain of raster functions
raster variables
![Page 30: Using ArcGIS as a Scientific Data Platform](https://reader031.vdocuments.mx/reader031/viewer/2022013005/58a2ce791a28ab32438bbffc/html5/thumbnails/30.jpg)
Copyright © Esri. All rights reserved.
Rast er Model: Grouping
![Page 31: Using ArcGIS as a Scientific Data Platform](https://reader031.vdocuments.mx/reader031/viewer/2022013005/58a2ce791a28ab32438bbffc/html5/thumbnails/31.jpg)
Copyright © Esri. All rights reserved.
Dem oCombining variables using a raster model
![Page 32: Using ArcGIS as a Scientific Data Platform](https://reader031.vdocuments.mx/reader031/viewer/2022013005/58a2ce791a28ab32438bbffc/html5/thumbnails/32.jpg)
Copyright © Esri. All rights reserved.
Dem oRaster models on a mosaic dataset
Aggregating temporal slicesDifference of means
![Page 33: Using ArcGIS as a Scientific Data Platform](https://reader031.vdocuments.mx/reader031/viewer/2022013005/58a2ce791a28ab32438bbffc/html5/thumbnails/33.jpg)
Copyright © Esri. All rights reserved.
Applying a Rast er Model
image service
mosaic dataset
mosaic dataset item(s)
image layer on a desktop map
choose & customize a raste r m ode l
im age se rvice layer on a web m ap
define & t ransmit a raste r m ode l
choose & customize a raste r m ode l
![Page 34: Using ArcGIS as a Scientific Data Platform](https://reader031.vdocuments.mx/reader031/viewer/2022013005/58a2ce791a28ab32438bbffc/html5/thumbnails/34.jpg)
Copyright © Esri. All rights reserved.
Dissem inat ing and Consum ing
![Page 35: Using ArcGIS as a Scientific Data Platform](https://reader031.vdocuments.mx/reader031/viewer/2022013005/58a2ce791a28ab32438bbffc/html5/thumbnails/35.jpg)
Copyright © Esri. All rights reserved.
Desk t op Web Device
Online Cont ent and
Services
Server
multivariate multidimensional m osaic dat aset
Dissem inat ing
professionalgeospatial analysts
![Page 36: Using ArcGIS as a Scientific Data Platform](https://reader031.vdocuments.mx/reader031/viewer/2022013005/58a2ce791a28ab32438bbffc/html5/thumbnails/36.jpg)
Copyright © Esri. All rights reserved.
Dissem inat ion St rat egies
· Tiled map service
· Dynamic map service
· Dynamic image service
![Page 37: Using ArcGIS as a Scientific Data Platform](https://reader031.vdocuments.mx/reader031/viewer/2022013005/58a2ce791a28ab32438bbffc/html5/thumbnails/37.jpg)
Copyright © Esri. All rights reserved.
Shar ing your dat a as an im age
· Mosaic Dataset ≻ Genera te Tile Cache
· Avoid copying source im age to ArcGIS Online
· Cache tile s gene ra ted using ArcGIS for Desktop
· Accessed via t i led m ap service
Enable access to a static representation of your data as a map service
![Page 38: Using ArcGIS as a Scientific Data Platform](https://reader031.vdocuments.mx/reader031/viewer/2022013005/58a2ce791a28ab32438bbffc/html5/thumbnails/38.jpg)
Copyright © Esri. All rights reserved.
Shar ing your m ap
· File ≻ Share As ≻ Service
· Fea tures ove rla id on raste rs
· Sta tic vs Dynam ic m ap se rvice
· Multid im ensiona l WMS
![Page 39: Using ArcGIS as a Scientific Data Platform](https://reader031.vdocuments.mx/reader031/viewer/2022013005/58a2ce791a28ab32438bbffc/html5/thumbnails/39.jpg)
Copyright © Esri. All rights reserved.
Shar ing dat a & inform at ion product s
· Mosaic Dataset ≻ Share As Im age Service
· Pixe ls & item m etada ta
· On-dem and se rve r-side p rocessing
· Raste r m ode ls: p rede fined or clien t-specified
· m ultid im ensiona l in fo , filte ring, vector fie lds
Enable access to a dynamic representation of your information product as an image service
![Page 40: Using ArcGIS as a Scientific Data Platform](https://reader031.vdocuments.mx/reader031/viewer/2022013005/58a2ce791a28ab32438bbffc/html5/thumbnails/40.jpg)
Copyright © Esri. All rights reserved.
Dem oPublishing a multidimensional mosaic dataset
![Page 41: Using ArcGIS as a Scientific Data Platform](https://reader031.vdocuments.mx/reader031/viewer/2022013005/58a2ce791a28ab32438bbffc/html5/thumbnails/41.jpg)
Copyright © Esri. All rights reserved.
Consum ing your services· In any ArcGIS application or any WMS client
· In a web map· Identify web services driven by maps or datasets· Bring service layers into a web map
· In a map-based application· Configurable apps· Story Maps· Web AppBuilder· Custom web apps using ArcGIS API for JavaScript
![Page 42: Using ArcGIS as a Scientific Data Platform](https://reader031.vdocuments.mx/reader031/viewer/2022013005/58a2ce791a28ab32438bbffc/html5/thumbnails/42.jpg)
Copyright © Esri. All rights reserved.
Maps & Apps
Office of Elect r icit y Delivery and Energy Reliabilit y, U.S. Department of EnergySea Level Rise and Storm Surge Effects on Energy Assets
![Page 43: Using ArcGIS as a Scientific Data Platform](https://reader031.vdocuments.mx/reader031/viewer/2022013005/58a2ce791a28ab32438bbffc/html5/thumbnails/43.jpg)
Copyright © Esri. All rights reserved.
Maps & Apps
Nat ional Energy Technology Laboratory, U.S. Department of EnergyStoryMap highlighting issues around induced seismicity
![Page 44: Using ArcGIS as a Scientific Data Platform](https://reader031.vdocuments.mx/reader031/viewer/2022013005/58a2ce791a28ab32438bbffc/html5/thumbnails/44.jpg)
Copyright © Esri. All rights reserved.
Maps & Apps
Chesapeake Bay Program and Region 3 of t he U.S. Environmental Protect ion Agencyhttp://gis.chesapeakebay.net/air
https://www.govloop.com/resources/story-mapping-chesapeake
![Page 45: Using ArcGIS as a Scientific Data Platform](https://reader031.vdocuments.mx/reader031/viewer/2022013005/58a2ce791a28ab32438bbffc/html5/thumbnails/45.jpg)
Copyright © Esri. All rights reserved.
Dem oUsing image service layers in ArcGIS Online map viewer
![Page 46: Using ArcGIS as a Scientific Data Platform](https://reader031.vdocuments.mx/reader031/viewer/2022013005/58a2ce791a28ab32438bbffc/html5/thumbnails/46.jpg)
Copyright © Esri. All rights reserved.
The Road Ahead· Python Raster Types: extensible data ingestion
· Raster processing models: on GitHub and out-of-the-box
· NetCDF, HDF, GRIB: as raster products, raster layer, image service
· Collection Processing: scalable transformation of large sets of rasters
· Raster Analytics: distributed analysis and processing of imagery or rasters in a Web GIS
… with ArcGIS 10.5
![Page 47: Using ArcGIS as a Scientific Data Platform](https://reader031.vdocuments.mx/reader031/viewer/2022013005/58a2ce791a28ab32438bbffc/html5/thumbnails/47.jpg)
Copyright © Esri. All rights reserved.
![Page 48: Using ArcGIS as a Scientific Data Platform](https://reader031.vdocuments.mx/reader031/viewer/2022013005/58a2ce791a28ab32438bbffc/html5/thumbnails/48.jpg)
Copyright © Esri. All rights reserved.
GIS work f lows t hat scale
Manage Analyze Share
mosaic dataset
raster types
geoprocessing tools
multidimensional filter
animation & rendering
raster functions
dynamic web services
web maps & apps
raster analytics
… built for the characteristics of multidimensional scientific data
![Page 49: Using ArcGIS as a Scientific Data Platform](https://reader031.vdocuments.mx/reader031/viewer/2022013005/58a2ce791a28ab32438bbffc/html5/thumbnails/49.jpg)
Copyright © Esri. All rights reserved.
Please t ake our SurveyYour feedback allows us to help maintain high standards and to help presenters
Find the session you want to review
Find your event in the Esr i Event s App
Scroll down to the bottom of the session
Answer survey questions and submit
![Page 50: Using ArcGIS as a Scientific Data Platform](https://reader031.vdocuments.mx/reader031/viewer/2022013005/58a2ce791a28ab32438bbffc/html5/thumbnails/50.jpg)