imagery management and accessibility in ... - esri canada · terminology •raster format...

Imagery Management and

Accessibility in ArcGIS Pro and

ArcGIS Excalibur

Adam Tomlin and Justine Woulfe

Agenda

• Introduction

• Managing Imagery

• Sharing Imagery

• Accessing Imagery

• Best Practices

• Questions

5 Key Imagery Capabilities of ArcGIS

Management

Map

ProductionAnalysis

Content

Visualization

& Exploitation

Terminology

• Raster format – defines how pixels are stored

- Ex. TIFF, MrSID, ECW, CRF

• Raster type – defines the metadata to be read and used for processing

- Ex. Raster Dataset, IKONOS, Table

• Raster function – on-the-fly processing of pixels

- Ex. NDVI

• Mosaic dataset – data model in a geodatabase for managing imagery

• Image service – data model for accessing mosaic datasets as a web service

Understanding Key Concepts

Image Management and Dissemination

ArcGIS Pro – Authoring of Mosaic Datasets

Extensive tools for Image Management

• ArcGIS Image Server – Scaling Imagery On Premises and Cloud

• Imagery Hosting

• Dynamic Image Services

• Raster Analytics

• Ortho Mapping

Making Imagery Accessible

A System of Record for Imagery

Justine Woulfe

Managing Imagery

Image ManagementAnd so much more…

Image Management Using Mosaic DatasetsArcGIS Imagery Information Model

• Supports multiple raster sources

• Supports many raster formats

• Maintains image quality

• Handles overlap and disparate datasets

• Supports over 50 sensor types

• Supports Image Services

Aerial

Satellite

Scanned Maps

Elevation

LiDAR

Imagery

Categorical

Drone

What is a Mosaic Dataset?

• A Catalog:

- References Imagery

- Associated metadata

- Processing functions can be applied

• Stored in Geodatabase

• Created using ArcGIS for Desktop

• Provides:

- Dynamic Mosaicking

- On-the-fly processing

ArcGIS Imagery Information Model

Highly scalable… from small to large volumes of imagery

Creating a Mosaic Dataset in ArcGIS Pro

1. Create Geodatabase (File or Enterprise)

2. Create Mosaic Dataset

3. Add Rasters

4. Generate Overviews (optional)

A brief summary

Add Rasters

• Specify parameters

• Crawls for imagery according

to the raster type

• Defines the initial processing

Adding data to your mosaic dataset

Supported Imagery

• Format: TIFF, JPEG, JPEG 2000, MRF, CRF, IMAGINE, NITF, netCDF, HDR, GRIB,

MrSID…

• Data Structure: Bands, Bits, Tiling, Pyramids, NoData

• Compression: Lossless, Lossy, Limited Error

• Georeferencing: Spatial reference systems

• Metadata: Acquisition Date, Color Map, Source, Copyright, Band wavelengths

Supports over 50 sensor types!

Overviews

• Like pyramids for a Mosaic Dataset

• Used for faster display at smaller scales (when zoomed out)

• Optional - if not created, imagery may not appear when zoomed out

• May also consider adding smaller scale imagery

Why can’t I see my data?

Adam Tomlin

Creating and

Configuring a

Mosaic Dataset

Mosaic Dataset Properties

• General

- General properties relating to

the data structure (number of

bands, bit depth)

- Source Type: Generic →Processed

• Defaults

- Direct the use of a Mosaic

Dataset when Published

- Sets some limits on Publishing

From the Catalog Pane

Mosaic Dataset Processing

• Initial Raster Function Chain defined by Raster Type

• Apply additional processing

a) To items in mosaic dataset

b) By adding to raster function

chain

c) By attaching to mosaic dataset

• Persists when shared

For easy and efficient visualization and exploration

What are Raster Functions?

Operations that apply processing directly to

the pixels of imagery and raster datasets

• No new dataset created

• Fast and efficient; processing on-the-fly

• Easily view and edit raster function history

• Create and use custom raster functions

• Save sets of raster functions as templates

• String processes together for complex

modeling

• Generate and share processing templates for

image services

Image processing instructions

New functions in Pro 2.4

Euclidean back direction

Flow length

Sink

Snap pour point

Stream order

Cost path as polyline

Adam Tomlin

Adding Raster

Functions to a

Mosaic Dataset

Justine Woulfe

Sharing Imagery

What is ArcGIS Image Server?

• Part of ArcGIS Enterprise

• Serves large collection of data for analytical processing

• Allows users to assemble, process, analyze and

manage large collection of imagery

The Enterprise solution to imagery sharing

Source images Mosaic dataset

Image service

ArcGIS Image Server

ArcGIS Image Server

• Dynamic image services

- Web accessible imagery which can have processing applied on-the-fly

• Raster Analytics

- Quickly process and persist data to create new information products

• Ortho mapping

- Processing of satellite, aerial or drone imagery into digital elevation models and

ortho mosaics

• Imagery hosting

- Enables users within organization to upload imagery into ArcGIS Enterprise and

serve it as dynamic imagery layers

Key Capabilities

ArcGIS Image Server

• An Image Service is the primary information model for imagery on ArcGIS Online

- Single Images

- Large collections via mosaic datasets

• Puts valuable imagery to use quickly

• Serves multiple views using the original imagery

• Access the records that make up the mosaic dataset

• Can be used to perform on-the-fly image processing and explore temporal changes

What is an image service?

Sharing imagery from ArcGIS Pro

• Must invoke the wizard from Catalog pane -

not Contents pane

• Share by Reference or Share by Value

• Define processing to be applied by the

server

• Option to allow downloads

• Can enable WMS (Web Map Service) and

WCS (Web Coverage Service) capabilities

• Can publish to ArcGIS Online, Portal and

standalone ArcGIS Server (new feature of

ArcGIS Pro 2.4)

How to publish an image service

Adam Tomlin

Publishing an

Image Service from

ArcGIS Pro

Justine Woulfe

Using Imagery

Image Visualization and Exploitation

ArcGIS Pro

• ArcGIS Image Analyst

- Image Space, Mensuration

- Stereo

- Motion Video

- Oriented Imagery

• Web

- ArcGIS Excalibur

- Map Viewer – Imagery features

- Image Configurable Apps (Image Viewer / Mask / Visit)

- WABIS – WebAppBuilder Widgets for Image Services

- Oriented Imagery

• Mobile

- Focused Apps

Integrating imagery into dynamic applications to aid understanding

ArcGIS Excalibur

• For: Analysts, Imagery Specialists, and Imagery/GIS

Managers

• Who: Need to discover, analyze, and report information

derived from imagery analysis or exploitation.

• The Solution: a cloud-based application

• That Provides: a simple and intuitive design to search

for and work with imagery and reference data in a

project-based experience. The results are shared in

dynamic information products across your organization.

What is it?

ArcGIS Excalibur is an intuitive project-based image analytics and exploitation

web application.

What is Required for ArcGIS Excalibur?System Components

Base ArcGIS Enterprise 10.7 or above Deployment

+ +

ArcGIS Image Server

ArcGIS Excalibur (separate Installer + separate license per

user)

ArcGIS Excalibur

• Image Management

- Interactive search and discovery

- Simplified access to imagery through

numerous experiences

- User defined search settings to refine

results

• Imagery Projects

- Focused workflows to organize and

accomplish image-based tasks

Image Management

Query, locate and find imagery quickly

Imagery ProjectsOrganized, Task Based Workflows

Focused Experiences

Imagery Derived Products

ExploitationOn-the-Fly Processing

Dynamic Visualization

Multi-View Oblique Imagery

“Image Space” Support

Image ManagementInteractive Search and Discovery

Simplified Access to Imagery

Interactive Briefing Products

Traceable Analytic Assessments

Dynamic Analysis Layers

ArcGIS Excalibur

• Exploitation

- Tools for on-the-fly processing

- Side-by-side visualization of oblique and

orthorectified imagery

- Image annotations automatically and

accurately transformed to geographic

features

• Imagery Derived Products

- Create products for interactive briefings or

web applications

Image Utilization

Query, locate and find imagery quickly

Imagery ProjectsOrganized, Task Based Workflows

Focused Experiences

Imagery Derived Products

ExploitationOn-the-Fly Processing

Dynamic Visualization

Multi-View Oblique Imagery

“Image Space” Support

Image ManagementInteractive Search and Discovery

Simplified Access to Imagery

Interactive Briefing Products

Traceable Analytic Assessments

Dynamic Analysis Layers

Adam Tomlin

ArcGIS Excalibur

Demonstration

Configurable Apps

• Imagery Web Apps provide:

- Functionality, polish and context beyond the basic Map Viewer

- Basic tools for interacting with imagery

- Ease of use with configurable apps and widgets; customization options with

Web AppBuilder and JavaScript API

- Easy access from any web-enabled device

For Imagery

Web AppBuilder (Core)

Web AppBuilder (Developer Edition)

MoreCustomization

Easier to implement

Configurable app templates

JavaScript API

(3.x or 4.x)

Configurable App Templates

• Imagery Viewer

- Visualize and interpret imagery layers

through time and space

• Image Mask

- Calculate and visualize change between

two images

- Highlight an area of interest that meets a

user-defined threshold for common

spectral indices

• Image Visit

- Review attributes for a predetermined

sequence of locations

Designed for Imagery

Extract meaning from imagery

Justine Woulfe

Best Practices

Best Practices…are data specific!

• Imagery Workflows website has best practices and recommended workflows

AerialSatellite

Scanned MapsElevation LiDARImagery Categorical

Dronehttps://doc.arcgis.com/en/imagery/workflows/

Best Practices for Managing ImageryStoring source images and data

• Store each collection of image files in a separate directory

• Try to keep the number of files per directory under 1,000

• One mosaic dataset per geodatabase, or at least a small number of them

• Store metadata files in the same directory as your data

• Use a consistent naming convention

Best Practices for Managing ImageryPre-processing and preparation

• Build pyramids for source images

• Identify NoData values

• Familiarize yourself with your data

• Verify the units of measurement

Best Practices for Managing ImageryCreating and Improving Mosaic Datasets

• Default values are your friends!

• Set the appropriate raster type

• Pay attention to metadata

• Use a mask or build footprints to clip the data

- Use Radiometry option OR Geometry option + clip to mask

Best Practices for Managing ImageryCreating and Publishing Image Services

• Publish using share by reference method (instead of copying data to server)

• Caching is recommended for services which will serve as basemap imagery

• Suggest to cache services that were published with low performing or highly

compressed formats

Summary

• Mosaic Dataset

- Primary information model to manage imagery

- Supports dynamic mosaicking and on-the-fly processing

- Can be configured to fit your data

- Can be accessed across the ArcGIS platform when shared as a web service

• ArcGIS Image Server

• dynamic image services

• ArcGIS Online or Portal

• make imagery accessible

• Use best practices specific to your data

Questions?

Adam Tomlin Justine Woulfe

atomlin@esri.ca jwoulfe@esri.ca

Session Rating

© 2019 Esri Canada Limited. All rights reserved. Trademarks for Esri products are provided under license from Environmental Systems Research Institute, Inc. Other product & company names mentioned

herein may be trademarks or registered trademarks of their respective owners. Errors & omissions excepted. Esri materials are copyrighted. Please request permission to use software, images or text.

Which Font Should You Use For Your Presentation?

Arial

Please use Arial at all times for your PowerPoint presentation.

Using Arial gives your PowerPoint presentation the flexibility to be used by many people on various

machines without the risk of font compatibility and changing the look of your layout.

Use of Arial Ensures…

Multiple users are able to view the font / Presentation distributed to others picks up the font

Presentation can be used on multiple computers

Did you know?

To quickly update any current presentation

Copy and paste your slides from your current deck into the newest template. The title and ending logo slide will

update automatically.

Videos not working?For video in PowerPoint, animated GIF is recommended. AVI and WMV (native PC files) will work best on a PC platform. H.264

MP4 will work only on PowerPoint 2013 and later.

Esri Corporate Template-Dark v3.4

16:9 version – January 29, 2017

Aspect Ratio Test

Esri Corporate Template-Dark v3.4

16:9 version – January 29, 2017

If this shape does not appear as

a perfect circle, adjust the aspect

ratio of your display until it does.

Try the resolution 1920x1080 for

16:9 displays.