imagery management and accessibility in ... - esri canada · terminology •raster format...

46
Imagery Management and Accessibility in ArcGIS Pro and ArcGIS Excalibur Adam Tomlin and Justine Woulfe

Upload: others

Post on 13-May-2020

7 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Imagery Management and Accessibility in ... - Esri Canada · Terminology •Raster format –defines how pixels are stored-Ex. TIFF, MrSID, ECW, CRF•Raster type –defines the metadata

Imagery Management and

Accessibility in ArcGIS Pro and

ArcGIS Excalibur

Adam Tomlin and Justine Woulfe

Page 2: Imagery Management and Accessibility in ... - Esri Canada · Terminology •Raster format –defines how pixels are stored-Ex. TIFF, MrSID, ECW, CRF•Raster type –defines the metadata

Agenda

• Introduction

• Managing Imagery

• Sharing Imagery

• Accessing Imagery

• Best Practices

• Questions

Page 3: Imagery Management and Accessibility in ... - Esri Canada · Terminology •Raster format –defines how pixels are stored-Ex. TIFF, MrSID, ECW, CRF•Raster type –defines the metadata

5 Key Imagery Capabilities of ArcGIS

Management

Map

ProductionAnalysis

Content

Visualization

& Exploitation

Page 4: Imagery Management and Accessibility in ... - Esri Canada · Terminology •Raster format –defines how pixels are stored-Ex. TIFF, MrSID, ECW, CRF•Raster type –defines the metadata

Terminology

• Raster format – defines how pixels are stored

- Ex. TIFF, MrSID, ECW, CRF

• Raster type – defines the metadata to be read and used for processing

- Ex. Raster Dataset, IKONOS, Table

• Raster function – on-the-fly processing of pixels

- Ex. NDVI

• Mosaic dataset – data model in a geodatabase for managing imagery

• Image service – data model for accessing mosaic datasets as a web service

Understanding Key Concepts

Page 5: Imagery Management and Accessibility in ... - Esri Canada · Terminology •Raster format –defines how pixels are stored-Ex. TIFF, MrSID, ECW, CRF•Raster type –defines the metadata

Image Management and Dissemination

ArcGIS Pro – Authoring of Mosaic Datasets

Extensive tools for Image Management

• ArcGIS Image Server – Scaling Imagery On Premises and Cloud

• Imagery Hosting

• Dynamic Image Services

• Raster Analytics

• Ortho Mapping

Making Imagery Accessible

A System of Record for Imagery

Page 6: Imagery Management and Accessibility in ... - Esri Canada · Terminology •Raster format –defines how pixels are stored-Ex. TIFF, MrSID, ECW, CRF•Raster type –defines the metadata

Justine Woulfe

Managing Imagery

Page 7: Imagery Management and Accessibility in ... - Esri Canada · Terminology •Raster format –defines how pixels are stored-Ex. TIFF, MrSID, ECW, CRF•Raster type –defines the metadata

Image ManagementAnd so much more…

Page 8: Imagery Management and Accessibility in ... - Esri Canada · Terminology •Raster format –defines how pixels are stored-Ex. TIFF, MrSID, ECW, CRF•Raster type –defines the metadata

Image Management Using Mosaic DatasetsArcGIS Imagery Information Model

• Supports multiple raster sources

• Supports many raster formats

• Maintains image quality

• Handles overlap and disparate datasets

• Supports over 50 sensor types

• Supports Image Services

Aerial

Satellite

Scanned Maps

Elevation

LiDAR

Imagery

Categorical

Drone

Page 9: Imagery Management and Accessibility in ... - Esri Canada · Terminology •Raster format –defines how pixels are stored-Ex. TIFF, MrSID, ECW, CRF•Raster type –defines the metadata

What is a Mosaic Dataset?

• A Catalog:

- References Imagery

- Associated metadata

- Processing functions can be applied

• Stored in Geodatabase

• Created using ArcGIS for Desktop

• Provides:

- Dynamic Mosaicking

- On-the-fly processing

ArcGIS Imagery Information Model

Highly scalable… from small to large volumes of imagery

Page 10: Imagery Management and Accessibility in ... - Esri Canada · Terminology •Raster format –defines how pixels are stored-Ex. TIFF, MrSID, ECW, CRF•Raster type –defines the metadata

Creating a Mosaic Dataset in ArcGIS Pro

1. Create Geodatabase (File or Enterprise)

2. Create Mosaic Dataset

3. Add Rasters

4. Generate Overviews (optional)

A brief summary

Page 11: Imagery Management and Accessibility in ... - Esri Canada · Terminology •Raster format –defines how pixels are stored-Ex. TIFF, MrSID, ECW, CRF•Raster type –defines the metadata

Add Rasters

• Specify parameters

• Crawls for imagery according

to the raster type

• Defines the initial processing

Adding data to your mosaic dataset

Page 12: Imagery Management and Accessibility in ... - Esri Canada · Terminology •Raster format –defines how pixels are stored-Ex. TIFF, MrSID, ECW, CRF•Raster type –defines the metadata

Supported Imagery

• Format: TIFF, JPEG, JPEG 2000, MRF, CRF, IMAGINE, NITF, netCDF, HDR, GRIB,

MrSID…

• Data Structure: Bands, Bits, Tiling, Pyramids, NoData

• Compression: Lossless, Lossy, Limited Error

• Georeferencing: Spatial reference systems

• Metadata: Acquisition Date, Color Map, Source, Copyright, Band wavelengths

Supports over 50 sensor types!

Page 13: Imagery Management and Accessibility in ... - Esri Canada · Terminology •Raster format –defines how pixels are stored-Ex. TIFF, MrSID, ECW, CRF•Raster type –defines the metadata

Overviews

• Like pyramids for a Mosaic Dataset

• Used for faster display at smaller scales (when zoomed out)

• Optional - if not created, imagery may not appear when zoomed out

• May also consider adding smaller scale imagery

Why can’t I see my data?

Page 14: Imagery Management and Accessibility in ... - Esri Canada · Terminology •Raster format –defines how pixels are stored-Ex. TIFF, MrSID, ECW, CRF•Raster type –defines the metadata

Adam Tomlin

Creating and

Configuring a

Mosaic Dataset

Page 15: Imagery Management and Accessibility in ... - Esri Canada · Terminology •Raster format –defines how pixels are stored-Ex. TIFF, MrSID, ECW, CRF•Raster type –defines the metadata

Mosaic Dataset Properties

• General

- General properties relating to

the data structure (number of

bands, bit depth)

- Source Type: Generic →Processed

• Defaults

- Direct the use of a Mosaic

Dataset when Published

- Sets some limits on Publishing

From the Catalog Pane

Page 16: Imagery Management and Accessibility in ... - Esri Canada · Terminology •Raster format –defines how pixels are stored-Ex. TIFF, MrSID, ECW, CRF•Raster type –defines the metadata

Mosaic Dataset Processing

• Initial Raster Function Chain defined by Raster Type

• Apply additional processing

a) To items in mosaic dataset

b) By adding to raster function

chain

c) By attaching to mosaic dataset

• Persists when shared

For easy and efficient visualization and exploration

Page 17: Imagery Management and Accessibility in ... - Esri Canada · Terminology •Raster format –defines how pixels are stored-Ex. TIFF, MrSID, ECW, CRF•Raster type –defines the metadata

What are Raster Functions?

Operations that apply processing directly to

the pixels of imagery and raster datasets

• No new dataset created

• Fast and efficient; processing on-the-fly

• Easily view and edit raster function history

• Create and use custom raster functions

• Save sets of raster functions as templates

• String processes together for complex

modeling

• Generate and share processing templates for

image services

Image processing instructions

New functions in Pro 2.4

Euclidean back direction

Flow length

Sink

Snap pour point

Stream order

Cost path as polyline

Page 18: Imagery Management and Accessibility in ... - Esri Canada · Terminology •Raster format –defines how pixels are stored-Ex. TIFF, MrSID, ECW, CRF•Raster type –defines the metadata

Adam Tomlin

Adding Raster

Functions to a

Mosaic Dataset

Page 19: Imagery Management and Accessibility in ... - Esri Canada · Terminology •Raster format –defines how pixels are stored-Ex. TIFF, MrSID, ECW, CRF•Raster type –defines the metadata

Justine Woulfe

Sharing Imagery

Page 20: Imagery Management and Accessibility in ... - Esri Canada · Terminology •Raster format –defines how pixels are stored-Ex. TIFF, MrSID, ECW, CRF•Raster type –defines the metadata

What is ArcGIS Image Server?

• Part of ArcGIS Enterprise

• Serves large collection of data for analytical processing

• Allows users to assemble, process, analyze and

manage large collection of imagery

The Enterprise solution to imagery sharing

Source images Mosaic dataset

Image service

ArcGIS Image Server

Page 21: Imagery Management and Accessibility in ... - Esri Canada · Terminology •Raster format –defines how pixels are stored-Ex. TIFF, MrSID, ECW, CRF•Raster type –defines the metadata

ArcGIS Image Server

• Dynamic image services

- Web accessible imagery which can have processing applied on-the-fly

• Raster Analytics

- Quickly process and persist data to create new information products

• Ortho mapping

- Processing of satellite, aerial or drone imagery into digital elevation models and

ortho mosaics

• Imagery hosting

- Enables users within organization to upload imagery into ArcGIS Enterprise and

serve it as dynamic imagery layers

Key Capabilities

Page 22: Imagery Management and Accessibility in ... - Esri Canada · Terminology •Raster format –defines how pixels are stored-Ex. TIFF, MrSID, ECW, CRF•Raster type –defines the metadata

ArcGIS Image Server

• An Image Service is the primary information model for imagery on ArcGIS Online

- Single Images

- Large collections via mosaic datasets

• Puts valuable imagery to use quickly

• Serves multiple views using the original imagery

• Access the records that make up the mosaic dataset

• Can be used to perform on-the-fly image processing and explore temporal changes

What is an image service?

Page 23: Imagery Management and Accessibility in ... - Esri Canada · Terminology •Raster format –defines how pixels are stored-Ex. TIFF, MrSID, ECW, CRF•Raster type –defines the metadata

Sharing imagery from ArcGIS Pro

• Must invoke the wizard from Catalog pane -

not Contents pane

• Share by Reference or Share by Value

• Define processing to be applied by the

server

• Option to allow downloads

• Can enable WMS (Web Map Service) and

WCS (Web Coverage Service) capabilities

• Can publish to ArcGIS Online, Portal and

standalone ArcGIS Server (new feature of

ArcGIS Pro 2.4)

How to publish an image service

Page 24: Imagery Management and Accessibility in ... - Esri Canada · Terminology •Raster format –defines how pixels are stored-Ex. TIFF, MrSID, ECW, CRF•Raster type –defines the metadata

Adam Tomlin

Publishing an

Image Service from

ArcGIS Pro

Page 25: Imagery Management and Accessibility in ... - Esri Canada · Terminology •Raster format –defines how pixels are stored-Ex. TIFF, MrSID, ECW, CRF•Raster type –defines the metadata

Justine Woulfe

Using Imagery

Page 26: Imagery Management and Accessibility in ... - Esri Canada · Terminology •Raster format –defines how pixels are stored-Ex. TIFF, MrSID, ECW, CRF•Raster type –defines the metadata

Image Visualization and Exploitation

ArcGIS Pro

• ArcGIS Image Analyst

- Image Space, Mensuration

- Stereo

- Motion Video

- Oriented Imagery

• Web

- ArcGIS Excalibur

- Map Viewer – Imagery features

- Image Configurable Apps (Image Viewer / Mask / Visit)

- WABIS – WebAppBuilder Widgets for Image Services

- Oriented Imagery

• Mobile

- Focused Apps

Integrating imagery into dynamic applications to aid understanding

Page 27: Imagery Management and Accessibility in ... - Esri Canada · Terminology •Raster format –defines how pixels are stored-Ex. TIFF, MrSID, ECW, CRF•Raster type –defines the metadata

ArcGIS Excalibur

• For: Analysts, Imagery Specialists, and Imagery/GIS

Managers

• Who: Need to discover, analyze, and report information

derived from imagery analysis or exploitation.

• The Solution: a cloud-based application

• That Provides: a simple and intuitive design to search

for and work with imagery and reference data in a

project-based experience. The results are shared in

dynamic information products across your organization.

What is it?

ArcGIS Excalibur is an intuitive project-based image analytics and exploitation

web application.

Page 28: Imagery Management and Accessibility in ... - Esri Canada · Terminology •Raster format –defines how pixels are stored-Ex. TIFF, MrSID, ECW, CRF•Raster type –defines the metadata

What is Required for ArcGIS Excalibur?System Components

Base ArcGIS Enterprise 10.7 or above Deployment

+ +

ArcGIS Image Server

ArcGIS Excalibur (separate Installer + separate license per

user)

Page 29: Imagery Management and Accessibility in ... - Esri Canada · Terminology •Raster format –defines how pixels are stored-Ex. TIFF, MrSID, ECW, CRF•Raster type –defines the metadata

ArcGIS Excalibur

• Image Management

- Interactive search and discovery

- Simplified access to imagery through

numerous experiences

- User defined search settings to refine

results

• Imagery Projects

- Focused workflows to organize and

accomplish image-based tasks

Image Management

Query, locate and find imagery quickly

Imagery ProjectsOrganized, Task Based Workflows

Focused Experiences

Imagery Derived Products

ExploitationOn-the-Fly Processing

Dynamic Visualization

Multi-View Oblique Imagery

“Image Space” Support

Image ManagementInteractive Search and Discovery

Simplified Access to Imagery

Interactive Briefing Products

Traceable Analytic Assessments

Dynamic Analysis Layers

Page 30: Imagery Management and Accessibility in ... - Esri Canada · Terminology •Raster format –defines how pixels are stored-Ex. TIFF, MrSID, ECW, CRF•Raster type –defines the metadata

ArcGIS Excalibur

• Exploitation

- Tools for on-the-fly processing

- Side-by-side visualization of oblique and

orthorectified imagery

- Image annotations automatically and

accurately transformed to geographic

features

• Imagery Derived Products

- Create products for interactive briefings or

web applications

Image Utilization

Query, locate and find imagery quickly

Imagery ProjectsOrganized, Task Based Workflows

Focused Experiences

Imagery Derived Products

ExploitationOn-the-Fly Processing

Dynamic Visualization

Multi-View Oblique Imagery

“Image Space” Support

Image ManagementInteractive Search and Discovery

Simplified Access to Imagery

Interactive Briefing Products

Traceable Analytic Assessments

Dynamic Analysis Layers

Page 31: Imagery Management and Accessibility in ... - Esri Canada · Terminology •Raster format –defines how pixels are stored-Ex. TIFF, MrSID, ECW, CRF•Raster type –defines the metadata

Adam Tomlin

ArcGIS Excalibur

Demonstration

Page 32: Imagery Management and Accessibility in ... - Esri Canada · Terminology •Raster format –defines how pixels are stored-Ex. TIFF, MrSID, ECW, CRF•Raster type –defines the metadata

Configurable Apps

• Imagery Web Apps provide:

- Functionality, polish and context beyond the basic Map Viewer

- Basic tools for interacting with imagery

- Ease of use with configurable apps and widgets; customization options with

Web AppBuilder and JavaScript API

- Easy access from any web-enabled device

For Imagery

Web AppBuilder (Core)

Web AppBuilder (Developer Edition)

MoreCustomization

Easier to implement

Configurable app templates

JavaScript API

(3.x or 4.x)

Page 33: Imagery Management and Accessibility in ... - Esri Canada · Terminology •Raster format –defines how pixels are stored-Ex. TIFF, MrSID, ECW, CRF•Raster type –defines the metadata

Configurable App Templates

• Imagery Viewer

- Visualize and interpret imagery layers

through time and space

• Image Mask

- Calculate and visualize change between

two images

- Highlight an area of interest that meets a

user-defined threshold for common

spectral indices

• Image Visit

- Review attributes for a predetermined

sequence of locations

Designed for Imagery

Extract meaning from imagery

Page 34: Imagery Management and Accessibility in ... - Esri Canada · Terminology •Raster format –defines how pixels are stored-Ex. TIFF, MrSID, ECW, CRF•Raster type –defines the metadata

Justine Woulfe

Best Practices

Page 35: Imagery Management and Accessibility in ... - Esri Canada · Terminology •Raster format –defines how pixels are stored-Ex. TIFF, MrSID, ECW, CRF•Raster type –defines the metadata

Best Practices…are data specific!

• Imagery Workflows website has best practices and recommended workflows

AerialSatellite

Scanned MapsElevation LiDARImagery Categorical

Dronehttps://doc.arcgis.com/en/imagery/workflows/

Page 36: Imagery Management and Accessibility in ... - Esri Canada · Terminology •Raster format –defines how pixels are stored-Ex. TIFF, MrSID, ECW, CRF•Raster type –defines the metadata

Best Practices for Managing ImageryStoring source images and data

• Store each collection of image files in a separate directory

• Try to keep the number of files per directory under 1,000

• One mosaic dataset per geodatabase, or at least a small number of them

• Store metadata files in the same directory as your data

• Use a consistent naming convention

Page 37: Imagery Management and Accessibility in ... - Esri Canada · Terminology •Raster format –defines how pixels are stored-Ex. TIFF, MrSID, ECW, CRF•Raster type –defines the metadata

Best Practices for Managing ImageryPre-processing and preparation

• Build pyramids for source images

• Identify NoData values

• Familiarize yourself with your data

• Verify the units of measurement

Page 38: Imagery Management and Accessibility in ... - Esri Canada · Terminology •Raster format –defines how pixels are stored-Ex. TIFF, MrSID, ECW, CRF•Raster type –defines the metadata

Best Practices for Managing ImageryCreating and Improving Mosaic Datasets

• Default values are your friends!

• Set the appropriate raster type

• Pay attention to metadata

• Use a mask or build footprints to clip the data

- Use Radiometry option OR Geometry option + clip to mask

Page 39: Imagery Management and Accessibility in ... - Esri Canada · Terminology •Raster format –defines how pixels are stored-Ex. TIFF, MrSID, ECW, CRF•Raster type –defines the metadata

Best Practices for Managing ImageryCreating and Publishing Image Services

• Publish using share by reference method (instead of copying data to server)

• Caching is recommended for services which will serve as basemap imagery

• Suggest to cache services that were published with low performing or highly

compressed formats

Page 40: Imagery Management and Accessibility in ... - Esri Canada · Terminology •Raster format –defines how pixels are stored-Ex. TIFF, MrSID, ECW, CRF•Raster type –defines the metadata

Summary

• Mosaic Dataset

- Primary information model to manage imagery

- Supports dynamic mosaicking and on-the-fly processing

- Can be configured to fit your data

- Can be accessed across the ArcGIS platform when shared as a web service

• ArcGIS Image Server

• dynamic image services

• ArcGIS Online or Portal

• make imagery accessible

• Use best practices specific to your data

Page 42: Imagery Management and Accessibility in ... - Esri Canada · Terminology •Raster format –defines how pixels are stored-Ex. TIFF, MrSID, ECW, CRF•Raster type –defines the metadata

Session Rating

Page 43: Imagery Management and Accessibility in ... - Esri Canada · Terminology •Raster format –defines how pixels are stored-Ex. TIFF, MrSID, ECW, CRF•Raster type –defines the metadata

© 2019 Esri Canada Limited. All rights reserved. Trademarks for Esri products are provided under license from Environmental Systems Research Institute, Inc. Other product & company names mentioned

herein may be trademarks or registered trademarks of their respective owners. Errors & omissions excepted. Esri materials are copyrighted. Please request permission to use software, images or text.

Page 44: Imagery Management and Accessibility in ... - Esri Canada · Terminology •Raster format –defines how pixels are stored-Ex. TIFF, MrSID, ECW, CRF•Raster type –defines the metadata

Which Font Should You Use For Your Presentation?

Arial

Please use Arial at all times for your PowerPoint presentation.

Using Arial gives your PowerPoint presentation the flexibility to be used by many people on various

machines without the risk of font compatibility and changing the look of your layout.

Use of Arial Ensures…

Multiple users are able to view the font / Presentation distributed to others picks up the font

Presentation can be used on multiple computers

Page 45: Imagery Management and Accessibility in ... - Esri Canada · Terminology •Raster format –defines how pixels are stored-Ex. TIFF, MrSID, ECW, CRF•Raster type –defines the metadata

Did you know?

To quickly update any current presentation

Copy and paste your slides from your current deck into the newest template. The title and ending logo slide will

update automatically.

Videos not working?For video in PowerPoint, animated GIF is recommended. AVI and WMV (native PC files) will work best on a PC platform. H.264

MP4 will work only on PowerPoint 2013 and later.

Esri Corporate Template-Dark v3.4

16:9 version – January 29, 2017

Page 46: Imagery Management and Accessibility in ... - Esri Canada · Terminology •Raster format –defines how pixels are stored-Ex. TIFF, MrSID, ECW, CRF•Raster type –defines the metadata

Aspect Ratio Test

Esri Corporate Template-Dark v3.4

16:9 version – January 29, 2017

If this shape does not appear as

a perfect circle, adjust the aspect

ratio of your display until it does.

Try the resolution 1920x1080 for

16:9 displays.