arcgis data reviewer advanced data validation · workshop agenda arcgis data reviewer automate,...

31
ArcGIS Data Reviewer Advanced Data Validation Shankar Chandrasekaran & Francisco Perez

Upload: others

Post on 21-Jul-2020

29 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: ArcGIS Data Reviewer Advanced Data Validation · Workshop Agenda ArcGIS Data Reviewer Automate, simplify, standardize and unify workflows to improve data quality Increase transparency

ArcGIS Data Reviewer

Advanced Data Validation

Shankar Chandrasekaran & Francisco Perez

Page 2: ArcGIS Data Reviewer Advanced Data Validation · Workshop Agenda ArcGIS Data Reviewer Automate, simplify, standardize and unify workflows to improve data quality Increase transparency

• What is ArcGIS Data Reviewer?

• Quality Assurance – A seamless experience

• Streamline Data Collection & Maintenance

• Data Quality tools for Automated Review

• Summary

• Resources

Workshop Agenda

Page 3: ArcGIS Data Reviewer Advanced Data Validation · Workshop Agenda ArcGIS Data Reviewer Automate, simplify, standardize and unify workflows to improve data quality Increase transparency

ArcGIS Data Reviewer

Automate, simplify, standardize and unify workflows to improve data quality

Increase transparency

Lower data management costs

Streamline quality control workflows

Implement repeatable processes

Reduce risk in decision-making

Page 4: ArcGIS Data Reviewer Advanced Data Validation · Workshop Agenda ArcGIS Data Reviewer Automate, simplify, standardize and unify workflows to improve data quality Increase transparency

Data quality managementCapabilities of ArcGIS

Geodatabase integrity

• Schema constraints

• Attribute rules

• Versioning

Advanced data types

• Topologies

• Parcel fabric

• Utility network

ArcGIS

Data Reviewer

• Automated review

• Semi-automated review

• Error management

• Quality reporting

Page 5: ArcGIS Data Reviewer Advanced Data Validation · Workshop Agenda ArcGIS Data Reviewer Automate, simplify, standardize and unify workflows to improve data quality Increase transparency

Using ArcGIS Platform

Quality Assurance - A Seamless Experience

Page 6: ArcGIS Data Reviewer Advanced Data Validation · Workshop Agenda ArcGIS Data Reviewer Automate, simplify, standardize and unify workflows to improve data quality Increase transparency

Stakeholder Inputs

Business Requirements

Technical Data Quality

Requirements

Quality Assurance

Plan

Requirements Quality Assurance Plan

Page 7: ArcGIS Data Reviewer Advanced Data Validation · Workshop Agenda ArcGIS Data Reviewer Automate, simplify, standardize and unify workflows to improve data quality Increase transparency

Requirements Quality Assurance Plan - Cyclic

Page 8: ArcGIS Data Reviewer Advanced Data Validation · Workshop Agenda ArcGIS Data Reviewer Automate, simplify, standardize and unify workflows to improve data quality Increase transparency

Requirements

Quality Assurance Plan – Change Management

New Business

Requirements

Internal Process

Improvements

Communicate

Disruptive

Complex

Page 9: ArcGIS Data Reviewer Advanced Data Validation · Workshop Agenda ArcGIS Data Reviewer Automate, simplify, standardize and unify workflows to improve data quality Increase transparency

Attribute Rules - Overview

User defined rules for simple features using Arcade scripting

Ensures data quality during data collection and maintenance

Enforces data integrity

Defined in feature classes or tables

Supported across the ArcGIS System

Quality Assurance with ArcGIS

Page 10: ArcGIS Data Reviewer Advanced Data Validation · Workshop Agenda ArcGIS Data Reviewer Automate, simplify, standardize and unify workflows to improve data quality Increase transparency

Attribute Rules - Types

Constraints Calculation

ImmediateCalculation

BatchCalculation

Validation

Page 11: ArcGIS Data Reviewer Advanced Data Validation · Workshop Agenda ArcGIS Data Reviewer Automate, simplify, standardize and unify workflows to improve data quality Increase transparency

Ready To Use Rules - Overview

Easily Configurable Attribute Rules (no scripting required)

Templated Arcade scripts with parameters

Assess feature’s Integrity and geometric properties

Evaluate Spatial relationship across feature classes

Attribute Constraint Rules

Page 12: ArcGIS Data Reviewer Advanced Data Validation · Workshop Agenda ArcGIS Data Reviewer Automate, simplify, standardize and unify workflows to improve data quality Increase transparency

Shankar Chandrasekaran

Quality Assurance

- Demo

Page 13: ArcGIS Data Reviewer Advanced Data Validation · Workshop Agenda ArcGIS Data Reviewer Automate, simplify, standardize and unify workflows to improve data quality Increase transparency

Key Components Quality Assurance Plan – ArcGIS System tools

Configuration Add Ins

Configure Rules

Rich Editing Experience

Role- Based Focused Start

Pages

Share rules with Project templates

SDK

Page 14: ArcGIS Data Reviewer Advanced Data Validation · Workshop Agenda ArcGIS Data Reviewer Automate, simplify, standardize and unify workflows to improve data quality Increase transparency

Questions ?

Page 15: ArcGIS Data Reviewer Advanced Data Validation · Workshop Agenda ArcGIS Data Reviewer Automate, simplify, standardize and unify workflows to improve data quality Increase transparency

Francisco Perez

Streamlining Data Collection and Maintenance

Page 16: ArcGIS Data Reviewer Advanced Data Validation · Workshop Agenda ArcGIS Data Reviewer Automate, simplify, standardize and unify workflows to improve data quality Increase transparency

Streamline Data Collection

Challenges

Poor Data Quality

Understanding data quality can be difficult

Data Validation is time consuming

Solution Platform

Define workflow standards

Identify patterns in the data

Outline an automated process for data validation

ArcGIS Pro/Data Reviewer

ArcGIS Pro

ArcGIS Data Reviewer

Page 17: ArcGIS Data Reviewer Advanced Data Validation · Workshop Agenda ArcGIS Data Reviewer Automate, simplify, standardize and unify workflows to improve data quality Increase transparency

Streamline Data Maintenance

Challenges

Knowing if deadlines will be met

No consistency in how work is done

Takes to long for staff to become effective

Solution Technology

ArcGIS ProDefine a data maintenance

process

Define standard workflows

Define processes to validate & fix data

ArcGIS Workflow Manager

Data Reviewer & ArcGIS Pro Tasks

Page 18: ArcGIS Data Reviewer Advanced Data Validation · Workshop Agenda ArcGIS Data Reviewer Automate, simplify, standardize and unify workflows to improve data quality Increase transparency

Francisco Perez

Streamline Data Maintenance Demo-QC Framework

Page 19: ArcGIS Data Reviewer Advanced Data Validation · Workshop Agenda ArcGIS Data Reviewer Automate, simplify, standardize and unify workflows to improve data quality Increase transparency

QC Framework Demo – Key Setups

1. WMX-Reviewer Integration (Map Level)

2. WMX-Reviewer Integration (Workflow Level)

3. ArcGIS Pro Tasks (Map Level)

Page 20: ArcGIS Data Reviewer Advanced Data Validation · Workshop Agenda ArcGIS Data Reviewer Automate, simplify, standardize and unify workflows to improve data quality Increase transparency

Questions ?

Page 21: ArcGIS Data Reviewer Advanced Data Validation · Workshop Agenda ArcGIS Data Reviewer Automate, simplify, standardize and unify workflows to improve data quality Increase transparency

Versioning

Type

• Traditional

• Branch

• Traditional

Data Source(s)

Used in Validation

• Shapefiles

• EGDB

• FGDB

• Shapefiles

• Feature Service

• EGDB

• FGDB

Authoring

Workflow

Reviewer

Map Rules

Reviewer

Batch Jobs

*Created using ArcMap

Identify

Check Type

• Documentation

• Checks Poster

Data Quality Tools for Automated Review

Quality

Requirements

Reviewer

Map Rules & Attribute Rules

Future

release

Page 22: ArcGIS Data Reviewer Advanced Data Validation · Workshop Agenda ArcGIS Data Reviewer Automate, simplify, standardize and unify workflows to improve data quality Increase transparency

Summary

• Manage Changes to Quality Assurance plan seamlessly

• Streamline data collection and data maintenance process

• Data Quality tools for Automated Review

Page 23: ArcGIS Data Reviewer Advanced Data Validation · Workshop Agenda ArcGIS Data Reviewer Automate, simplify, standardize and unify workflows to improve data quality Increase transparency

See Us Here

Data Reviewer

Info

Page 24: ArcGIS Data Reviewer Advanced Data Validation · Workshop Agenda ArcGIS Data Reviewer Automate, simplify, standardize and unify workflows to improve data quality Increase transparency

Want to learn more?

• Product page

www.esri.com/datareviewer

Page 25: ArcGIS Data Reviewer Advanced Data Validation · Workshop Agenda ArcGIS Data Reviewer Automate, simplify, standardize and unify workflows to improve data quality Increase transparency

Want to learn more?

• Documentation

- Desktop desktop.arcgis.com

Page 26: ArcGIS Data Reviewer Advanced Data Validation · Workshop Agenda ArcGIS Data Reviewer Automate, simplify, standardize and unify workflows to improve data quality Increase transparency

Want to learn more?

• Documentation

- Desktop

- Server

enterprise.arcgis.com

Page 27: ArcGIS Data Reviewer Advanced Data Validation · Workshop Agenda ArcGIS Data Reviewer Automate, simplify, standardize and unify workflows to improve data quality Increase transparency

Want to learn more?

• Documentation

- Desktop

- Server

• Training

http://esriurl.com/15503

Page 28: ArcGIS Data Reviewer Advanced Data Validation · Workshop Agenda ArcGIS Data Reviewer Automate, simplify, standardize and unify workflows to improve data quality Increase transparency

Want to learn more?

• Documentation

- Desktop

- Server

• Training

• GeoNet Community

http://esriurl.com/15504

Page 29: ArcGIS Data Reviewer Advanced Data Validation · Workshop Agenda ArcGIS Data Reviewer Automate, simplify, standardize and unify workflows to improve data quality Increase transparency

As “GIS - The Science of Where”becomes an integral part of decision making

Food for thought as we conclude..

The accuracy of “WHERE” will fosterbetter decisions in the ever changing

world….

More to come …. Adios

Page 30: ArcGIS Data Reviewer Advanced Data Validation · Workshop Agenda ArcGIS Data Reviewer Automate, simplify, standardize and unify workflows to improve data quality Increase transparency

Please Share Your Feedback in the App

Download the Esri

Events app and find

your event

Select the session

you attended

Scroll down to

“Survey”

Log in to access the

survey

Complete the survey

and select “Submit”

Page 31: ArcGIS Data Reviewer Advanced Data Validation · Workshop Agenda ArcGIS Data Reviewer Automate, simplify, standardize and unify workflows to improve data quality Increase transparency

Questions ?