Download - How to Optimize GIS Workflows
![Page 1: How to Optimize GIS Workflows](https://reader034.vdocuments.mx/reader034/viewer/2022042511/589f51551a28abec418b5fa7/html5/thumbnails/1.jpg)
How to Optimize GIS Workflows
With Mark Stoakes & Steve MacCabe
![Page 2: How to Optimize GIS Workflows](https://reader034.vdocuments.mx/reader034/viewer/2022042511/589f51551a28abec418b5fa7/html5/thumbnails/2.jpg)
Who are we anyway?
![Page 3: How to Optimize GIS Workflows](https://reader034.vdocuments.mx/reader034/viewer/2022042511/589f51551a28abec418b5fa7/html5/thumbnails/3.jpg)
Connect Virtually Any Format with FME
![Page 4: How to Optimize GIS Workflows](https://reader034.vdocuments.mx/reader034/viewer/2022042511/589f51551a28abec418b5fa7/html5/thumbnails/4.jpg)
FME & GIS can do amazing things
Here is a taste of what’s possible.
Manage your attributes
Validate your attributes
Distribute a Validation Report
Automate the process
![Page 5: How to Optimize GIS Workflows](https://reader034.vdocuments.mx/reader034/viewer/2022042511/589f51551a28abec418b5fa7/html5/thumbnails/5.jpg)
Managing Attributes
![Page 6: How to Optimize GIS Workflows](https://reader034.vdocuments.mx/reader034/viewer/2022042511/589f51551a28abec418b5fa7/html5/thumbnails/6.jpg)
Attribute ManagementWhy another attribute handling transformer?
➢ Because there are already too many… plus we needed a couple other operations
Goal: consolidate the attribute management transformers
Doomed transformers:AttributeCreatorAttributeCopierAttributeRenamerExpressionEvaluatorStringConcatenatorAttributeKeeperAttributeRemover
Plus… …many string operations:case changetrim/padsubstring/regex
One transformer to rule all your attributes
![Page 7: How to Optimize GIS Workflows](https://reader034.vdocuments.mx/reader034/viewer/2022042511/589f51551a28abec418b5fa7/html5/thumbnails/7.jpg)
● Create attributes
● Rename attributes
● Copy attributes
● Remove attributes
● Set attribute values
● Re-order attributes
● Concatenate attributes (Text Editor)
● Arithmetic expressions (Arithmetic Editor)
● Set conditional values (Conditional Value)
● Reference earlier attributes
AttributeManager
![Page 8: How to Optimize GIS Workflows](https://reader034.vdocuments.mx/reader034/viewer/2022042511/589f51551a28abec418b5fa7/html5/thumbnails/8.jpg)
AttributeManager creates an opportunity for more focused and simplified attribute management.
#ThanksFME2016
![Page 9: How to Optimize GIS Workflows](https://reader034.vdocuments.mx/reader034/viewer/2022042511/589f51551a28abec418b5fa7/html5/thumbnails/9.jpg)
Let’s Go - Demo!
AttributeManger:
Lets you organize your attributes in
your workflows
![Page 10: How to Optimize GIS Workflows](https://reader034.vdocuments.mx/reader034/viewer/2022042511/589f51551a28abec418b5fa7/html5/thumbnails/10.jpg)
Attribute Validation
![Page 11: How to Optimize GIS Workflows](https://reader034.vdocuments.mx/reader034/viewer/2022042511/589f51551a28abec418b5fa7/html5/thumbnails/11.jpg)
Attribute Validation – why?
If you distribute poor quality data then you've amplified the data issue.
If you distribute good quality data you've amplified the benefits.
Data validation is key to many FME workflows…
![Page 12: How to Optimize GIS Workflows](https://reader034.vdocuments.mx/reader034/viewer/2022042511/589f51551a28abec418b5fa7/html5/thumbnails/12.jpg)
Attribute Validation – Standards
Bunch of ISO standards – ISO19xxxMostly replaced by - ISO 19157
Also CAD & Data Model Standards
![Page 13: How to Optimize GIS Workflows](https://reader034.vdocuments.mx/reader034/viewer/2022042511/589f51551a28abec418b5fa7/html5/thumbnails/13.jpg)
Attribute Validation – FME ToolsAttribute Validation – Key Tools
● Tester and TestFilter● AttributeCreator (conditional tests)● AttributeClassifier● AttributeRangeFilter & AttributeFilter● NullAttributeMapper● DuplicateRemover● StringSearcher● StatisticsCalculator
![Page 14: How to Optimize GIS Workflows](https://reader034.vdocuments.mx/reader034/viewer/2022042511/589f51551a28abec418b5fa7/html5/thumbnails/14.jpg)
AttributeValidator...
Goals:Simplify validation workflows (Reduce number of transformers)
Be more confident about the data you’re loading into a destination dataset
...say goodbye to bad data
#ThanksFME2016
![Page 15: How to Optimize GIS Workflows](https://reader034.vdocuments.mx/reader034/viewer/2022042511/589f51551a28abec418b5fa7/html5/thumbnails/15.jpg)
Attribute ValidationSome of the validation tests available:
➢ Attribute type (integer, float, char, xml, json, etc.)➢ In – either a list or range – good for domain validation➢ Regular Expressions➢ Unique➢ Not Null➢ …and more…
![Page 16: How to Optimize GIS Workflows](https://reader034.vdocuments.mx/reader034/viewer/2022042511/589f51551a28abec418b5fa7/html5/thumbnails/16.jpg)
Attribute Validation Output Output is:
➢ Summary Attribute:_fme_validation_message
➢ List of all messages: _fme_validation_message_list{}
Attribute 'CodePrefix' with value 'ABE' fails check for Matches Regular Expression '[ABCD]{3}'{0} Attribute 'CodePrefix' with value 'ABE' fails check for Matches Regular Expression '[ABCD]{3}'{1} Attribute 'num_measures' with value '12' fails check for in Range '[0,10]'{2} Attribute 'CodePrefix' with value 'ABE' fails check for in 'ABC,ABD,TXU,TXV'
![Page 17: How to Optimize GIS Workflows](https://reader034.vdocuments.mx/reader034/viewer/2022042511/589f51551a28abec418b5fa7/html5/thumbnails/17.jpg)
Let’s Go - Demo!
AttributeValidator:
Lets you scrutinize your attributes and
simplify your data validation
workflows
![Page 18: How to Optimize GIS Workflows](https://reader034.vdocuments.mx/reader034/viewer/2022042511/589f51551a28abec418b5fa7/html5/thumbnails/18.jpg)
Q&AChat your questions to us
![Page 19: How to Optimize GIS Workflows](https://reader034.vdocuments.mx/reader034/viewer/2022042511/589f51551a28abec418b5fa7/html5/thumbnails/19.jpg)
Writing Features...a different approach
![Page 20: How to Optimize GIS Workflows](https://reader034.vdocuments.mx/reader034/viewer/2022042511/589f51551a28abec418b5fa7/html5/thumbnails/20.jpg)
Traditional vs. state-of-the-art...Write data with a writer
Write data with a FeatureWriter
![Page 21: How to Optimize GIS Workflows](https://reader034.vdocuments.mx/reader034/viewer/2022042511/589f51551a28abec418b5fa7/html5/thumbnails/21.jpg)
Write the conclusion to your data process
Write data in the middle of workflows to avoid chaining workspaces.
Write the summary of your data output.
#ThanksFME2016
Use the FeatureWriter to allow post-processing freedom.
#FreeYourData
![Page 22: How to Optimize GIS Workflows](https://reader034.vdocuments.mx/reader034/viewer/2022042511/589f51551a28abec418b5fa7/html5/thumbnails/22.jpg)
Some Easy Wins:• Create summary reports
– Email an attachment• Copy data after writing
– FTP results– Load into Dropbox
![Page 23: How to Optimize GIS Workflows](https://reader034.vdocuments.mx/reader034/viewer/2022042511/589f51551a28abec418b5fa7/html5/thumbnails/23.jpg)
Automation Workflows• Quality checking• Database operations• Database validation• FME Server Notification
![Page 24: How to Optimize GIS Workflows](https://reader034.vdocuments.mx/reader034/viewer/2022042511/589f51551a28abec418b5fa7/html5/thumbnails/24.jpg)
Transformation
...transform your data
A new pattern for database workflows
Transform your database workflows
SQLCreator
...drop constraints
FeatureReader
...read your data
Transformation
...transform your data
FeatureWriter
...write to database
SQLExecutor
...enable constraints
SQLExecutor
...validate/index/unique
![Page 25: How to Optimize GIS Workflows](https://reader034.vdocuments.mx/reader034/viewer/2022042511/589f51551a28abec418b5fa7/html5/thumbnails/25.jpg)
A new pattern for FME Server notification workflows
FeatureReader & FeatureWriter simplies you workspace
![Page 26: How to Optimize GIS Workflows](https://reader034.vdocuments.mx/reader034/viewer/2022042511/589f51551a28abec418b5fa7/html5/thumbnails/26.jpg)
Let’s Go - Demo!
FeatureWriter:
Lets you post-process your
output data
![Page 27: How to Optimize GIS Workflows](https://reader034.vdocuments.mx/reader034/viewer/2022042511/589f51551a28abec418b5fa7/html5/thumbnails/27.jpg)
Automation
![Page 28: How to Optimize GIS Workflows](https://reader034.vdocuments.mx/reader034/viewer/2022042511/589f51551a28abec418b5fa7/html5/thumbnails/28.jpg)
FME Server OverviewFME Engine workhorse and runs FME Workspaces
Automate Deliver Data Download Data
Love
FME!
ScaleReal Time Data
![Page 29: How to Optimize GIS Workflows](https://reader034.vdocuments.mx/reader034/viewer/2022042511/589f51551a28abec418b5fa7/html5/thumbnails/29.jpg)
Let FME Server do the work
Examples of things we can automate:● Directory watcher● Run the workspace through a notification ● Data Delivery
○ Dropbox○ email
Let’s Go - Demo!
![Page 30: How to Optimize GIS Workflows](https://reader034.vdocuments.mx/reader034/viewer/2022042511/589f51551a28abec418b5fa7/html5/thumbnails/30.jpg)
Summary
![Page 31: How to Optimize GIS Workflows](https://reader034.vdocuments.mx/reader034/viewer/2022042511/589f51551a28abec418b5fa7/html5/thumbnails/31.jpg)
Take advantage of our new transformers.
![Page 32: How to Optimize GIS Workflows](https://reader034.vdocuments.mx/reader034/viewer/2022042511/589f51551a28abec418b5fa7/html5/thumbnails/32.jpg)
Free StuffThere are too many to list so be sure to check out www.safe.com
for more.
Knowledge Articles● AttributeManager● AttributeValidator
Blog Posts● FeatureWriter● AttributeManager
Free FME Training● FME Desktop Basic: March 8-9● FME Server: March 15-16● FME Desktop Advanced: March 22-23
![Page 33: How to Optimize GIS Workflows](https://reader034.vdocuments.mx/reader034/viewer/2022042511/589f51551a28abec418b5fa7/html5/thumbnails/33.jpg)
60+ CITIESApril - J une
![Page 34: How to Optimize GIS Workflows](https://reader034.vdocuments.mx/reader034/viewer/2022042511/589f51551a28abec418b5fa7/html5/thumbnails/34.jpg)
Poll Question
Which of today's tasks do you see yourself performing on your GIS data?
![Page 35: How to Optimize GIS Workflows](https://reader034.vdocuments.mx/reader034/viewer/2022042511/589f51551a28abec418b5fa7/html5/thumbnails/35.jpg)
Q&AChat your questions into us
![Page 36: How to Optimize GIS Workflows](https://reader034.vdocuments.mx/reader034/viewer/2022042511/589f51551a28abec418b5fa7/html5/thumbnails/36.jpg)
Thank you!
Get a free trial of FME at www.safe.com
![Page 37: How to Optimize GIS Workflows](https://reader034.vdocuments.mx/reader034/viewer/2022042511/589f51551a28abec418b5fa7/html5/thumbnails/37.jpg)
Resources: Attribute ValidationOriginal PR: 8945Knowledge Center: Validate your Data's Attributes with the AttributeValidator Transformer
Webinar 2015: Data Validation Victories: Tips for Better Data Quality:
Data Validation & Quality Assurance
WWTour:FME & Data Validation: http://www.slideshare.net/SafeSoftware/fme-data-validation
WWTour 2014: Validation and Quality Control with FME & FME Server and also at SlideShare
Validating your data before loading it into a database: video by Robyn
FME 2014 UC - Colonial Pipeline: CAD Data Validation using FME
Automated Quality Control: ISo 9000:2000 Quality Measures ISO 19157/19131 Metria 2014
Berk Bayer 2014 Application of FME to Maintain Quality Control (QC) over Standardized Spatial Data
FME WWTour 2013 – Introducing Geometry Validator
![Page 38: How to Optimize GIS Workflows](https://reader034.vdocuments.mx/reader034/viewer/2022042511/589f51551a28abec418b5fa7/html5/thumbnails/38.jpg)
Resources: AttributeManagerKnowledge Center: Control Your Data's Attributes with the AttributeManager Transformer