the application of fme to maintain quality control (qc) over standardized spatial data

Download The Application of FME to Maintain Quality Control (QC) over Standardized Spatial Data

Post on 21-Jun-2015




1 download

Embed Size (px)


The Bureau of Land Management National Operations Center (NOC) harvests and maintains a plethora of spatial data from twelve administrative state offices that holds central importance to implementing strategic national initiatives. Standardization is a fundamental process that serves to resolve data anomalies and data conflicts. Exercising quality control over standardized data helps to improve data integrity and builds confidence when making critical business decisions. The ability to adopt and apply FME QC tools has vastly improved customer experience in working with standardized data and has contributed to promoting better data management practices at the state level. The NOC utilizes the FME Tester transformer to help assess the accuracy of the data in each of the attribute fields and delivers QC reports directly to the state offices that include comments describing the nature of the errors. The states join their data to the QC report via the standardized primary key (GlobalID), and perform the necessary adjustments to their data. The adjusted dataset is replicated and reconciled with the NOCs version of that particular states data. These efforts expedite QC workflow at the NOC as well as the states and continue to help staff deliver quality assured spatial data to both internal and external customers. See more presentations from the FME User Conference 2014 at:


  • 1. CONNECT. TRANSFORM. AUTOMATE. Berk Bayer The Application of Feature Manipulation Engine (FME) to Maintain Quality Control (QC) over Standardized Spatial Data

2. Introduction ! I am a Data Management Specialist with the Northrop Grumman Corporation working at the Bureau of Land Management National Operations Center (NOC) in Denver, Colorado. ! The NOC harvests and maintains standardized spatial data from the twelve administrative states in the Bureau. CONNECT. TRANSFORM. AUTOMATE. 3. Todays Agenda ! Advantages of Data Standardization ! FME & Data Quality ! Geometry Validator Transformer ! Building Geometry Checks ! Tester Transformer ! Building Attribute Checks ! Interpreting The Error Table ! Maintaining QC 4. Advantages of Data Standardization ! Data standardization ensures common understanding of content and quality. ! Data standardization serves to resolve data anomalies and data conflicts. ! Data standardization optimizes resources needed for organizational data calls. 5. FME & Data Quality ! Quality Control (QC) over standardized data: "Improves data integrity. "Builds confidence in critical business decisions. "Builds trust in the organization. ! FME helps to develop an effective QC plan. 6. FME & Data Quality ! FME tools provide robust data management capabilities: "Geometry Validator transformer "Tester transformer 7. Geometry Validator Transformer ! As features are harvested from the states, they undergo a geometry validation process: "FME attempts to repair any features with null, degenerate/corrupt or self-intersecting geometries. "An error report is created showing all features and its status as passing, repaired, or not repaired. 8. Building Geometry Checks ! Our organization uses a similar outline of the diagram below to validate feature geometry: 9. Building Geometry Checks 10. Building Geometry Checks 11. Building Geometry Checks 12. Building Geometry Checks 13. Tester Transformer ! Our organization uses the tester transformer to evaluate the attribute integrity of harvested features. ! The tester transformer ensures that attribute values meet the established design constructs. ! Attributes that violate design considerations are noted in the error report. 14. Building Attribute Checks 15. Building Attribute Checks 16. Building Attribute Checks 17. Building Attribute Checks 18. Building Attribute Checks 19. Building Attribute Checks 20. Interpreting The Error Table 21. Maintaining QC ! Data is periodically harvested from the states. ! Once the data satisfies QC measures, as established by the business/program area, it may be published for external customers. 22. Thank You! ! Questions? ! For more information: ! Berk Bayer ( ! Tom Chatfield ( ! Jeff Safran ( ! Northrop Grumman Corporation ( ! Bureau of Land Management ( CONNECT. TRANSFORM. AUTOMATE.