automated quality controls with fme
DESCRIPTION
This presentation shows how well FME works with ISO standards in quality control and how an FME Server validation service can be used to support data management in a data distribution workflow.TRANSCRIPT
CONNECT. TRANSFORM. AUTOMATE.
Automated quality controls with FME Anna Halvarsson and Johan Esko Metria
. How do I
know if the data meet my quality
demands?
Definition of quality
“The degree to which a set of inherent characteristics fulfills requirements”
ISO 9000:2000
Best quality?
Swedish Technology Journal
“Short wheelbase and minimal overhang at the front and
rear, combined with high ground clearance makes it extremely well suited to continue the drive where the road ends. Indeed the Niva outperform the Porsche Cayenne, which in comparison is clumsy as an elephant with a backpack in a supermarket”.
(Teknikens värld, 2006)
Comment: “If it is the terrain capabilities that is evaluated, the Niva
fulfils the quality requirements better than the Porsche.”
Best quality?
Which one of these view services delivers data with the highest positional accuracy?
How to manage quality in my SDI?
Data QC service - Pilot project
Objectives:
1. The QC service shall in a standardized and traceable way describe the quality of data
2. The QC service shall automatically perform the controls
3. The QC process shall be the link between the EPA:s manuals and the result published by the data host.
Applies to both cars and bikes
Choose the right track for the solution
Excelfile
Shapefile
Excelfile
SchemaMapper
SchemaMapper
SchemaMapper
XMLTemplater
XMLTemplater
XMLValidator
File for QC Harmonise data Create XML/GML (applicationschema)
Test 1 DQ _Logical consistency
Counter
Test 2 DQ_Completeness
Tester
DQ X DQ_ Element
Transformer
Transformer
Metadata (XML)
XMLTemplater
Readable QC report
ISO 19156 O&M
ISO 19131 Data Product specifcation ISO 19157 Data Quality
ISO 19157 DQ
ISO 19157 DQ ISO 19115 Metadata
XSD-file
Air quality reports
Environmental monitoring type 2
Result files
Quality control of Air data
Quality control of Sediment data
Quality control of Biota data
Validate and deliver environmental monitoring data
Select file for quality control:
Metadata XML ISO 19139
QC report HTML
Finally
• During 2014 the validation service will be launched in version 1.0.
• In Sweden a number of agencies have started to work with Product specifications and quality controls according to ISO standards.
• Private companies are also showing much more interest in data quality issues than they did a couple of years ago.
Thank you!
Johan Esko [email protected]
+46 10 121 81 29
Anna Halvarsson [email protected]
+46 10 121 81 49
Thank You!
Questions?
For more information:
Anna Halvarsson, [email protected]
Johan Esko, [email protected]
Metria AB, Sweden
www.metria.se
CONNECT. TRANSFORM. AUTOMATE.