FS Enterprise Data Warehouse
and Standard Reference Data
EDW Purpose and Benefits
Provide a trusted source of information from FS authoritative sources
Aggregate data from multiple FS programs and make it accessible
Provide tools for data analysis and management reporting
Provide public access to FS data
Promote data quality
Promote data standardization
Reduce redundant data storage
2ENTERPRISE DATA WAREHOUSE (EDW) OVERVIEW
EDW provides one-stop shopping for standardized, current, trusted data from disparate sources to be used for analysis or for sharing with external partners
ENTERPRISE DATA WAREHOUSE (EDW) OVERVIEW 3
What is the EDW?
ENTERPRISE DATA WAREHOUSE (EDW) OVERVIEW 4
One Data Source – Many Publication Formats
ENTERPRISE DATA WAREHOUSE (EDW) OVERVIEW 5
Some EDW FeaturesContent Governance – EDW Content Governance Board reviews and approves proposals for all EDW content
Data Quality Forum – by publishing the data for broader use, there is increased review and use of the data. Data Quality forum allows FS users to comment on issues identified in the data. Issues forwarded to data owners for resolution.
Data Status information is available on proposed content from the proposal phase through development to publication.
ENTERPRISE DATA WAREHOUSE (EDW) OVERVIEW 6
FS internal information resources on SharePoint
EDW SharePoint Site: Program overview, strategy, tools, alerts Data Status: What data is available? Status of proposed data content. Data Quality Forum: Report issues with data quality Users Forum: Report problems, make suggestions Training o General GIS Trainingo Use of EDW Best Practices
EDW Content Governance: process, charter, decision record, minutes, Governance content status
ENTERPRISE DATA WAREHOUSE (EDW) OVERVIEW 7
EDW Standard Reference DataReference data is any kind of data that is used to categorize other data found in a database, or for relating data in a database to information outside of the database. It is usually managed as a set of values (acronyms or codes) and descriptions, and examples include lists of counties, states, and countries.
Reference data in the EDW goes through the Content approval process, and therefore can be considered an FS data standard.
ENTERPRISE DATA WAREHOUSE (EDW) OVERVIEW 8
Benefits of Standard Reference Data in the EDWProvides data that can be used to link data from disparate programs
Provides developers with needed data that is accurate, current, and readily accessible
Reduces use of multiple (potentially inconsistent) versions of the same reference data in different parts of agency operation
Provides metadata that documents data source
Acquisition and maintenance of reference data is more cost-effective and convenient—individual applications do not need to acquire and maintain their own reference data.
ENTERPRISE DATA WAREHOUSE (EDW) OVERVIEW 9
Internal and External Reference Data SourcesPriorities were identified in interviews with FS programs
External reference data: States (Census) Counties (Census) Congressional Districts (Census)
Other external data: Hydrologic Unit Codes (HUCs) (USGS) Others under consideration
Internal reference data: Standard Administrative Unit Names (and Codes) FS Office Locations (and related People, Units, and Building information) – under development
ENTERPRISE DATA WAREHOUSE (EDW) OVERVIEW 10
ENTERPRISE DATA WAREHOUSE (EDW) OVERVIEW
Standard Reference Data Business Process Workflow
11
Reference Data Documentation and ArtifactsData analysis (spreadsheet)
Use Case
Data Standard
Business Rules
Data Model
Web Services – RESTful services developed for applications to consume EDW data using a URL (i.e., Get method) or HTML form (i.e., Post method). Examples provided for developers incorporating a web service call directly from their application through Oracle PL/SQL.
ENTERPRISE DATA WAREHOUSE (EDW) OVERVIEW 12
Using EDW Data Public Access to FS data:
Data and services with Data.Gov http://catalog.data.gov/organization/fs-fed-us Data download capability for the public - http://data.fs.usda.gov/geodata/edw/datasets.phpData available via map services http://data.fs.usda.gov/geodata/edw/mapServices.phpData available via data extract tool http://data.fs.usda.gov/geodata/edw/dataExtract.php
Collaborative Business Intelligence environment – internal use:Cognos and ESRI Maps tools available to developers from various FS programs -
https://ems-team.usda.gov/sites/fs-cio-edwts/edw-developers/SitePages/Home.aspx Connecting to the data via ArcGIS (via Citrix): T:\FS\Reference\GeoTool\agency\DatabaseConnection\edwdb - sde.default as myself.sde
Map services: Internal: Available only to FS usersExternal: Available to FS users and the external public
ENTERPRISE DATA WAREHOUSE (EDW) OVERVIEW 13
Public Distribution of FS Data: http://data.fs.usda.gov/geodata/edw/index.php
ENTERPRISE DATA WAREHOUSE (EDW) OVERVIEW 14
LOCATIONAL BUSINESS INTELLIGENCE IN THE U.S. FOREST SERVICE 15
Questions?
June 2015
