Oceanak Soup-2-Nuts

OceanakSoup-2-Nuts

Alaska Department of Fish & GameCommercial Fisheries

February, 2012

Soup-2-NutsAn Overview of the Commercial Fisheries Data Warehouse and Business Intelligence Structure

Project ObjectivesComponentsShow MeProject Status & In ProcessAdhoc WorkshopProject ObjectivesProvide a Single Reporting Tool for All Commercial FisheriesEliminate multiple technologies and make better use of our programmers and end users timeProvide end users with a common interface where we can integrate data entry applications Provide users with both powerful ad-hoc capabilities and canned reports3Project ObjectivesProvide a Single Reporting Tool for All Commercial Fisheries (continued)Provide users with scheduled reports - supports low bandwidth areasProvide state-wide views and access to data across regionsProvide ongoing workshops in this common tool & use staff to teach staff as well as share designs.The OceanAk dashboard in Dev is the one you want. The 2 links that actually open up a Flex app are Invertebrate Dive Surveys and Herring Spawn Survey.

4Project ObjectivesProvide a Data Warehouse as a Reporting SourceIntegrate dataTransform data when requiredDivorce Reporting from Data EntryReporting Friendly source of dataData Rescue SupportPer Subject Area, review data inventory and provide a home for endangered data

Capabilities to integrate stove-piped datasets into single subject areas

5ComponentsSource Database Oracle Data Integrator (ODI)Oracle Data WarehouseOracle Business Intelligence AdministratorOracle Business Intelligence (OBI or BI)

=

Derived from: OCEANUS (keanos), the god of the river Oceanus, by which the whole earth was surrounded.

BUCKETHAMMERHOUSESCREWDRIVERWINDOWFRONT DOOR6Source Database

Original storage point of data entryRelational Database - Supports fast and valid data entrySource Database

Many sources in CFMany types of databasesMany input applicationsNone talk to each otherDuplicated dataYouve all seen this before8Source Systems

What you dont see:The plethora of individual reporting technologiesThe inability of staff to cross application boundariesMan-hours lost manually manipulating dataMan-hours lost duplicating effortData IntegratorHas one job Map from point A to point B. Can change the shape of the data to optimize for reporting Can apply logic and combine source databasesIs optional!

Data WarehouseCan consolidate from many sourcesCan be rebuilt from scratchScheduled updates according to needsIs optional!

OBI Administrator A tool used to prepare the data for use from various sources for use in the OBI InterfaceUses data direct from source databases or data warehouse (ODI and Data Warehouse optional)Can add value: Calculated fields, HierarchiesOrganizes data by Subject Areas

OBI InterfaceThe web based end-user toolDashboardsCustom and Ad-hoc reportsPublic web reports & charts

Dashboards = Organizational units, group report (analysis), application links. Top level is regional, statewide is available.Custom = canned reports, written by programmers or shared by other users.Public web = dynamic reporting13All TogetherSource DatabaseData IntegratorData WarehouseBI Administrator BI User Interface

What is ETL?ETL means Extract, Transform and LoadExecuted by Oracle Data Integrator (ODI)Extract Grab the data from the source(s)Transform Any restructuring to make reporting easier (i.e. Merge data from multiple tables)Load Store the data in the data warehouseOnly used if data is required to be integrated with other sources or transformed. (General rule). First step get the data from the source database(s)15Will All Data Use the Warehouse?

Data that does not require transformation may not use the data warehouseMuch simpler &quicker to buildCan join later!Why Transform the Data?

17eLandings Source Database

ETL Using Oracle Data Integrator (ODI) Loading data warehouse

ODI Task LOAD_ITEM_FACTS

Target Data Warehouse Table

OBI Admin

22BI Admin Physical LayerDefines the physical data model of your data source

BI Admin Business ModelAllows you to set upFact table with measuresDimension tablesHierarchies

BI Admin Presentation LayerThe structure that is presented to the userAccessed through logical sqlNo key columns

Show Me OBI InterfaceOracle Answers & DashboardsOceanak ADFG staff interfaceOceanak Public WebCurrent StatusRegion I ready for Test. Production in SpringRegion I & Region II Public reporting in productioneLandings is in full ProductionStaff trained Dutch, Homer, Kodiak SE this winterBlueSheets is in ProductionMariner V2012 is in designFish Tickets Detail Iterative Testing of ETLMTAL , Region III and Region IV IT staff in trainingFutureCOAR/ITOWaiting eLandings planningASL Repository Move/ExpandWork in conjunction with ASL projectExpansion of Mariner V2013 to Region IIIRegion III and AOOS ProjectSpatial data / Reporting with mapsIntegration of new Metadata data entry and queryCombined eLandings/Fish Ticket subject area (Unverified/Verified)Soup-2-NutsbyKathy JonesAmmon BaileyPaul CaldwellScott Johnson