National Marine Fisheries Service

FIS Electronic Reporting Special Interest Group:

West Coast Groundfish Trawl Catch Share Program

- Individual Fish Quota System (IFQ)

Presented by: Richard Kang

Scientific Data Management, NWFSC

Seattle, WA

Aug. 24, 2011

04/19/23

Welcome to the Information Age and Electronic Reporting

04/19/23

What is Data Management?

The development, execution and supervision of plans, policies, practices, and programs that control, protect,deliver, and enhance the value of data and informationassets.

Data Management Association International (DAMA)

04/19/23

04/19/23

“Deliver the right data, information, and services when and where they are needed.”

"To effect a cultural change in which all NMFS data are recognized and managed as a core

agency resource, on par with financial and human resources."

NMFS customers can confidently find, access, and use our data.

04/19/23

• The Magnuson-Stevens Fishery Conservation and Management Act – Oct. 11, 1996 and 2007

• NMFS Catch Share Program• May 2010 - First meeting with NWR• June 2010 - Started Requirements gather process • Sept 2010 - No contractors on board til end of month• Sept – SER lockdown visit (Irene • Nov 2010 - first Prototype• Dec 17, 2010 – Requirements Completed• Dec - User reviews and changes to interface• Dec - working weekend and nights (web conference)• Jan 2011 - Testing,Testing,Testing• Jan 2011 - Multiple releases, collisions, and

coordination• Jan 11, 2011 12:00 - West Coast Groundfish Catch

Share Trawl Program or IFQ launched• Jan – Parties with SDM• Numerous releases and fixes • Mar - Presentation to Pacific Fisheries Council• June – Maintenance• Aug 2011 – Phase II Admin and Renewals

development

04/19/23

Tools:• Oracle DB Ver. 10• Oracle Designer 10• Oracle ApEx 3.0 for reporting/Adhoc Query

reports• Oracle SQL Developer/Toad• Subversion version control• Java (middle tier and web service)• PL/SQL• Adobe Flex 3.0 (Action Script)• Visio, Flex Designer (Visual Interface)• Oracle and Beehive Collaboration Suite• NWFSC Infrastructure – secured

04/19/23

04/19/23

Review ExistingSystems

Functions and Entity Analysis

FunctionalRequirements(Use Cases)

User Acceptance ReviewIFQ Pilot YearJan. 11, 2011

Legislation, Policy, and

BusinessRules

Discoverable Metadata In InPort

Deliver IFQ Application Database in 6 months by Jan. 1 2011Actual Implementation Jan. 11, 2011 at 12:00 PM

04/19/23

IFQ Development Portal

IFQ Collaboration, Document and Content Management

04/19/23

04/19/23

Data Flow Process

04/19/23

QA/QC Process

04/19/23

IFQ Entity Relationship Diagram

04/19/23

Data Dictionary

04/19/23

Function Hierarchy

IFQ Database Environmentand more

04/19/23

IFQ Release Process

IFQ Application

Query & Search Tool

User Help Guide

Training VideosIFQ Production 1.3.3

04/19/23

IFQ DOCUMENTATION STAGES DOCUMENTS/ CHAPTERS  STATUS

  Current Application Version Number V 1.3.3

  SDM Contact and Lead DeveloperRich Kang / Jeff

Cowen  BUDGET Yes

STRATEGY Scoping Document / Grant Proposal* Yes  Project Management Plan No

ANALYSIS Functional Requirements Yes  System Architecture Yes  Workflow Document Draft  Functional Specification* Draft

DESIGN Logical Design* Draft  Crud Matrix Yes  Physical Design* Yes  Data Dictionary* Draft

DEVELOPMENT Milestones Yes  Source Code Subversion  Unit Testing Done

DOCUMENTATION One Page Summary Yes  Tutorial Yes  User Guide Yes  DBA Guide No  Help (Context Sensitive Help) Yes

TESTING System Test Plan Document Yes  Test Cases and Scripts Yes  Type of Testing Manual

DATA QUALITY / ASSURANCE Data Quality Plan DraftTRANSITION Data Uploading Scripts/ Document Yes

DEPLOYMENT SDM Release Document Yes  IT Forms: Project Initiation Checklist Yes  Web Site Policy Checklist Yes  Web Accessibility Checklist Yes

  Web Application Security

Checklist Yes  Quality Control Checklist Yes  Metadata Published in Inport Yes

04/19/23

Next Steps• Phase II IFQ administrative requirements and enhancements –

Summer/Fall 2011

• Account renewals for 2011

• Economic Data Survey database system linkage

• Year 2 rollover on Jan. 1, 2012

• Complete detailed system documentation

• Implement scalable redundant array cluster (RAC)

• Apply lessons learned to on-going projects for further integration

• Observer Program development Oracle DB

Observer in Database and Apex Website

Observer Client in Apex and Oracle XE DB – Dec. 31, 2011

Observer Program Logistics Database – Oct. 1

Observer with AdHoc Query in Apex/GIS - 12/2012

• Celebrate team successes

04/19/23

Economic Data Survey Collectionbuilt in 6 weeks

04/19/23

04/19/23

Metadata Card Catalog

https://inport.nmfs.noaa.gov/inport/item/11090

04/19/23

Lessons Learned• Borrow, learn, and adopt what others have done,

• ASK FOR HELP!!!

• Alaska Region and Center, Pacific States, Southeast Region*, NWR, OLE, NWC and potential users

• Capture extensive business requirements and rules from all participants, extensive review process and the Regs

• The right people, tools, methods, and budgets

• User feedback, bugs, and timely responses until resolved,

• Try new tools (Adobe Flex) and processes (Subversion) leverage past successful efforts (Oracle ApEx, PL/SQL/Java) and enterprise infrastructure supported by IT,

• Web services/ODBC to integrate disparate DB over the web

• Top Down, Agile, and Spiral (don’t get stuck on methodology).

• Data QA/QC resolution issues will take significant time and resources as part of maintenance

04/19/23

ConclusionsData management and Electronic Reporting is successful when your project:

•supports agency’s high priority mission,

•will result in positive management support,

•sufficient budgets,

•the right people, tools, and methods,

•meets tight timeframes

•appreciative customers,

•lead by successful examples,

•celebrate successes,

•Just Do It and Deliver and hope you survive!

04/19/23

04/19/23

Q & A

Crew for hire.Will share code and knowledge.

Contact SDM Helpdesk

04/19/23

Websites

NWR and NWC Websites: https://webapps.nwfsc.noaa.govhttps://webapps.nwfsc.noaa.gov/ifqhttp://www.nwr.noaa.gov/