rwdg webinar: metadata to support data governance

1

Copyright © 2016 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com

Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting #RWDG

Robert S. SeinerKIK Consulting & Educational Services, LLC – KIKconsulting.com

The Data Administration Newsletter, LLC – TDAN.com

Real-World Data GovernanceMetadata to Support Data Governance

Monthly Webinar Series Hosted by DATAVERSITYJanuary 21, 2016 – 2:00 p.m. EST

2



• Real-World Data Governance – Monthly Webinar Series – Third Thursday @ 2pET– February 18, 2016 – The Data Model as a Data Governance Artifact– March 17, 2016 – Writing Data Governance Policies & Procedures– April 21, 2016 – How to Implement Data Governance Best Practice– Register On-Line at KIKconsulting.com, TDAN.com, DATAVERSITY.net

• The Data Administration Newsletter (TDAN.com)– Monthly On-Line Publication – January 2016 Issue Available– Content re Data Governance, Metadata,

Data Modeling, Agile, BigData, MDM – Register for monthly email newsletters at TDAN.com

Real-World Data GovernanceWhat’s New?

3



• Non-Invasive Data Governance:The Path of Least Resistance and Greatest Success– ISBN 9781935504856 / Technics Publishing – September 2014

• KIKConsulting.com– Home of Non-Invasive Data Governance™

• How to Build & Implement a Non-Invasive Data Governance™ Program– Two Day Public Class – Pittsburgh, Pennsylvania – March 21 & 22, 2016

• DATAVERSITY Conferences– Enterprise Data Governance On-Line

Anywhere / Anyhow – January 27edgo.dataversity.net

– Enterprise Data World 2016San Diego, California – April 17-22edw2016.dataversity.net

Real-World Data GovernanceWhat’s New?

4



• Metadata is a by-product of executing and enforcing authority over themanagement of data.

• Metadata is also a by-product of formalizing accountability for themanagement of data.

• It is impossible to deliver a successful Data Governance program without it.

• Identifying the appropriate metadata and applying the appropriate level ofgovernance around the metadata is a critical success factor.

Metadata to Support Data GovernanceAbstract

5



• This webinar will cover:– The Relationship between Good Governance and Metadata– Selecting the First and Right Metadata to Manage– Using the Metadata to Support Your Program– Using the Program to Support Your Metadata– Building Governance Metadata into Everyday Events

Metadata to Support Data GovernanceAbstract

6



Metadata to Support Data GovernanceDefinitions

• Data Governance– Data Governance is the Execution and Enforcement of Authority

Over the Management of Data and Data-Related Resources.

• Data Stewardship– Data Stewardship is the Formalization of Accountability

Over the Management of Data and Data-Related Resources.• Metadata

– Data about Data. – Data recorded in IT tools that improves both the

business and technical understanding of thedefinition, production and usage of data.

7




• Non-Invasive Data Governance™

– The practice of applying formal accountability & behavior to assure quality,effective use, compliance, security and protection of data.

– Non-Invasive describes how governance is applied to assurenon-threatening management of valuable data assets.

– The goal is to be» Transparent» Supportive» Collaborative.

8



• [to] gov·ern [data]

v. gov·erned, gov·ern·ing, gov·erns– To make and administer the public policy and affairs [of data]– To exercise sovereign authority [in data]– To control the speed or magnitude [of data]– To regulate [data] – To control the actions or behavior [of data] – To keep under control [data]; to restrain [data] – To exercise a deciding or determining influence [on data] – To exercise political authority [over data] – To have or exercise a determining influence [over data]

FreeDictionary.com [Bob Seiner]


9



• Two Way Street– Metadata is a by-product of formal data governance practices.– Metadata itself must be governed as data.

– You can’t have one without the other.old blue eyes

Metadata to Support Data GovernanceThe Relationship between Good Governance and Metadata

10



• Metadata is a By-Product– First of all … and perhaps most important

Formalizing accountability requires the recording of who is accountable for what.– Recording means “write it down”.


11




12




13




14



• Metadata is a By-Product– To improve quality requires the recording and use of standards.– To improve understanding requires the recording and sharing of business

vocabulary, glossaries and dictionaries.– To improve protection requires formal recording and communications of protection

rules as they apply to everyday handling of data.– To improvement analytical capabilities requires the recording of the best available

data in the best available resource.


15



• Metadata is a By-Product– The information that is recorded is metadata.– Successful governance of data requires that the metadata associated with the

governed discipline is well defined, produced and used.– Data Governance is all about the “Bill of Rights”

• Getting the “right” people • Involved at the “right” time • To do the “right” thing• With the “right” information• To make the “right” decision

– Metadata is a part of each of these “rights”


16



• Metadata itself must be Governed– The metadata will not define, produce and use itself.– Someone must be formally accountable for

• defining what metadata is or will be required• producing the metadata and making certain it is collected and made available• using the metadata to perform their job function

– The accumulation of metadata must be built into data processes that are governed.– Not “Data Governance Processes”

– The Selection of Metadata Must Be Governed!


17



• Someone Must Define What Metadata is Required– Not only define what metadata data is required …– … But also define the metadata that is identified as being required.– Improve “Understanding of Data and Data-Related Assets”.– Improve consistency in the collection of metadata

• What is metadata collected• Where the metadata is collected from• When the metadata will be collected• Who will collect the metadata• How will people access and used the metadata• Why the metadata is necessary to govern data

Metadata to Support Data GovernanceSelecting the First and Right Metadata to Manage

DEFINE

18



• Someone Must Produce the Metadata – Metadata is created by using industry tools

• Data modeling tools – data definition and design metadata• Database tools – physical database metadata• Data movement tools – extraction, transformation, loading metadata• Data analytics tools – location, timing, scientific metadata• Data quality tools – standards, vocabulary, glossary metadata• Data protection tools – classification, handling, enforcement metadata• Workflow tools – process steps, accountability, outcome metadata

– Improve Reliability• Standards for collecting metadata• Formal accountability for metadata that is collected


PRODUCE

19



• Someone Must Use the Metadata– Use metadata to improve analytical capabilities

• Where is the best data & metadata• When they can get the data• How is the best data & metadata defined• How is the best data & metadata produced• How the best data & metadata can be used

– Use metadata to improve protection• Communicate classification schema• Communicate handling rules associated with schema• Identify who stewards the data• Enforce handling rules with stewards


USE

20



• How will you use the program?– Data Definition Governance

• Improve Understanding• Improve Consistency

– Data Production Governance• Improve Data Quality• Improve Reliability

– Data Usage Governance• Improve Analytical Capabilities• Improve Protection

Metadata to Support Data GovernanceUsing the Metadata to Support Your Program

What Roles will people play?

21




• Data Governance Operating Model of Roles & Responsibilities– Executive Level

• Steering Committee– Strategic Level

• Data Governance Council– Tactical Level

• Data Domain Stewards• Data Steward Coordinators

– Operational Level• Data Definers, Data Producers, Data Users

– Support Level• Data Governance Program Team• Information Technology – Data and System SMEs

22




23



Metadata to Support Data GovernanceUsing the Program to Support Your Metadata

• Remember what Data Governance is in the First Place:– Execution and enforcement of authority over the management of

[meta] data and [meta] data related assets.

• Remember what Data Stewardship is in the First Place:– Formalization of accountability for the management of

[meta] data and [meta] data related assets.

24




• Formalize the Accountability to:– Build Governance into Every Major Data Happening – Govern Processes– Build the Definition of Metadata into Every Project – Govern Projects– Build the Collection of Metadata into Every Activity – Govern Tools– Build the Usage of Metadata into Everything You Do – Govern Distribution

25



• “Active” Data Governance– Pro-Active – Through Method / Process / Projects– Re-Active – Through Issue Resolution / Everyday

• Overlay Roles & Responsibilities Over Existing Methodology & Work-Flow

• Data Stewardship Conflict Resolution Paths


26



• System Development Life Cycle (SDLC)Application Development Life Cycle (ADLC)

Data Development Methodology (DDM)DB Development Methodology (DbDM)

– Planning (Roles, Time Commitments, Tasks)– Requirements– Analysis– Design– Development– Testing– Implementation– Maintenance– Enhancement

Metadata to Support Data GovernanceBuilding Governance Metadata into Project Events

27



DATA DEFINER DATA PRODUCER

DATA STEWARDCOORDINATOR

MASTER DATA DEVELOPMENT

LIFE CYCLE(MDDLC)

INFORMATION GATHERING

(DOMAIN, SYSTEM, STEWARDS)

OPERATIONAL DATA STEWARDS

DATA USERDATA DOMAIN

STEWARD(or designee)

DATA DOMAIN / LOB/FUNCTIONAL AREA

ASSESSMENT &REQUIREMENTS

PLANNING &ANALYSIS

SOLUTION DESIGN

SOLUTION DEVELOPMENT

SOLUTION TESTING

SOLUTION IMPLEMENTATION

SOLUTION MONITORING &MAINTENANCE

Activity initiated re: this domain,Data Domain Steward is involved in identifying and recording info related Domains, Systems, Stewards per issue or task.

Activity initiated re: this domain,Steward Coordinator is involved in identifying Operational Stewards in this LOB/FA that should participate in this work flow. Assure appropriate business meta-data is recorded.

Propose alternatives for data definition solution that best fits with defined requirements.

Provide input to the development of the data production solution.

Provide definition requirements & gathering document. Define data needed to operate business & report results.

Test data solution from a definition perspective. Assure that appropriate business meta-data is recorded.

Produce user requirements. Use data needed to operate business & report results.

Coordinate activities of Operational Stewards including project timelines, status reporting, tactical decision making. Assure appropriate business meta-data is recorded.

Provide data definition guidance to build the appropriate solution.

Provide data usage guidance to build the appropriate solution.

Coordinate tasks associated conducting planning and analysis steps.

Propose alternatives for data production that best fits with the data definition solution and defined requirements.

Propose alternatives for data usage solution that best fits with defined requirements.

Coordinate tasks associated conducting planning and analysis steps. Accept or Resolve solution from the Steward Coordinator.

Coordinate activities of all individuals related to development work including timelines, status, tactical decision making.

SYSTEM SMEs

IT

DATA SMEs

Test data solution from a production perspective. Assure that appropriate business meta-data is recorded.

Test data solution from a usage perspective. Assure that appropriate business meta-data is recorded.

Coordinate activities of the Operational Stewards related to testing work including timelines, status, tactical decision making.

Coordinate activities of the Operational Stewards related to solution implementation including timelines, status, tactical decision making.

Coordinate activities of the Operational Stewards related to solution monitoring & maintenance including timelines, status, tactical decision making.

Perform EIS system testing. Assure that appropriate technical meta-data is recorded.

Perform EIS data testing. Assure that appropriate technical meta-data is recorded.

Coordinate and manage all technical aspects of data solution development. Assure that appropriate technical meta-data is recorded.

Coordinate and manage all technical aspects of system solution development. Assure that appropriate technical meta-data is recorded.

Coordinate system design with Data Domain Stewards and Steward Coordinators.

Coordinate data design with Data Domain Stewards and Steward Coordinators.

Coordinate and manage all technical aspects of system planning and analysis with Data Domain Stewards and Steward Coordinators.

Coordinate and manage all technical aspects of data planning and analysis with Data Domain Stewards and Steward Coordinators.

Coordinate and manage all technical aspects of system assessment & requirements gathering with Data Domain Stewards and Steward Coordinators.

Coordinate and manage all technical aspects of data assessment & requirements gathering with Data Domain Stewards and Steward Coordinators.

Coordinate and manage all technical aspects of data information gathering with Data Domain Stewards and Steward Coordinators. Assure appropriate technical meta-data is recorded.

Coordinate and manage all technical aspects of system information gathering with Data Domain Stewards and Steward Coordinators. Assure appropriate technical meta-data is recorded.

Participate in data definition information gathering as needed.

Participate in data production information gathering as needed.

Participate in data usage information gathering as needed.

Coordinate and manage all technical aspects of system solution implementation.

Coordinate and manage all technical aspects of system solution monitoring & maintenance.

Coordinate and manage all technical aspects of data solution implementation.

Coordinate and manage all technical aspects of data solution monitoring & maintenance.

Coordinate business tasks associated with solution testing steps.

Coordinate business tasks associated with solution implementation.

Coordinate business tasks associated with solution monitoring & maintenance.

As part of daily job, identify operation data issues pertaining to their domain of data.




28



DATA DEFINER DATA PRODUCER

DATA STEWARDCOORDINATOR

MASTER DATA DEVELOPMENT

LIFE CYCLE(MDDLC)

INFORMATION GATHERING

(DOMAIN, SYSTEM, STEWARDS)

OPERATIONAL DATA STEWARDS

DATA USERDATA DOMAIN

STEWARD(or designee)

DATA DOMAIN / LOB/FUNCTIONAL AREA

ASSESSMENT &REQUIREMENTS

PLANNING &ANALYSIS

SOLUTION DESIGN

SOLUTION DEVELOPMENT

SOLUTION TESTING

SOLUTION IMPLEMENTATION

SOLUTION MONITORING &MAINTENANCE

Activity initiated re: this domain,Data Domain Steward is involved in identifying and recording info related Domains, Systems, Stewards per issue or task.

Activity initiated re: this domain,Steward Coordinator is involved in identifying Operational Stewards in this LOB/FA that should participate in this work flow. Assure appropriate business meta-data is recorded.

Propose alternatives for data definition solution that best fits with defined requirements.

Provide input to the development of the data production solution.

Provide definition requirements & gathering document. Define data needed to operate business & report results.

Test data solution from a definition perspective. Assure that appropriate business meta-data is recorded.

Produce user requirements. Use data needed to operate business & report results.

Coordinate activities of Operational Stewards including project timelines, status reporting, tactical decision making. Assure appropriate business meta-data is recorded.

Provide data definition guidance to build the appropriate solution.

Provide data usage guidance to build the appropriate solution.

Coordinate tasks associated conducting planning and analysis steps.

Propose alternatives for data production that best fits with the data definition solution and defined requirements.

Propose alternatives for data usage solution that best fits with defined requirements.

Coordinate tasks associated conducting planning and analysis steps. Accept or Resolve solution from the Steward Coordinator.

Coordinate activities of all individuals related to development work including timelines, status, tactical decision making.

SYSTEM SMEs

IT

DATA SMEs

Test data solution from a production perspective. Assure that appropriate business meta-data is recorded.

Test data solution from a usage perspective. Assure that appropriate business meta-data is recorded.

Coordinate activities of the Operational Stewards related to testing work including timelines, status, tactical decision making.

Coordinate activities of the Operational Stewards related to solution implementation including timelines, status, tactical decision making.

Coordinate activities of the Operational Stewards related to solution monitoring & maintenance including timelines, status, tactical decision making.

Perform EIS system testing. Assure that appropriate technical meta-data is recorded.

Perform EIS data testing. Assure that appropriate technical meta-data is recorded.

Coordinate and manage all technical aspects of data solution development. Assure that appropriate technical meta-data is recorded.

Coordinate and manage all technical aspects of system solution development. Assure that appropriate technical meta-data is recorded.

Coordinate system design with Data Domain Stewards and Steward Coordinators.

Coordinate data design with Data Domain Stewards and Steward Coordinators.

Coordinate and manage all technical aspects of system planning and analysis with Data Domain Stewards and Steward Coordinators.

Coordinate and manage all technical aspects of data planning and analysis with Data Domain Stewards and Steward Coordinators.

Coordinate and manage all technical aspects of system assessment & requirements gathering with Data Domain Stewards and Steward Coordinators.

Coordinate and manage all technical aspects of data assessment & requirements gathering with Data Domain Stewards and Steward Coordinators.

Coordinate and manage all technical aspects of data information gathering with Data Domain Stewards and Steward Coordinators. Assure appropriate technical meta-data is recorded.

Coordinate and manage all technical aspects of system information gathering with Data Domain Stewards and Steward Coordinators. Assure appropriate technical meta-data is recorded.

Participate in data definition information gathering as needed.

Participate in data production information gathering as needed.

Participate in data usage information gathering as needed.

Coordinate and manage all technical aspects of system solution implementation.

Coordinate and manage all technical aspects of system solution monitoring & maintenance.

Coordinate and manage all technical aspects of data solution implementation.

Coordinate and manage all technical aspects of data solution monitoring & maintenance.

Coordinate business tasks associated with solution testing steps.

Coordinate business tasks associated with solution implementation.

Coordinate business tasks associated with solution monitoring & maintenance.





Sample metadataData RequirementsData ModelsDatabase DesignDATA MappingData etl processReports & queriesBusiness glossaryBusiness rules

29




30




Sample metadataMaster data subject areasSpecific data elementsAppropriate stewardsSystems, databasesSystem of record

31



Metadata to Support Data GovernanceBuilding Governance Metadata into Everyday Events

32




33




34




Sample metadataQuality issuesQuality rulesResolutionCompliance rulesProtection rulesBusiness vocabularyData requirements

35



• Data Quality Methodology / Issue Resolution Process– Qualify & Prioritize Data Issue– Identify Affected Data Domain– Identify Affected Data Stewards– Conduct Data Systems & Data Resource Discovery– Conduct Root Cause Analysis– Conduct Cost-Benefit Analysis– Analyze & Recommend Resolution– Gain Approval, Funding, Resources– Resolve Data Issue

• Cross Reference DQ Methodology & Resources– Who does What and When?


36




37




Sample metadataStakeholdersCommon data matrixIssue solutionTesting resultsChange managementSolution metrics

38



• This webinar covered:– The Relationship between Good Governance and Metadata– Selecting the First and Right Metadata to Manage– Using the Metadata to Support Your Program– Using the Program to Support Your Metadata– Building Governance Metadata into Project / Everyday Events

Metadata to Support Data GovernanceWrap Up

39



• Real-World Data Governance – Monthly Webinar Series – Third Thursday @ 2pET– February 18, 2016 – The Data Model as a Data Governance Artifact– Register On-Line at KIKconsulting.com, TDAN.com, DATAVERSITY.net

Real-World Data GovernanceUpcoming Webinars

40



ContactInformation

• Robert S. SeinerKIK Consulting & Educational Services, LLC – KIKconsulting.comThe Data Administration Newsletter, LLC – TDAN.comPost Office Box 112571, Upper St. Clair, Pennsylvania 15241412.220.9643, 412.220.9644 (Fax)[email protected]@tdan.com