agile data governance and warehousing via simplified semantics · knowledge discovery and...
TRANSCRIPT
![Page 1: Agile Data Governance and Warehousing via Simplified Semantics · Knowledge Discovery and Dissemination Information and data engineering 2. ... • Authoritative data • Leverage](https://reader034.vdocuments.mx/reader034/viewer/2022042122/5e9cf701fed1914e181835db/html5/thumbnails/1.jpg)
Agile Data Governance and Warehousing via Simplified Semantics
Delivering Agile Data
Dr. Geoffrey Malafsky, CEO/CTO
![Page 2: Agile Data Governance and Warehousing via Simplified Semantics · Knowledge Discovery and Dissemination Information and data engineering 2. ... • Authoritative data • Leverage](https://reader034.vdocuments.mx/reader034/viewer/2022042122/5e9cf701fed1914e181835db/html5/thumbnails/2.jpg)
An Introduction: Geoffrey Malafsky
• Phasic Systems Inc CEO, CTO▫ Tackle the toughest data management problems.▫ Simplifying and accelerating data design and aggregation
• PhD in Nanotechnology from The Pennsylvania State University• Research scientist at the Naval Research Laboratory • Supported many organizations in their quest to get the right
information at the right time• Technology consultant in multiple fields including: ▫ Nanotechnology▫ Knowledge Discovery and Dissemination▫ Information and data engineering
2
![Page 3: Agile Data Governance and Warehousing via Simplified Semantics · Knowledge Discovery and Dissemination Information and data engineering 2. ... • Authoritative data • Leverage](https://reader034.vdocuments.mx/reader034/viewer/2022042122/5e9cf701fed1914e181835db/html5/thumbnails/3.jpg)
Topics
• Bringing agility and coordination to governance, design, and warehousing
• Using simplified semantics to design data models for flexibility, standardization, and performance
• Agile data aggregation (Q&A)
3
![Page 4: Agile Data Governance and Warehousing via Simplified Semantics · Knowledge Discovery and Dissemination Information and data engineering 2. ... • Authoritative data • Leverage](https://reader034.vdocuments.mx/reader034/viewer/2022042122/5e9cf701fed1914e181835db/html5/thumbnails/4.jpg)
Bringing agility and coordination to governance, design, and warehousing
4
![Page 5: Agile Data Governance and Warehousing via Simplified Semantics · Knowledge Discovery and Dissemination Information and data engineering 2. ... • Authoritative data • Leverage](https://reader034.vdocuments.mx/reader034/viewer/2022042122/5e9cf701fed1914e181835db/html5/thumbnails/5.jpg)
Governance
• “The act, process, or power of governing; government” (Houghton-Mifflin)
• There are increasing legal ramifications (corporate and personal)
• Governing relies on decision making, planning, communicating
• Each part of the process requires knowledge, analysis, rules, data, and a common language
5
![Page 6: Agile Data Governance and Warehousing via Simplified Semantics · Knowledge Discovery and Dissemination Information and data engineering 2. ... • Authoritative data • Leverage](https://reader034.vdocuments.mx/reader034/viewer/2022042122/5e9cf701fed1914e181835db/html5/thumbnails/6.jpg)
Information/Data Management
• There are many types of information/data: ▫ Documents, structured data, unstructured text, images,
audio, transient content • We want to collect, organize, store, and disseminate
information/data across physical, organizational, topical, and temporal boundaries
• Some challenges: ▫ quantity, quality, trustworthiness, system performance,
reliable categorization, version control, identifying & separating good/bad, useful/useless, complying with changing laws & policies, reuse, flexibility, adaptability
6
![Page 7: Agile Data Governance and Warehousing via Simplified Semantics · Knowledge Discovery and Dissemination Information and data engineering 2. ... • Authoritative data • Leverage](https://reader034.vdocuments.mx/reader034/viewer/2022042122/5e9cf701fed1914e181835db/html5/thumbnails/7.jpg)
The Symbiosis
• Governing without current, validated, meaningful information/data leads to bad decisions and organizational inefficiency or even disaster (--fill in news headline here---)
• Producing and consuming information/data separate from continuous, direct governance leads to rework and delays, or worse, dangerous and costly mistakes
7
![Page 8: Agile Data Governance and Warehousing via Simplified Semantics · Knowledge Discovery and Dissemination Information and data engineering 2. ... • Authoritative data • Leverage](https://reader034.vdocuments.mx/reader034/viewer/2022042122/5e9cf701fed1914e181835db/html5/thumbnails/8.jpg)
Problem Statement
• There is a very large and growing amount of data• Too much data dispersed over many systems• Need consistency, commonality for enterprise
applications and analytics• Data cannot be readily aggregated due to
conflicting meanings and lack of documentation • Cannot transition to Cloud without new approaches
and tools for data management
8
![Page 9: Agile Data Governance and Warehousing via Simplified Semantics · Knowledge Discovery and Dissemination Information and data engineering 2. ... • Authoritative data • Leverage](https://reader034.vdocuments.mx/reader034/viewer/2022042122/5e9cf701fed1914e181835db/html5/thumbnails/9.jpg)
Options
• Status quo: non-Agile data design, management and integration - expensive, time-consuming because requires brute-force
• Current tools▫ Data modeling: ERWIN, Oracle, XML, Semantics▫ Integration: Informatica, IBM DataStage▫ Analytics/Reporting: Cognos, MicroStrategy
• Adopt efficient, cost effective, Agile business-centric modeling, integration working with existing systems in evolutionary transition to new technologies (e.g. NoSQL)
9
![Page 10: Agile Data Governance and Warehousing via Simplified Semantics · Knowledge Discovery and Dissemination Information and data engineering 2. ... • Authoritative data • Leverage](https://reader034.vdocuments.mx/reader034/viewer/2022042122/5e9cf701fed1914e181835db/html5/thumbnails/10.jpg)
• Authoritative data• Leverage existing infrastructure
Agile andCoordinated
UsersData Modeling
Integration
Analytics/Reporting
10
• Timely, Agile, flexible• Meaningful analytics
![Page 11: Agile Data Governance and Warehousing via Simplified Semantics · Knowledge Discovery and Dissemination Information and data engineering 2. ... • Authoritative data • Leverage](https://reader034.vdocuments.mx/reader034/viewer/2022042122/5e9cf701fed1914e181835db/html5/thumbnails/11.jpg)
Coordinate Key Components
11
![Page 12: Agile Data Governance and Warehousing via Simplified Semantics · Knowledge Discovery and Dissemination Information and data engineering 2. ... • Authoritative data • Leverage](https://reader034.vdocuments.mx/reader034/viewer/2022042122/5e9cf701fed1914e181835db/html5/thumbnails/12.jpg)
Lessons Learned
• We need clear, declarative statements not abstract goals• We need detailed architecture including:▫ current data models, ▫ code dictionaries, ▫ and usage in business processes
• We need to define and monitor detailed metrics on data quality and level of effort to maintain and disseminate meaningful data
12
![Page 13: Agile Data Governance and Warehousing via Simplified Semantics · Knowledge Discovery and Dissemination Information and data engineering 2. ... • Authoritative data • Leverage](https://reader034.vdocuments.mx/reader034/viewer/2022042122/5e9cf701fed1914e181835db/html5/thumbnails/13.jpg)
Why Is the Data Lifecycle So Difficult?
• Governance, design, integration, Master Data Mgmt all require coordinated knowledge▫ Which value should be used when? Whose is right in this
situation? • Data meaning is just as important as its structure▫ Semantics focuses on actual meaning▫ This is NOT given by database technical metadata
• Building data standards and enterprise logical models must adapt to new business needs and timelines▫ Continuous changes are the norm: requirements,
consolidation▫ Important business terms really do have multiple definitions
![Page 14: Agile Data Governance and Warehousing via Simplified Semantics · Knowledge Discovery and Dissemination Information and data engineering 2. ... • Authoritative data • Leverage](https://reader034.vdocuments.mx/reader034/viewer/2022042122/5e9cf701fed1914e181835db/html5/thumbnails/14.jpg)
Agility
• Agility focuses on value produced not formal methodologies
• Agile manifesto for software development▫ Individuals and interactions over processes and tools▫ Working software over comprehensive documentation▫ Customer collaboration over contract negotiation▫ Responding to change over following a plan
14
![Page 15: Agile Data Governance and Warehousing via Simplified Semantics · Knowledge Discovery and Dissemination Information and data engineering 2. ... • Authoritative data • Leverage](https://reader034.vdocuments.mx/reader034/viewer/2022042122/5e9cf701fed1914e181835db/html5/thumbnails/15.jpg)
Agility• Agile Declaration of Interdependence for project management▫ We increase return on investment by making continuous flow of
value our focus.▫ We deliver reliable results by engaging customers in frequent
interactions and shared ownership.▫ We expect uncertainty and manage for it through iterations,
anticipation, and adaptation.▫ We unleash creativity and innovation by recognizing that
individuals are the ultimate source of value, and creating an environment where they can make a difference.
▫ We boost performance through group accountability for results and shared responsibility for team effectiveness.
▫ We improve effectiveness and reliability through situationallyspecific strategies, processes and practices.
15
![Page 16: Agile Data Governance and Warehousing via Simplified Semantics · Knowledge Discovery and Dissemination Information and data engineering 2. ... • Authoritative data • Leverage](https://reader034.vdocuments.mx/reader034/viewer/2022042122/5e9cf701fed1914e181835db/html5/thumbnails/16.jpg)
Coordinating and Making Agile• Adjust organizational groups and authorities to promote
enterprise commonality, consistency, and understanding ▫ Logical and physical modeling are intertwined and need day-
to-day iterative integrated design to trade-off performance, adaptability, manageability
16
![Page 17: Agile Data Governance and Warehousing via Simplified Semantics · Knowledge Discovery and Dissemination Information and data engineering 2. ... • Authoritative data • Leverage](https://reader034.vdocuments.mx/reader034/viewer/2022042122/5e9cf701fed1914e181835db/html5/thumbnails/17.jpg)
17
Coordinating and Making AgileShorten and combine design and implementation efforts
![Page 18: Agile Data Governance and Warehousing via Simplified Semantics · Knowledge Discovery and Dissemination Information and data engineering 2. ... • Authoritative data • Leverage](https://reader034.vdocuments.mx/reader034/viewer/2022042122/5e9cf701fed1914e181835db/html5/thumbnails/18.jpg)
Coordinating and Making Agile
18
Design for changing, non-deterministic business requirements with many combinations of rules, processes, data, and analyses
![Page 19: Agile Data Governance and Warehousing via Simplified Semantics · Knowledge Discovery and Dissemination Information and data engineering 2. ... • Authoritative data • Leverage](https://reader034.vdocuments.mx/reader034/viewer/2022042122/5e9cf701fed1914e181835db/html5/thumbnails/19.jpg)
Coordinating and Making Agile
19
Use a simple, standards-based concept framework to capture knowledge and use cases according to different world views, i.e. perspectives
![Page 20: Agile Data Governance and Warehousing via Simplified Semantics · Knowledge Discovery and Dissemination Information and data engineering 2. ... • Authoritative data • Leverage](https://reader034.vdocuments.mx/reader034/viewer/2022042122/5e9cf701fed1914e181835db/html5/thumbnails/20.jpg)
Case Study – Navy Data Strategy
• Problem: Large organization, dispersed mgmt, data is redundant, conflicting, difficult to govern and consolidate
• Previous approaches: 10 years of organizational policies and structures (e.g. Functional Data Mgrs), and warehouse development could not solve problem
• Solution – Used Facilitated Agile Governance and modeling• Results – 90 days, achieved new data strategy with concrete
process, definitions, metrics and widespread consensus• Customer Reaction – “We accomplished more in three months with
DataStar than we did in the past three years.“ Dept of Navy CIO
20
![Page 21: Agile Data Governance and Warehousing via Simplified Semantics · Knowledge Discovery and Dissemination Information and data engineering 2. ... • Authoritative data • Leverage](https://reader034.vdocuments.mx/reader034/viewer/2022042122/5e9cf701fed1914e181835db/html5/thumbnails/21.jpg)
Navy Data Strategy• Use a lifecycle approach drawn from industry standards• Use existing sources for definitions and requirements• Eliminate nebulous, impractical requirements• Add organizationally specific processes and requirements• Expand each process into a handful of important functions• Define objectives, measurable metrics, and key
inputs/outputs for each function • Consolidate when possible; embrace variations when
necessary
21
![Page 22: Agile Data Governance and Warehousing via Simplified Semantics · Knowledge Discovery and Dissemination Information and data engineering 2. ... • Authoritative data • Leverage](https://reader034.vdocuments.mx/reader034/viewer/2022042122/5e9cf701fed1914e181835db/html5/thumbnails/22.jpg)
22
Navy Data Strategy: Process Functions
![Page 23: Agile Data Governance and Warehousing via Simplified Semantics · Knowledge Discovery and Dissemination Information and data engineering 2. ... • Authoritative data • Leverage](https://reader034.vdocuments.mx/reader034/viewer/2022042122/5e9cf701fed1914e181835db/html5/thumbnails/23.jpg)
23
Navy Data Strategy: Processes
![Page 24: Agile Data Governance and Warehousing via Simplified Semantics · Knowledge Discovery and Dissemination Information and data engineering 2. ... • Authoritative data • Leverage](https://reader034.vdocuments.mx/reader034/viewer/2022042122/5e9cf701fed1914e181835db/html5/thumbnails/24.jpg)
24
Navy Data Strategy• Links technology, processes, organizations
via simplified, predefined concept framework
• Must be easy to see, easy to understand, collaborative, and iterative
![Page 25: Agile Data Governance and Warehousing via Simplified Semantics · Knowledge Discovery and Dissemination Information and data engineering 2. ... • Authoritative data • Leverage](https://reader034.vdocuments.mx/reader034/viewer/2022042122/5e9cf701fed1914e181835db/html5/thumbnails/25.jpg)
Using simplified semantics to design data models for flexibility, standardization, and performance
25
![Page 26: Agile Data Governance and Warehousing via Simplified Semantics · Knowledge Discovery and Dissemination Information and data engineering 2. ... • Authoritative data • Leverage](https://reader034.vdocuments.mx/reader034/viewer/2022042122/5e9cf701fed1914e181835db/html5/thumbnails/26.jpg)
The Semantic Moat
• Semantics means data’s actual meaning▫ This is NOT the same as database metadata (table and
element names)• When is a “customer” not a “customer” ?▫ When Sales, Accounting, Product Development, CEO, (SAP,
IBM, Oracle, ….) use it in their systems• Why can’t these be consolidated into one common
definition ?▫ Strong disincentives to give up control of definitions, system
control, peer prestige▫ Complexity of evolving integrated business-technology-
organization perspectives
26
![Page 27: Agile Data Governance and Warehousing via Simplified Semantics · Knowledge Discovery and Dissemination Information and data engineering 2. ... • Authoritative data • Leverage](https://reader034.vdocuments.mx/reader034/viewer/2022042122/5e9cf701fed1914e181835db/html5/thumbnails/27.jpg)
Non-Agile Methods to Define Semantics
• Business Process Modeling• Enterprise Architecture• Industry standard data models• Industry standard XML schema• Ad-hoc team meetings• Anything in a spreadsheet
27
![Page 28: Agile Data Governance and Warehousing via Simplified Semantics · Knowledge Discovery and Dissemination Information and data engineering 2. ... • Authoritative data • Leverage](https://reader034.vdocuments.mx/reader034/viewer/2022042122/5e9cf701fed1914e181835db/html5/thumbnails/28.jpg)
Common Approach: List Mapping
• Creates multiple lists of entities and maps among them▫ Brute force▫ Relies on technical metadata (titles, types)▫ Unaware of actual use case context and value space ▫ Only works in simple situations
• Usually done in spreadsheets▫ Hard to maintain version control▫ Hard to capture collaborative knowledge▫ Prone to mechanical errors
• Depends on prior, often undocumented, modeling constraints and rationale
• Does not address underlying semantics nor help guide to common definitions, standards
28
![Page 29: Agile Data Governance and Warehousing via Simplified Semantics · Knowledge Discovery and Dissemination Information and data engineering 2. ... • Authoritative data • Leverage](https://reader034.vdocuments.mx/reader034/viewer/2022042122/5e9cf701fed1914e181835db/html5/thumbnails/29.jpg)
Common Approach: Canonical Model
• Creates set of concept entities with well defined semantics• Map all model entities to new canonical entities• Requires detailed knowledge of actual use case context
and value space prior to determining entity set• Produces a conceptual or logical model but disconnected
from system performance issues • Usually produces highly abstract entities unsuitable for
data engineering• Focus may be on building consensus around new terms
instead of using existing standards and identifying underlying semantics, commonality, and consolidation
29
![Page 30: Agile Data Governance and Warehousing via Simplified Semantics · Knowledge Discovery and Dissemination Information and data engineering 2. ... • Authoritative data • Leverage](https://reader034.vdocuments.mx/reader034/viewer/2022042122/5e9cf701fed1914e181835db/html5/thumbnails/30.jpg)
Non-Agile Data Modeling
• The “standard” modeling techniques were designed for non-enterprise situations where▫ Requirements could be deterministically defined▫ Requirements were stable over design and implementation▫ Semantics, whether explicit or implicit, could be captured in the
model’s hierarchy, relations, and constraints▫ Rigidly defined tables, attributes, facts, dimensions could be
adapted to business applications and analytics with reasonable effort
• Current options (Inmon vs Kimball; dimensional vs normalized) need to adapt to new era
• XML: Many standards (NIEM, XBRL, HRXML, ..) that are complicated with confusing semantics
30
![Page 31: Agile Data Governance and Warehousing via Simplified Semantics · Knowledge Discovery and Dissemination Information and data engineering 2. ... • Authoritative data • Leverage](https://reader034.vdocuments.mx/reader034/viewer/2022042122/5e9cf701fed1914e181835db/html5/thumbnails/31.jpg)
Real Estate Listing Example• Seems simple and well-defined▫ Each house has a type, id, address, etc..▫ Industry standards: OSCRE, RETS
• Yet, data systems are very different▫ Data model tied tightly to business workflow▫ Add-ons and extensions and make-it-work changes over time
• Similar to customer relationship mgmt, ERP, and many other fields
31
![Page 32: Agile Data Governance and Warehousing via Simplified Semantics · Knowledge Discovery and Dissemination Information and data engineering 2. ... • Authoritative data • Leverage](https://reader034.vdocuments.mx/reader034/viewer/2022042122/5e9cf701fed1914e181835db/html5/thumbnails/32.jpg)
Semantic Conflict in Real Estate Models
32
NKY
HOMESEEKERS
NKY attribute ‘basement’ does not have a corollary in
HOMESEEKERS
![Page 33: Agile Data Governance and Warehousing via Simplified Semantics · Knowledge Discovery and Dissemination Information and data engineering 2. ... • Authoritative data • Leverage](https://reader034.vdocuments.mx/reader034/viewer/2022042122/5e9cf701fed1914e181835db/html5/thumbnails/33.jpg)
Agile Data Systems• High volume, adaptive web data systems use Agile
techniques▫ Facebook, Google, Yahoo, …….▫ NoSQL databases: based on key-value pairs Cassandra, Mongo DB, Hadoop, ..
▫ Elevate logic and rules of how data relates and is grouped out of the database into applications
▫ But, they lack a visible, direct connection to business requirements and governance so are poorly suited to corporate use
33
![Page 34: Agile Data Governance and Warehousing via Simplified Semantics · Knowledge Discovery and Dissemination Information and data engineering 2. ... • Authoritative data • Leverage](https://reader034.vdocuments.mx/reader034/viewer/2022042122/5e9cf701fed1914e181835db/html5/thumbnails/34.jpg)
DataStar Hybrid NoSQL
• PSI created a hybrid for corporate environments and when strong, continuous, Agile governance is needed▫ Object-based ▫ Business driven terminology▫ Easily handles all semantic variations and updates without
any changes to logical or physical models, or physical storage
▫ Governance concepts directly implemented in physical layer▫ Can be as ‘dimensional’ or ‘normalized’ as desired
• Uses simplified semantic framework based on intuitive, standard concepts for agile and continuous model requirements
34
![Page 35: Agile Data Governance and Warehousing via Simplified Semantics · Knowledge Discovery and Dissemination Information and data engineering 2. ... • Authoritative data • Leverage](https://reader034.vdocuments.mx/reader034/viewer/2022042122/5e9cf701fed1914e181835db/html5/thumbnails/35.jpg)
Semantic Framework Components• Typical semantic frameworks repeat
the mistake of fragmented activities▫ Collect knowledge determine
business rules design conceptual model (i.e. ontology) specify data/metadata semantics
• These components should be coordinated
• These components should be hidden from users to avoid confusion and unnecessary complexity
35
![Page 36: Agile Data Governance and Warehousing via Simplified Semantics · Knowledge Discovery and Dissemination Information and data engineering 2. ... • Authoritative data • Leverage](https://reader034.vdocuments.mx/reader034/viewer/2022042122/5e9cf701fed1914e181835db/html5/thumbnails/36.jpg)
Unified Business Model
36
![Page 37: Agile Data Governance and Warehousing via Simplified Semantics · Knowledge Discovery and Dissemination Information and data engineering 2. ... • Authoritative data • Leverage](https://reader034.vdocuments.mx/reader034/viewer/2022042122/5e9cf701fed1914e181835db/html5/thumbnails/37.jpg)
Unified Business Model: Agile Design• Add business context to technical metadata• Collect subject matter knowledge• Identify semantic definitions, variations, and opportunities
to consolidate• Specify basis of data model entities• Automatically determine commonality across data models
using more than just simple titles ▫ Use in business activities▫ Similar values (e.g. referencing master codes)
37
![Page 38: Agile Data Governance and Warehousing via Simplified Semantics · Knowledge Discovery and Dissemination Information and data engineering 2. ... • Authoritative data • Leverage](https://reader034.vdocuments.mx/reader034/viewer/2022042122/5e9cf701fed1914e181835db/html5/thumbnails/38.jpg)
38
Navy Data Strategy Example
![Page 39: Agile Data Governance and Warehousing via Simplified Semantics · Knowledge Discovery and Dissemination Information and data engineering 2. ... • Authoritative data • Leverage](https://reader034.vdocuments.mx/reader034/viewer/2022042122/5e9cf701fed1914e181835db/html5/thumbnails/39.jpg)
39
![Page 40: Agile Data Governance and Warehousing via Simplified Semantics · Knowledge Discovery and Dissemination Information and data engineering 2. ... • Authoritative data • Leverage](https://reader034.vdocuments.mx/reader034/viewer/2022042122/5e9cf701fed1914e181835db/html5/thumbnails/40.jpg)
DataStar Hybrid NoSQL Data Model• Entities can come directly from Unified Business Model▫ Object structure with simple tables▫ Key-value pairs are basic repeating structure of all tables▫ Maintain direct line-of-sight between governance – data models
• Any and all concept or terminology variations handled▫ Keys hold governance directed vocabulary▫ Vocabulary allows concurrent mapping of same physical data to many
business uses: legacy data interfaces, to-be models, external regulatory standards
• Normalize or not▫ Disk space and CPU capacity are cheap and getting cheaper▫ “Duplicative” data is not always really duplicative: slight variations tied to
business processes or system operations E.g. SAP, Oracle, IBM applications and data models have built-in semantics
that frequently don’t align with corporate or web applications• Dimension or not▫ A “fact” and “dimension” depend on use case and can change over time
40
![Page 41: Agile Data Governance and Warehousing via Simplified Semantics · Knowledge Discovery and Dissemination Information and data engineering 2. ... • Authoritative data • Leverage](https://reader034.vdocuments.mx/reader034/viewer/2022042122/5e9cf701fed1914e181835db/html5/thumbnails/41.jpg)
The 5 Minute Real Estate Data Model
41
![Page 42: Agile Data Governance and Warehousing via Simplified Semantics · Knowledge Discovery and Dissemination Information and data engineering 2. ... • Authoritative data • Leverage](https://reader034.vdocuments.mx/reader034/viewer/2022042122/5e9cf701fed1914e181835db/html5/thumbnails/42.jpg)
Object Data Model Semantic Vocabulary
![Page 43: Agile Data Governance and Warehousing via Simplified Semantics · Knowledge Discovery and Dissemination Information and data engineering 2. ... • Authoritative data • Leverage](https://reader034.vdocuments.mx/reader034/viewer/2022042122/5e9cf701fed1914e181835db/html5/thumbnails/43.jpg)
Case Study – Navy HR Data• Problem: 5 major warehouses for 1 million HR records. Conflicting
data, unable to consolidate, undocumented business context, brute force approaches don’t scale
• Solution – Used DataStar Agile warehousing & integration• Results – Agilely implemented common data model built on
simplified, stds-based definitions accommodating all business variations; built subject matter-based integration transforms; automatically integrated, de-duplicated, cleansed data into Authoritative data stores
• Customer Reaction – Data model accepted as standard with standing Governance renamed for it (Position-Resume Governance Board). Only consolidated data approved as trustworthy – VADM K. Moran (Ret)
43
![Page 44: Agile Data Governance and Warehousing via Simplified Semantics · Knowledge Discovery and Dissemination Information and data engineering 2. ... • Authoritative data • Leverage](https://reader034.vdocuments.mx/reader034/viewer/2022042122/5e9cf701fed1914e181835db/html5/thumbnails/44.jpg)
Position Data Model
44
• Handles legacy business and technical terms and semantics (e.g. Navy specific like ‘billet’ with many different uses)
• Handles industry standards (e.g. HRXML)
• Handles to-be (competency based)
![Page 45: Agile Data Governance and Warehousing via Simplified Semantics · Knowledge Discovery and Dissemination Information and data engineering 2. ... • Authoritative data • Leverage](https://reader034.vdocuments.mx/reader034/viewer/2022042122/5e9cf701fed1914e181835db/html5/thumbnails/45.jpg)
45
Resume Data Model
![Page 46: Agile Data Governance and Warehousing via Simplified Semantics · Knowledge Discovery and Dissemination Information and data engineering 2. ... • Authoritative data • Leverage](https://reader034.vdocuments.mx/reader034/viewer/2022042122/5e9cf701fed1914e181835db/html5/thumbnails/46.jpg)
46
Competency Data Model
![Page 47: Agile Data Governance and Warehousing via Simplified Semantics · Knowledge Discovery and Dissemination Information and data engineering 2. ... • Authoritative data • Leverage](https://reader034.vdocuments.mx/reader034/viewer/2022042122/5e9cf701fed1914e181835db/html5/thumbnails/47.jpg)
Key-Value Vocabulary
47
Resume Identifiers
![Page 48: Agile Data Governance and Warehousing via Simplified Semantics · Knowledge Discovery and Dissemination Information and data engineering 2. ... • Authoritative data • Leverage](https://reader034.vdocuments.mx/reader034/viewer/2022042122/5e9cf701fed1914e181835db/html5/thumbnails/48.jpg)
Key-Value Vocabulary
48
Competency KSAs
![Page 49: Agile Data Governance and Warehousing via Simplified Semantics · Knowledge Discovery and Dissemination Information and data engineering 2. ... • Authoritative data • Leverage](https://reader034.vdocuments.mx/reader034/viewer/2022042122/5e9cf701fed1914e181835db/html5/thumbnails/49.jpg)
What Do We Do Now?
• We must apply Agile solutions for increased business value• Our approach to modeling must support business agility• We need to adopt a new approach that unites governance,
design, and aggregation of enterprise data • We must adopt solutions that dramatically reduce project
time and cost• We must adopt a method that easily uses current tools and
business processes to deliver agile data
49
![Page 50: Agile Data Governance and Warehousing via Simplified Semantics · Knowledge Discovery and Dissemination Information and data engineering 2. ... • Authoritative data • Leverage](https://reader034.vdocuments.mx/reader034/viewer/2022042122/5e9cf701fed1914e181835db/html5/thumbnails/50.jpg)
Further Information
• Contact me at:▫ [email protected]▫ 888-735-1774, ext 100
• Online▫ http://www.phasicsystemsinc.com
50