microsoft sql server 2008 r2 and biztalk server presentation
DESCRIPTION
TRANSCRIPT
SQL Server 2008 R2 and BizTalk Server
Enabling Informed Actions and Creating a Foundation for Agile Systems Master Data Management & Event Driven Processing
NameTitle
Microsoft Corporation
Business Demands Actionable Data
Actionable Data is
Intelligent
In Context
Complete
Accurate
Derived meanings from information
Real time delivery of relevant information when and where it is neededRelated
information reconciled into
single unified view
Complex and disparate data transformed,
cleansed and delivered
Data Quality is Key Requirement
System 1
Syed K. Rasheed
Male
1 Aug 1968
Married
Passport: 876313456
1 Main St,…
System 2
Syed Rasheed
M
1/8/68
M
DL: 554SKR888
Main St #1, …
System 3
S.K. Rasheed
Male
1/8/1968
M
SSN: 555121313
1 Main Street,…
System 4
Sadia Rasheed
F
July 15, 1975
Married
ID: C9988021
No 1, Main St.,...
• Are they the same person?• Are they related to other customers?•Which address is correct?
Actionabl
e Data
is
Intelligent
In Context
Complete
Accurate
What is Master Data?
Types of Enterprise Data
Transactional Data
Describes Enterprise’s Activities
Master Data
Describes Enterprise Business Entities
Analytical Data
Describes Enterprise Performance
Master Data ISThe key facts describing your core business entities: customers,
partners, employee, products, etc.The high value information an organization uses repeatedly
across many business processes and applications
Actionabl
e Data
is
Intelligent
In Context
Complete
Accurate
The Master Data ProblemIsn’t just a data problem … it’s a process and function problem
EXISTINGAPPLICATIONS
INFRASTRUCTURE
INVENTORY
SQL ServerWindows
CRM
Oracle DBUnix
OPERATIONS
DB2Z/OS
ERP FINANCE
SQL ServerWindows
OracleSolaris
OtherPartners &Customers
Sales forecasts
and reports
Sales force automation
Customer service
Operations
New product
idea portal
New product portfolio analysis
Financial reporting
New Regulatory compliance
portal
Compliance reports
Supply chain
integration
Trading partner portal
SymptomData is out-of-sync, incomplete, and inaccurate in your applications
Root CauseApplication functionality and business
processes are not designed to manage data for use beyond its own sphere, affecting data integrity, quality and
governance
Actionabl
e Data
is
Intelligent
In Context
Complete
Accurate
What is Master Data Management?
• MDM is‒ An application for creating and maintaining an authoritative
view of master data including policies and procedures for access, update, modification, viewing between systems across the enterprise
• MDM Usage Style‒ Operational Use of MDM
‐ Use and Maintenance of Master Data occurs within Operational process/applications
‐ Master Data is consumed by other systems via real-time accessible SOA Services
‒ Analytical Use of MDM:‐ Integration with existing data warehouse & analytics
environment to provide master data‐ Inject insight from analytic systems into operational business
processes
Moving towards a Solution
Trusted Master Data
Cleanse
Govern
Integration Need• ERP/LOB Application Adapters• Reliable Messaging &
Notification• Process Orchestration• Data Mapping &
Transformations• Business Activity Monitoring
Data and Functionality unique to each
application
Data and functionality common to applications:
Customer, Account, Product
PeopleSoft
SAP
JDE
Mainframes
Custom
Oracle
Fuse Master Data with applications and
processes to drive broad data consistency and usage (actionable
Data)
Without integration of Master Data with OLTP applications, Master
Data Hub = YET ANOTHER SILO
Actionabl
e Data
is
Intelligent
In Context
Complete
Accurate
Point-to-Point Integration Fails to Deliver Business Agility
• Point-to-Point‒ Complex Interface‒ Redundant Logic‒ Doesn’t Scale‒ Lacks Visibility
• Business Impact‒ Delays Response
to changing business needs
JD Edward
s
SAP
Custom Apps
AS/400
CICSMaster Data Hub
Dynamics
CRM/AX
OracleEBS
Actionabl
e Data
is
Intelligent
In Context
Complete
Accurate
Agile MDM
PeopleSoft
SAP
JDE
Mainframes
Custom
Oracle
BizTalkServer
Application Integration
Master Data Hub
Business Activity Monitoring
New Master Data Synchronization
Master Data Publication
Data Synchronization
Actionabl
e Data
is
Intelligent
In Context
Complete
Accurate
Adding Near real-time Reporting
PeopleSoft
SAP
JDE
Mainframes
Custom
Oracle
BizTalkServer
Application Integration
Operation Data Store (ODS)
Master Data Hub
Business Activity Monitoring
Near Real-time Reporting
New Master Data Synchronization
Master Data Publication
Near Real-time Transaction Trickle Feed
Data Synchronization
Master Reference
Actionable Data
is
Intelligent
In Context
Complete
Accurate
Enterprise MDM
PeopleSoft
SAP
JDE
Mainframes
Custom
Oracle
Biz
Talk
ES
B
Operation Data Store (ODS)
Master Data Hub
Enterprise Data
Warehouse(EDW)
Data Marts
Data Marts
Data Marts
Data Marts
Data Marts
SSIS (ETL)
Microsoft Business Intelligence
Business Activity Monitoring
Operational Reporting
Strategic Analysis
Actionabl
e Data
is
Intelligent
In Context
Complete
Accurate
MDS + BizTalk enabler of actionable data
SQL Server MDS provides Data Cleansing + Governance
• Reduces data maintenance costs by preventing multiple processing in different systems.• Accelerates process execution by providing sophisticated data
synchronization mechanisms to connected applications • Ensures data consistency and accuracy thus reduces error-
processing costs due to inconsistent master data.• Improves corporate decision making in strategic sales and
purchasing by providing up-to-date information to all people.
BizTalk Server provides
Application Integration &
Process Automation
Integrate
Cleanse
Govern
Actionabl
e Data
is
Intelligent
In Context
Complete
Accurate
SQL Server MDS Capabilities• Any Master Data Domain• Hierarchy & Attribute
Management• Versioning & Logging• Data Governance Portal• Data Quality Rules,
Notification, Validation• Data Level Security
BizTalk Server Capabilities• Enterprise Application
Integration• Application & B2B Adapters• Data Mapping &
Transformations• Durable Messaging &
Enterprise Service Bus• Process Orchestration Engine• Business Activity Monitoring• Business Rules Engine• Enterprise Single Sign-On
Integrate
Cleanse
Govern
REAL WORLDMASTER DATA MANAGEMENT
Actionable Data
is
Intelligent
In Context
Complete
Accurate
Business Demands Actionable Data
Actionable Data is
Intelligent
In Context
Complete
Accurate
Derived meanings from information
Real time delivery of relevant information when and where it is needed
Related information reconciled into single
unified view
Complex and disparate data transformed,
cleansed and delivered
A Different Way of Processing Data
• How many invalid credit card authorization were accepted yesterday?
Event Data Processing• When 3 authorizations for the
same credit card occur in any 60 second period, deny the request and require manual approval
Traditional Data Processing
Time
• Works in real time• Analyze by pattern within
time frames
Actionabl
e Data
is
Intelligent
In Context
Complete
Accurate
Common Definitions
• Event‒ An event is a notable thing that happens inside or outside
your business. An event (business or system) may signify a problem or impending problem, an opportunity, a threshold, or a deviation
• Complex Event Processing‒ CEP deals with evaluating a confluence of events and then
take action‒ The events (notable or ordinary) may cross event types and
occur over a long period of time‒ The event correlation may be casual, temporal, or spatial‒ CEP is commonly used to detect and respond to business
anomalies, threats, and opportunities
Order Received
Reading from Sensor
Low Inventory
Stock Price Fluctuation
Temperature Change
Post Payment
Keycard Swiped
Flight Delay Radio Frequency IDFile Deleted
Click on Website
Actionable Data
is
Intelligent
In Context
Complete
Accurate
Scenario – Financial Industry
• Buy or sell a security at a certain price, or a certain time• Bond or CD matures, be notified to decide how to
reinvest• How would you implement this? Polling? Polling
interval•With Event Driven Approach, you could register for a
SELL event (or Price Event)
Actionable Data
is
Intelligent
In Context
Complete
Accurate
Scenario – Travel IndustryActionable Data
is
Intelligent
In Context
Complete
Accurate
• Flight delays or cancellations‒ Car Rental agencies, Hotels & Travel agencies need to be
notified or subscribe‒ Delayed flight means plane’s subsequent flights will be
delayed‒ Airport gate & ground crew are now available but another
needs to be reserved for later‒ Flight crew will be delayed for their connections & may
overrun their work limits for the day‒ New planes and/or crews may need to be allocated
• Try coding one central rescheduler with a whole bunch of if-statements
Event Driven Processing
Monitor
• From one or multiple streams
• All in real time-as the events occur
• Transform event data to the required format
• Events may be evaluated for notabilities by an event preprocessor (router, filter)
Process
• Events processed by engine based on event processing logic
• Comparisons, Calculations, Correlations, Aggregation, Temporal Operations – sliding window, hopping window etc.
Actionable Data
is
Intelligent
In Context
Complete
Accurate
Event Driven Processing
Devices, Sensors
Web Servers
Applications & DBs
Stock Tickers & News Feeds
Event Sources
CEP Engine
Standing Queries
INPU
T A
DA
PTER
S
OU
TPU
T A
DA
PTER
S
EVENTEVENT
EVENT
EVENT
EVENTEVENT
EVENT
EVENT
EVENT
Event Targets
Applications & DBs
Pagers & Monitoring Devices
KPI Dashboards, SharePoint UI
Trading Stations
IntegrateInformatio
n
AutomateProcesses
SimplifyManageme
ntOrchestration
Messaging / ESB
Business RulesBusiness Activity
MonitoringB2B Integration
Adapters
ESSO and UDDI
Monitor Process Act
Actionable Data
is
Intelligent
In Context
Complete
Accurate
Event Processing TechnologiesActionable Data
is
Intelligent
In Context
Complete
Accurate
• Technologies that can turn a stream of events into valuable and actionable information for business users:• SQL Server StreamInsight
‒ Extreme Performance event processing engine that monitor and analyze streams of real time events, including temporal correlations and detect notables events
• BizTalk Server‒ Automate the actions that the event processing produces as a
result
• BizTalk Business Activity Monitoring (BizTalk BAM)‒ Provide insight into the real time performance of the business‒ Complements SQL Server StreamInsight (CEP) and BizTalk Server
(BPA) as an business events dashboard
• BizTalk Business Rules Engine (BizTalk BRE)‒ Provide Event correlation and policy for cross node StreamInsight
Events‒ Automation of downstream decision management
Summary & Call to Action
• Microsoft Application Platform – SQL Server, BizTalk Server and Visual Studio – Enable you to address the most challenging business needs and
‒ Improve Business Agility With Actionable Data & Connected Systems
‒ Simplify Development And Management experiences
• Adopt, Upgrade, Deploy
Actionable Data
is
Intelligent
In Context
Complete
Accurate
Applications
Partners
Devices
EDI, AS/2, SWIFT, HL7, HIPAA…
SAP, PeopleSoft, OracleDynamics CRM,
SharePoint, Mainframe…
RFID
IntegrateInformation
AutomateProcesses
SimplifyManagement
Increase Business Agility
Drive Business Efficiency
Reuse ExistingIT Investments
Orchestration
Messaging / ESB
Business Rules
Business Activity Monitoring
B2B Integration
Adapters
Tool
sM
anagement
ESSO and UDDI
Business Process Automation & Integration Server
Q&A
What is Master Data and MDM?
• MD – Slowly changing reference data shared across systems• MDM – An application for creating and maintaining an
authoritative view of master data including policies and procedures for access, update, modification, viewing between systems across the enterprise• MDS – Microsoft’s Master Data Services platform shipping with KJ
26
People
• Customers
•Vendors
• Sales People
• Employees
• Partners
• Patients
Things
• Products
•Organizational units
•Recipes
• Parts
• Storage bin
•Documents
Places
• Stores
•Wells
• Power lines
•Geographical areas
Abstract
• Contacts
•Warrantees
• Time
•Metrics
Why do you need MDM?
ERP - USA
ERP - Europe
Data Warehouse or Analytic App
• Difficulty coordinating multiple systems – Operational MDM• Difficulty managing dimensions – Analytic
MDM• Or both – Enterprise MDM
• Operational• Europe keeps changing the color• New products never include the
French product name• I can’t pick the right Boeing
• Analytic• My sales reports are wrong• Analysts can’t maintain dimensions• Marketing can’t analyze by patch area
27
Agile Master Data Management
JD Edward
sService
SAPService
Custom Apps
Services
AS/400Service
s
CICS Service
Master Data Hub
MS CRM
Service
OracleService
BizTalk Server
Operational MDM:• Use and Maintenance of Master Data occurs within
Operational process/applications• Master Data is consumed by other systems via real-time
accessible SOA Services
Actionabl
e Data
is
Intelligent
In Context
Complete
Accurate
A not-for-profit, user-run association to enable the SQL Server community to connect, share, and learn
Get ongoing SQL Server learning from MVPs, top experts, and real-world users:
• Training webcasts, technical education, worldwide event info, and moreSign up for your FREE PASS membership today: www.sqlpass.org
• Go to local PASS Chapter meetings Visit the PASS Chapter booth to learn about upcoming local events, or visit www.sqlpass.org/PASSChapters
• No local Chapter? Start a Chapter with support and resources from PASS
www.sqlpass.org/getchapterinfo
• Attend PASS Summit 2010World's largest and best conference for SQL Server and BI technical education www.sqlpass.org/na2010 Follow / Join us online: Twitter @sqlpass #sqlpass, LinkedIn group, Facebook
group
© 2009 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.
The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after
the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.