分析平台夢幻組合 ase + iq · sybase iq and kxen solution rtmetrics to analyze web logs...
TRANSCRIPT
分析平台夢幻組合 ASE + IQ
Frank Weng / Database & Technology
07, 2012
© 2012 SAP AG. All rights reserved. 2
Agenda
ASE vs. IQ
ASE + IQ Role-play in Analytics Environment
IQ is Special Design for Analytics – Column Base / Index / Compression
IQ in Big Data Analytics – Shared-everything MPP Architecture
– Conjunction with Hadoop
– References
DW2.0 – Next Generation DW Architecture
© 2012 SAP AG. All rights reserved. 3
ASE vs. IQ
© 2012 SAP AG. All rights reserved. 4
ASE vs. IQ
IQ
Column-base , Analytics
ASE
Row-base , OLTP
© 2012 SAP AG. All rights reserved. 5
ASE + IQ Role-play in Analytics Environment
Disk-Storage
Database
In-Memory
Option
ASE
Operational
Data Store
Data
Stage Area
IQ
Column-Based Analytics Server
IQ
Source
Data
Pre
sen
tatio
n
© 2012 SAP AG. All rights reserved. 6
IQ - Special Design for Analytics
Query is the King
Real
Column-Based
Architecture
Eliminate
Index
Optimized
Storage & Compression
No more
Table Scan
© 2012 SAP AG. All rights reserved. 7
Shared-everything MPP Architecture
CPU
MEM
IQ 1
CPU
MEM
IQ 2
CPU
MEM
IQ 3
CPU
MEM
IQ 4
CPU
MEM
IQ 5
CPU
MEM
IQ 6
SAN
Query 1
W L W W W W L
Query 2
L: Leader Node
W: Worker Node
Logical Server A
Logical Server B
© 2012 SAP AG. All rights reserved. 8
Conjunction with Hadoop (1)
Moving HDFS subsets into Sybase IQ
© 2012 SAP AG. All rights reserved. 9
Conjunction with Hadoop (2)
Federate data from Hadoop into Sybase IQ
HDFS subsets are materialized in IQ as in-memory virtual tables
© 2012 SAP AG. All rights reserved. 10
Conjunction with Hadoop (3)
Federate process from Hadoop into Sybase
IQ
Hadoop MapReduce jobs triggered from
Sybase IQ
© 2012 SAP AG. All rights reserved. 11
HMV Japan’s Problem
Low accuracy
Poor processing
speeds
High operational
costs
Limited audience
Limited results
eCustomers
Website
Store POS Catalog
Database
Online Sales Additional
Databases
Custom System
© 2012 SAP AG. All rights reserved. 12
Sybase IQ and KXEN Solution
RTMetrics to analyze web logs
model
Sybase IQ
Email All
customers
Website
Up to 15x growth in
purchase rates
Up to 3x growth in
per-transaction
revenue
Query speeds
1 Day 30 sec.
© 2012 SAP AG. All rights reserved. 13
IQ Customers – 1,800+
Government & Health
Telecommunications Finance & Insurance
Retail, Entertainment & Electronics
© 2012 SAP AG. All rights reserved. 14
ASE Customers – 30,000+
© 2012 SAP AG. All rights reserved. 15
DW 2.0 for Next Generation DW Architecture
•Recognize LIFE CYCLE OF DATA
• In-memory for operational analytics
• Off-load data
• Include UNSTRUCTURE DATA
• Conjunction with big data
•Build FOUNDATION can change over time
• Flexible architecture
© 2012 SAP AG. All rights reserved. 16
Agenda
ASE vs. IQ
ASE + IQ Role-play in Analytics Environment
IQ is Special Design for Analytics – Column Base / Index / Compression
IQ in Big Data Analytics – Shared-everything MPP Architecture
– Conjunction with Hadoop
– References
DW2.0 – Next Generation DW Architecture
