appendices: introduction to business intelligence date
TRANSCRIPT
Appendices: Introduction to Business Intelligence
DATE
Current landscape Solution Architecture
APPENDIX A
Current Architecture - LIME
Target Architecture - LIME
Current Architecture - Bahamas
Target Architecture - Bahamas
EDS scope and roadmap
APPENDIX B
Phase 1• Comverse SLU CDRs: Voice, SMS, MMS, content, mobile data• Liberate unbilled (preload) and billed Itemized Messages (IMs).• Archived Liberate IMs: 18-24 months billed IMs
Phase 2• Network raw CDRs (i.e. fixed and mobile).• Network DPI data (mobile data usage detail)• Archived Comverse call history records• Archived RTBS call history records (offload of legacy reporting
DB)
Phase 3 (possible candidates)• Portal and self-service app activity logs• LIMEWare and Gateway logs• Radio network probe data (radio coverage and quality KPIs)
Event Data Store –Phasing of data sources
Introduction to Business Intelligence | Appendix B8
EDS will store up to 7 years detailed usage online for search and queries
To meet the full set of EDS requirements, and to standardize on a technology approach, we are leveraging a fully-integrated Apache stack comprising Cassandra, Hadoop and Hive.
Cassandra provides the underlying resilient and fast database storage, Hadoop provides the bulk-analytics and search, with Hive providing the SQL Layer.
Selected Solution from Cartesian/TMNG
This cost-effective approach reduces risk by using some of the most popular deployed open-source Big-Data technologies available.
Introduction to Business Intelligence | Appendix B9
EDS - Integration Architecture
Digital Route’s Mediation Zone provides the mediation layerArchitectural approach permits easy extension for further data sources such as mobile data usage and raw network CDRsEDS is deployed in Virtacore
EDS versus ODSEDS keeps full record contents whereas ODS takes stripped down record setsEDS keeps records for up to 7 years, whereas ODS keeps usage detail for 3 months and then summarisesODS produces regular reports & KPIs
cmp Target Arch
Comv erse ONE RT+ (Charging & Balance Mgmt)
Mediation Zone (ETL)
CIS (CRM & Billing) Insight (DWH) Business Objects (Self-Serv ice Reporting)
Ev ent Data Store
ODS/EDW
4a. CIS Reference Data
«flow»
3c. Postpaid IMs
«flow»
1c. CDRs «flow»
JCC
2a. DWH,MTR, RECH
«flow»
3a. Postpaid IMs(Unbilled, Bil led)
«flow»
1a. CDRs
«flow»
1b. CDRs
«flow»
1d. CDRs
«flow»
2b. DWH,MTR, RECH
«flow»
2c. DWH,MTR, RECH
«flow»
2d. DWH «flow»
3b. Postpaid IMs
«flow»
4b. CIS Ref. Data
«flow»
Introduction to Business Intelligence | Appendix B10
Data Storage: Datastax and HDFSTo improve data storage capacity per node and reduce cost a parallel data store is to be configured next to each Datastax data store.
This data store will not be a part of the Datastax storage limit of 4TB and can provide another 4TB of storage per node. (Before replication and compression)
Datastax provides job and task scheduling for each node. Regardless of the data store. Therefore Datastax is required on each node. (Datastax controls what tasks the processors should be working on)
Concurrent tasks will impact performance. No nodes are reserved for Real-Time searches
Ascertain EDS Nodes
Ascertain
Web Interface Job Controller
Analytics Controller
8 Cores32GB Ram1TB Disk
Ascertain
MetaData2 Cores16GB Ram120GB Disk
Node 14TB Disk
DataStax
Real Time &Analytics
4TB Disk
Node 24TB Disk
DataStax
Real Time &Analytics
4TB Disk
Node 34TB Disk
DataStax
Real Time &Analytics
4TB Disk
Node 44TB Disk
DataStax
Real Time &Analytics
4TB Disk
Node 54TB Disk
DataStax
Real Time &Analytics
4TB Disk
Node 64TB Disk
DataStax
Real Time &Analytics
4TB Disk
HDFS StoreCassandra Store
&Job/Task Trackers for
each node
HDFS
HDFS
HDFS
HDFS
HDFS
HDFS
Each node contains Datastax controller
software, Datastax Data store (Cassandra) and a HDFS data store
HDFS Store is controlled by the Datastax
Job/Task Trackers. Datastax ‘OpsCenter’
will track running map reduce tasks on either
store
Datastax software is required on each node
for the node to contribute to processing
requests
Introduction to Business Intelligence | Appendix B11
Searches and Queries
Introduction to Business Intelligence | Appendix B12
Extended Search Screen Shot
Phase 2 Architecture
Introduction to Business Intelligence | Appendix B14