bi for banks - natural group bi for banks adf meets bank’s objectives 1 creating cdr data quality...
TRANSCRIPT
Client Project
Bank of India Comprehensive closing returns
The Himachal Pradesh State Cooperative Bank Ltd
MIS Implementation and Support
Raichur DCC Bank MIS Implementation and Support
Corporation Bank ADF and XBRL
MIS, BI & Similar Projects done by the same team
To create Central data repository (CDR) adhering to the framework outlined by RBI for automated data flow of returns to RBI.
The CDR should be populated with clean and valid data and should synchronize financial and non-financial data from various source systems of the bank.
Eliminate multiple data version by creating single version of data at any point of time
Provide integrated system with existing Source systems (CBS, Treasury, CIS, HRM, LAPS, etc) and other applications.
The CDR enable the bank to meet requirements for:
• Decision support system
• Internal MIS and analytical reports, charts, graphs, etc.
• Reporting to external agencies like Ministry of Commerce, SEBI and other regulators
Returns to be submitted in XBRL formats as per taxonomy published by RBI
To have Data and Systems readiness for any future Data-Warehousing Project
Project Objectives
How BI for Banks ADF meets Bank’s Objectives
1
Creating CDR
Data quality
2
3
4
Data integration from
various source
systems deployed in
the bank.
Reporting,
dashboards and
conversion to XBRL
format.
This solution is structured in four layers as outlined in the RBI
framework to meet all the activities and tasks prescribed for
implementing ADF system. It has ready data models key Features being
the extensible Data Model, System for Governance, External Data
Capture functionality
The solution has data validating algorithms built in ETL and
gives reports related to quality of data.
The solution can be easily integrated with data quality tools
and provides for strong data governance.
It has ETL routines and mapping from source systems like
Finacle, Treasury, Central Accounts department, etc.
Data management platform consists of rich set of
transformation for a variety of task, Integration Analytics and
Data Quality Transformation
1
4 We have created 400+ reports in a public sector bank. Hence
the data mapping to the reports are already available.
The reporting interface component of the proposed solution
allows to create reports and dashboard with drag and drop
facility with a strong metadata management component.
2
3
OB
JE
CT
IVE
S
Features of the Solution
Software is web based, menu driven and user friendly.
Access is through user login.
User defined access control available. The access can be configured on need to know basis.
Audit trails provided for each login, logout, and Addition/deletion/modification by individual users.
Uploading of data in electronic form as well as data entry mode available.
Software compiles statements of sundry deposits, sundry credits, and suspense debits.
Provision of Data Governance by using feature such as Maker / Checker.
Is able to configure the amount in Thousands, Lakhs, and Crores
Features of the Solution
Supports multiple currencies.
Compiles statements relating to Asset Classification, Allocation of Advances & Unrealized Interest.
Is able to configure the amount in Thousands, Lakhs, and Crores
Has provisions to accommodate increase in no. of branches ,zones etc and also various other fields which may come in future.
Uploading of data any number of times permitted at various stages like pre-audit, post audit and post MOC.
Scalable, Extensible data model cutting across various Banking domain
CBS & other source systems to Stage Database
• All the Required data from CBS and other systems (Source tables) Extracted to the Stage Database. Configurable frequency to ensure returns periodicity.
Stage Database to CDR
• Other set of ETL packages use this Staged Database for transformation, mapping and cleaning various data elements and loading into CDR from where the reports & returns are generated.
Legacy system data
• In case any data required in the CDR is existing in any legacy system which does not have RDBMS then the data that is collected in Flat files and transfer to CDR database.
Gap data
• Data not available in any system is fetched through data entry programs. Which provides for maker checker facility.
Data Management
Data Integration
• Data Adaptors
• Custom Data Maps and Transformation Rules
• Sources – Data bases, Excel, Flat Files, etc.
Data Extraction from Disparate Operational Source Data
• Data Validation
• Data Standardization
• Generation of Data Sets for Analysis & Predictive Modeling
Consolidation of Data
Historical Data Population through ETL
Auto-scheduled ETL
Audit Trails
Data Cleansing
Data Profiling – to detect defect levels in variable values
Deployment of Data Profiling functions for incremental data
Development of Business Rules for transformation / standardization
Deployment of Business Rules in ETL
Customer ID creation
Standardization of categorical variable values
Conversion (Pin Code to City Name)
Missing value population with Business Rules
Creation of Bins for functions like frequency distribution (e.g. Age)
Develop a complete assessment of the scope and nature of data quality issues in CBS and other source databases along with existing MIS database of the Bank.
Create an inventory of data assets.
Inspect bank’s CBS and other Source data bases for errors, inconsistencies, redundancies and incomplete information in the data.
Build the foundation for future data management initiatives to provide clean, consistent, effective and efficient data.
Profiling
Quality
Plan and prioritize data correction initiatives.
Identify and resolve problematic data.
Standardize, normalize and transform data before loading into bank’s CDR.
Validate and improve the overall accuracy of data.
Data Quality
12
Reporting and Alerting
• Enabled as Shared
Service
• Built-in scale-out for
RS Service Apps
• Cross-farm reporting
• Integrated backup &
recovery, ULS
logging, PowerShell
etc.
• End User Alerting
• Defined from within
operational or ad-hoc
reports
• Intuitive Alert rules
• Self-managed Alerts
• XLS/Word 2007/2010
• Power View
• Highly visual design
experience
• Rich metadata-driven
interactivity
• Presentation-ready
at all times
Increase efficiency Increase Proactive Intelligence
Managed Self Service BI – Corporate BI
Empower users
Proactive Intelligence
Self Services Alerting capability makes it trivial for any end user while viewing a report to define rules and thresholds on data and be alerted when they are reached. This transforms a traditional pull mode activity to a push mode activity greatly increasing Information Workers productivity.
What XBRL Requires…
Standardized data
Clean and validated data
Timely data
Capturing the granular data
Removing the redundancy in data collected and stored
Automated data processing
RBI’s XBRL Initiative
Key driver for XBRL adoption in India
Member of XBRL India jurisdiction
Started XBRLisation with RCA II in 2008
Migrate to XBRL solution for all returns in phased manner
XBRL via ADF
Returns currently covered
• Form A, GPB, Financial Reporting
• Form VIII, Form X
Brief on Security Architecture
18
The application has a three tier architecture. (Web/App/DB)
Each of the layer Web/App/DB has been divided into zones separated by firewall.
The web layer is in DMZ which will be first layer for all users access.
The App/DB has been put into the MZ separately.
The application level security is through user access levels which is configurable as
per the banks ISSP.
Security features of application:
• Automatic logout of idle user after specified time.
• Minimum password length of 8 characters available.
• User lock after predefined unsuccessful login attempts.
• Force password change after predefined periods.
• System does not accept user id as password.
• Password is not same as old password.
19
Some of the key reports generated
# Name of the Output form
1 Form A Special
2 Form B
3 Form B Special
4 Form VIII
5 Form IX
6 Form IX Special
7 Press Communique data
8 Statistical Tables relating to Banks in (Table No. 34)
9 Working Group on Monetary Aggregates (WGMA)
10 Advances to Priority Sector by all SCBs (Final)
11 Advances to Priority Sector by all SCBs (Adhoc -Half yearly)
12 Special Return I (As on Last Reporting Friday of June)
13 Special Return II (As on Last Reporting Friday of June)
14 Special Return III
15 Advance under DRI Scheme
16 Credit Facility to SC/ST
17 Credit Assistance to Minorities
Case Study: Himachal State Cooperative Bank
Some of the Reports available
• Weekly Flash Data Report
• BSR Statements.
• Industry wise advances.
• Sector wise advances.
• Facility wise advances.
• Position of Priority Sector Advances and Disbursement.
100+ reports are deployed which cover reports of different departments like Credit, Risk Management, Priority Sector Lending, Statistics, Retail Banking and International Banking Division etc.
Dashboards are made available
Statutory and regulatory reports as per RBI format are generated.
Case Study: ADF Solution
203 ADF Reports Available for Reporting to RBI on defined frequency
Predefined templates available for data extraction.
Advances & Reminder Mail Alerts for Data upload, Report Due Data, Report Approval, Report Submission.
XBRL Report Generation Integrated available for RBI Reports.
User Management available to define access rights to user as designation and department integrated with bank employee data.
Report Scheduling and Auto Loading provided for report generation as on due date or on receipt of data.
Dashboards are made available
Financial inclusion - number of no frill accounts opened
Form – VIII (SLR)
State-wise ATMs data
Area-wise ATMs data
Cards data
Pre-paid cards
Vostro list
List of offices/branches maintaining (Rupee and ACU Dollar) accounts of non-
resident banks and list of Vostro accounts
Credit flow to micro, small and medium enterprise
Statement on the position of balancing of books
Form-A Provisional (Sec.42)
Form-A Final (Sec.42)
Form-X – statement of assets and liabilities
BSR1, BSR 2, BSR 4 & BSR 7
Opening / closing of branches
Names of some Reports Rendered through ADF
38
Accelerated Roll-out
Thoughtful Solution Design
Robust Governance
• Requirement validation as applicable
• Minimum Customization • Parallel builds
synchronizing in to single Testing phase
• Core Key team members from domain and technology are ready to be deployed
• Governance Layer can be leveraged
Bank/ NSCS key stakeholder participation in project governance
Proven BI Governance mechanism at all levels – Country, Region, Group
• Focus on current application needs
• Alignment to Enterprise standards of SBI as applicable\required.
• Design and development follow standard SDLC processes .
Proven Relationships &
Techniques
Delivery excellence across multiple projects over many years
Strong relationship with SAS as a partner
Real-time synchronization between Onsite-Offsite teams
Commitment to Bank for project Success
Successful Solution Implementation
Critical Success Factors which we will deliver against
Solution fit to requirements
Conforms to existing Performance measures
In-time Remediation No cost & Schedule spill-
over
Proposition to Customer
39
Phases / Deliverables Initiation Manage Build Operate Transfer O
bje
ctiv
e
• Due Diligence • Risk management • Expectation
management
• Ensure governance • Scope, issue, resource
management
• Design , Install , customize , integrate and deploy Solution
• Provide operational support
• Optimize
• Solution is live and support model is in place
Act
ivit
ies
• Project kick-off • Establish PMO
• GAP / risk /
dependency identification
• Verification of scope/requirements
• Verification of existing solution stack/environment
• Project planning and tracking
• Budget tracking
• Monthly steering Committee meetings
• Weekly check point meeting
• Scope management
• Planning: QA, Integration, migration ,Rollout
• Requirement gathering • Infrastructure design
• UAT,PDC,HA,DR • Install Solution • Parameterization and
customization • SIT and UAT • Pilot Rollout, Parallel run • Initial Training • Data migration, QA, UAT • Production
Migration/cut-over • Phased Rollouts: web
based, thin clients, messing hub integration
• Define SOP for Integrations, On boarding
• Training
• Setup Support: Helpdesk, L2, L3
• Application monitoring
• Problem/issue management
• Root cause analysis
• Change management
• Production updates if any
• Verification and signoff.
• Build knowledge repository
• Tier 3 support
Del
iver
able
s
• Project charter/Plan • Roles Responsibilities
matrix • Frozen Project scope • Risk management
plan • Project calendar • Resource calendar • Gap analysis
• Updated project plan • Status reports • Issue tracking status • Budgets • Change management Log • Rollout plan, release
management • QA plan
• SRS, traceability matrix • Process Documents • High /Low level design • Infrastructure plan • Customized Solution • QA Results • QA,UAT, production
deployments
• Training schedule • User manuals • Pilot/ HARD Launch
• Lights are on, SLA
tracking • Admin/user guide • On boarding SOP • Change controls if any
• System documentation
• AMC contract • Help desk • Application
Support
Initiation Planning Execute Go-Live/Operate Transfer
Key Success factors
Collaborative approach and transparency
Strong Governance
Strong Program/Project
management
Proactive Risk identification
and mitigation
Mature process framework based on CMMi 5 and ITIL…
Project Phases NSCSPL Bank
Analysis Of Requirements a) Capture Business Requirements b) Source System Study c) Gap Data analysis
a) Provide Business Requirements b) Access to data sources c) Sign-off the BRD
Design Phase a) Configure Data Model b) Configure Solution c) Design ETL & Business Rules d) Design Gap data screens
a) Data in structured format b) Sign off the design document
Construct Phase a) Provides gap data entry programs b) Configure ETL c) Configure rules engine for DQ and
transformations d) Build Reports e) Configure alerts and authorizations levels
a) Access to Source System for integration b) Ensure Gap data is entered and authorized c) ISSP guidelines for configurations of user levels d) Provide hierarchy for sending alerts
Internal Testing a) Report wise testing b) End to end testing
UAT a) Initial training to testing team b) Replicate Test cases c) Record Issues d) Address Issues
a) Constitute test team b) Provide Test cases c) Conduct UAT and notify issues d) Sign off UAT
Trainings and Go-live a) Impart training to core team b) Training to users and other stakeholders c) Port the solution on production
environment
a) Nominate personnel for trainings b) Nominate the pilot branches/departments c) Sign offs on training d) Go-live sign off
Roles and Responsibilities - Representative