BI for Banks End-to-End Solution for MIS/BI & Automated Data

End-to-End Solution for MIS/BI & Automated Data
Flow to RBI
BI for Banks
MIS, BI & Similar Projects done by the same team
Client
Bank of India
Project
Comprehensive closing returns
The Himachal Pradesh State
Cooperative Bank Ltd
MIS Implementation and Support
Raichur DCC Bank
MIS Implementation and Support
Corporation Bank
ADF and XBRL
Project Objectives
To create Central data repository (CDR) adhering to the framework outlined by RBI for automated
data flow of returns to RBI.
The CDR should be populated with clean and valid data and should synchronize financial and nonfinancial data from various source systems of the bank.
Eliminate multiple data version by creating single version of data at any point of time
Provide integrated system with existing Source systems (CBS, Treasury, CIS, HRM, LAPS, etc) and
other applications.
The CDR enable the bank to meet requirements for:
• Decision support system
• Internal MIS and analytical reports, charts, graphs, etc.
• Reporting to external agencies like Ministry of Commerce, SEBI and other regulators
Returns to be submitted in XBRL formats as per taxonomy published by RBI
To have Data and Systems readiness for any future Data-Warehousing Project
How BI for Banks ADF meets Bank’s Objectives
1
1

This solution is structured in four layers as outlined in the RBI
framework to meet all the activities and tasks prescribed for
implementing ADF system. It has ready data models key Features being
the extensible Data Model, System for Governance, External Data
Capture functionality

The solution has data validating algorithms built in ETL and
gives reports related to quality of data.
The solution can be easily integrated with data quality tools
and provides for strong data governance.
Creating CDR
2
OBJECTIVES
2

Data quality
3
4
Data integration from
various source
systems deployed in
the bank.
3


4
Reporting,
dashboards and
conversion to XBRL
format.


It has ETL routines and mapping from source systems like
Finacle, Treasury, Central Accounts department, etc.
Data management platform consists of rich set of
transformation for a variety of task, Integration Analytics and
Data Quality Transformation
We have created 400+ reports in a public sector bank. Hence
the data mapping to the reports are already available.
The reporting interface component of the proposed solution
allows to create reports and dashboard with drag and drop
facility with a strong metadata management component.
Features of the Solution
Software is web based, menu driven and user friendly.
Access is through user login.
User defined access control available. The access can be configured on need to
know basis.
Audit trails provided for each login, logout, and Addition/deletion/modification by
individual users.
Uploading of data in electronic form as well as data entry mode available.
Provision of Data Governance by using feature such as Maker / Checker
.
Software compiles statements of sundry deposits, sundry credits, and suspense
debits.
Is able to configure the amount in Thousands, Lakhs, and Crores
Features of the Solution
Supports multiple currencies.
Compiles statements relating to Asset Classification, Allocation of Advances &
Unrealized Interest.
Has provisions to accommodate increase in no. of branches ,zones etc and also
various other fields which may come in future.
Uploading of data any number of times permitted at various stages like pre-audit,
post audit and post MOC.
Is able to configure the amount in Thousands, Lakhs, and Crores
Scalable, Extensible data model cutting across various Banking
domain
Logical & Functional Architecture
Data Management
CBS & other source systems to Stage Database
• All the Required data from CBS and other systems (Source tables) Extracted to the
Stage Database. Configurable frequency to ensure returns periodicity.
Stage Database to CDR
• Other set of ETL packages use this Staged Database for transformation, mapping and
cleaning various data elements and loading into CDR from where the reports &
returns are generated.
Legacy system data
• In case any data required in the CDR is existing in any legacy system which does not
have RDBMS then the data that is collected in Flat files and transfer to CDR
database.
Gap data
• Data not available in any system is fetched through data entry programs. Which
provides for maker checker facility.
Data Integration
Data Extraction from Disparate Operational Source Data
• Data Adaptors
• Custom Data Maps and Transformation Rules
• Sources – Data bases, Excel, Flat Files, etc.
Consolidation of Data
• Data Validation
• Data Standardization
• Generation of Data Sets for Analysis & Predictive Modeling
Historical Data Population through ETL
Auto-scheduled ETL
Audit Trails
Data Cleansing
Data Profiling – to detect defect levels in variable values
Deployment of Data Profiling functions for incremental data
Development of Business Rules for transformation / standardization
Deployment of Business Rules in ETL
Customer ID creation
Standardization of categorical variable values
Conversion (Pin Code to City Name)
Missing value population with Business Rules
Creation of Bins for functions like frequency distribution (e.g. Age)
Data Quality
Profiling
Develop a complete assessment of the scope and nature of data quality issues in CBS
and other source databases along with existing MIS database of the Bank.
Create an inventory of data assets.
Inspect bank’s CBS and other Source data bases for errors, inconsistencies,
redundancies and incomplete information in the data.
Build the foundation for future data management initiatives to provide clean, consistent,
effective and efficient data.
Quality
Plan and prioritize data correction initiatives.
Identify and resolve problematic data.
Standardize, normalize and transform data before loading into bank’s CDR.
Validate and improve the overall accuracy of data.
Reporting and Alerting
Empower users
• Power View
• Highly visual design
experience
• Rich metadata-driven
interactivity
• Presentation-ready
at all times
Increase Proactive
Intelligence
• End User Alerting
Increase efficiency
• Enabled as Shared
• Defined from within
operational or ad-hoc
reports
Service
• Built-in scale-out for
RS Service Apps
• Intuitive Alert rules
• Cross-farm reporting
• Self-managed Alerts
• Integrated backup &
• XLS/Word 2007/2010
Managed Self Service BI
–
12
recovery, ULS
logging, PowerShell
etc.
Corporate BI
Proactive Intelligence
Self Services Alerting capability makes it trivial for any end user while viewing a
report to define rules and thresholds on data and be alerted when they are
reached. This transforms a traditional pull mode activity to a push mode activity
greatly increasing Information Workers productivity.
What XBRL Requires…
Standardized data
Clean and validated data
Timely data
Capturing the granular data
Removing the redundancy in data collected and stored
Automated data processing
RBI’s XBRL Initiative
Key driver for XBRL adoption in India
Member of XBRL India jurisdiction
Started XBRLisation with RCA II in 2008
Migrate to XBRL solution for all returns in phased manner
XBRL via ADF
Returns currently covered
• Form A, GPB, Financial Reporting
• Form VIII, Form X
Solution Overview:
MIS/BI & Automated Data Flow
Infrastructure Deployment
Hardware Architecture
17
Brief on Security Architecture

The application has a three tier architecture. (Web/App/DB)

Each of the layer Web/App/DB has been divided into zones separated by firewall.

The web layer is in DMZ which will be first layer for all users access.

The App/DB has been put into the MZ separately.

The application level security is through user access levels which is configurable as
per the banks ISSP.

Security features of application:
•
Automatic logout of idle user after specified time.
•
Minimum password length of 8 characters available.
•
User lock after predefined unsuccessful login attempts.
•
Force password change after predefined periods.
•
System does not accept user id as password.
•
Password is not same as old password.
18
Some of the key reports generated
#
Name of the Output form
1
Form A Special
2
Form B
3
Form B Special
4
Form VIII
5
Form IX
6
Form IX Special
7
Press Communique data
8
Statistical Tables relating to Banks in (Table No. 34)
9
Working Group on Monetary Aggregates (WGMA)
10
Advances to Priority Sector by all SCBs (Final)
11
Advances to Priority Sector by all SCBs (Adhoc -Half yearly)
12
Special Return I (As on Last Reporting Friday of June)
13
Special Return II (As on Last Reporting Friday of June)
14
Special Return III
15
Advance under DRI Scheme
16
Credit Facility to SC/ST
17
Credit Assistance to Minorities
19
Case Study: Himachal State Cooperative Bank

Some of the Reports available
• Weekly Flash Data Report
• BSR Statements.
• Industry wise advances.
• Sector wise advances.
• Facility wise advances.
• Position of Priority Sector Advances and Disbursement.

100+ reports are deployed which cover reports of different departments like Credit, Risk
Management, Priority Sector Lending, Statistics, Retail Banking and International
Banking Division etc.

Dashboards are made available

Statutory and regulatory reports as per RBI format are generated.
Case Study: ADF Solution

203 ADF Reports Available for Reporting to RBI on defined frequency

Predefined templates available for data extraction.

Advances & Reminder Mail Alerts for Data upload, Report Due Data, Report Approval,
Report Submission.

XBRL Report Generation Integrated available for RBI Reports.

User Management available to define access rights to user as designation and
department integrated with bank employee data.

Report Scheduling and Auto Loading provided for report generation as on due date or
on receipt of data.

Dashboards are made available
Names of some Reports Rendered through ADF
Financial inclusion - number of no frill accounts opened
Form – VIII (SLR)
State-wise ATMs data
Area-wise ATMs data
Cards data
Pre-paid cards
Vostro list
List of offices/branches maintaining (Rupee and ACU Dollar) accounts of nonresident banks and list of Vostro accounts
Credit flow to micro, small and medium enterprise
Statement on the position of balancing of books
Form-A Provisional (Sec.42)
Form-A Final (Sec.42)
Form-X – statement of assets and liabilities
BSR1, BSR 2, BSR 4 & BSR 7
Opening / closing of branches
Sample Reports
Samples – What-If Analysis
Sample – Dashboards
CASA DASHBOARD
Employee Data – Creation / Edit / Upload
Data Upload – Screens with Maker – Checker Concept
Data Upload – Screens with Maker – Checker Concept
Data Upload – Screens with Maker – Checker Concept
Email Alerts – Data Upload / Reports
RBI Reports
RBI Reports – Version Wise Report Generation
RBI Reports – Report Details if Data Pending for Date
RBI Reports - Report Generation
Solution Overview:
MIS/BI & Automated Data Flow
Proposed Implementation and Methodology
Proposition to Customer
Accelerated
Roll-out
Thoughtful
Solution Design
Robust
Governance
• Requirement validation as
applicable
• Minimum Customization
• Parallel builds
synchronizing in to single
Testing phase
• Core Key team members
from domain and
technology are ready to
be deployed
• Governance Layer can be
leveraged
• Focus on current
application needs
• Alignment to Enterprise
standards of SBI as
applicable\required.
• Design and development
follow standard SDLC
processes .
 Bank/ NSCS key stakeholder
participation in project
governance
 Proven BI Governance
mechanism at all levels –
Country, Region, Group
Proven
Relationships &
Techniques
 Delivery excellence across
multiple projects over
many years
 Strong relationship with
SAS as a partner
 Real-time synchronization
between Onsite-Offsite
teams
Commitment to Bank for project Success
Successful Solution Implementation
Critical Success Factors which we will deliver against
Solution fit to
requirements
Conforms to existing
Performance measures
In-time Remediation
38
No cost & Schedule spillover
Objective
Planning
Initiation / Deliverables
Phases
Manage
Build Execute
Go-Live/Operate
Operate
Transfer
• Due Diligence
• Risk management
• Expectation
management
• Ensure governance
• Scope, issue, resource
management
• Design , Install ,
customize , integrate and
deploy Solution
• Provide operational
support
• Optimize
• Solution is live and
support model is in
place
• Project kick-off
• Establish PMO
• Project planning and
tracking
• Budget tracking
• Requirement gathering
• Infrastructure design
• UAT,PDC,HA,DR
• Install Solution
• Parameterization and
customization
• SIT and UAT
• Pilot Rollout, Parallel run
• Initial Training
• Data migration, QA, UAT
• Production
Migration/cut-over
• Phased Rollouts: web
based, thin clients,
messing hub integration
• Define SOP for
Integrations, On
boarding
• Training
• Verification and
signoff.
• SRS, traceability matrix
• Process Documents
• High /Low level design
39
• Infrastructure
plan
• Customized Solution
• QA Results
• QA,UAT, production
deployments
• Training schedule
• User manuals
• Pilot/ HARD Launch
Activities
• GAP / risk /
dependency
identification
Deliverables
Transfer
Initiation
• Verification of
scope/requirements
• Monthly steering
Committee meetings
• Weekly check point
meeting
• Scope management
• Verification of existing
solution
stack/environment
• Planning: QA,
Integration, migration
,Rollout
• Project charter/Plan
• Roles Responsibilities
matrix
• Frozen Project scope
• Risk management
plan
• Project calendar
• Resource calendar
• Gap analysis
• Updated project plan
• Status reports
• Issue tracking status
• Budgets
• Change management Log
• Rollout plan, release
management
• QA plan
• Setup Support:
Helpdesk, L2, L3
• Application
monitoring
• Build knowledge
repository
• Tier 3 support
• Problem/issue
management
• Root cause analysis
• Change management
• Production updates if
any
• Lights are on, SLA
tracking
• Admin/user guide
• On boarding SOP
• Change controls if any
• System
documentation
• AMC contract
• Help desk
• Application
Support
Key Success factors
Collaborative approach and transparency
Strong
Governance
Strong
Program/Project
management
Proactive Risk
identification
and mitigation
Mature process framework based on CMMi 5 and ITIL…
Roles and Responsibilities - Representative
Project Phases
NSCSPL
Bank
Analysis Of Requirements
a) Capture Business Requirements
b) Source System Study
c) Gap Data analysis
a) Provide Business Requirements
b) Access to data sources
c) Sign-off the BRD
Design Phase
a)
b)
c)
d)
a) Data in structured format
b) Sign off the design document
Construct Phase
a) Provides gap data entry programs
b) Configure ETL
c) Configure rules engine for DQ and
transformations
d) Build Reports
e) Configure alerts and authorizations levels
Internal Testing
a) Report wise testing
b) End to end testing
UAT
a)
b)
c)
d)
Trainings and Go-live
a) Impart training to core team
b) Training to users and other stakeholders
c) Port the solution on production
environment
Configure Data Model
Configure Solution
Design ETL & Business Rules
Design Gap data screens
Initial training to testing team
Replicate Test cases
Record Issues
Address Issues
a)
b)
c)
d)
Access to Source System for integration
Ensure Gap data is entered and authorized
ISSP guidelines for configurations of user levels
Provide hierarchy for sending alerts
a)
b)
c)
d)
Constitute test team
Provide Test cases
Conduct UAT and notify issues
Sign off UAT
a)
b)
c)
d)
Nominate personnel for trainings
Nominate the pilot branches/departments
Sign offs on training
Go-live sign off
Thank You!
Q&A