Process oriented Data Stewardship improves

Luncheon Webinar Series
May 7th, 2015
Stewardship Center Overview
Presented by Robert Dickson
Sponsored By:
1
1
© 2015 IBM Corporation
Stewardship Center Overview
 Questions and suggestions regarding presentation topics? send to [email protected]
 Downloading the presentation
– http://www.dsxchange.net/StewardshipCenterOverview.html
– Replay will be available within one day watch for email with details
 Pricing and configuration - send to [email protected]
Subject line : Pricing
 For those that stay through the entire presentation, we have a
extra give away!
 Bonus Offer – Free premium membership for your DataStage
Management! Submit your management’s email address and
we will offer him access on your behalf.
– Email [email protected] subject line “Managers special”.
– Join us all at Linkedin http://tinyurl.com/DSXmembers
2
2
© 2015 IBM Corporation
IBM InfoSphere Information Server
InfoSphere Stewardship Center
Robert Dickson, Product Specialist – Information Server, [email protected]
© 2015 IBM Corporation
Agenda
 Stewardship Center Overview
 High Level Walk Through
– Information Governance
– Data Quality Remediation
4
© 2015 IBM Corporation
POLL QUESTION #1
5
© 2015 IBM Corporation
Agenda
 Stewardship Center Overview
 High Level Walk Through
– Information Governance
– Data Quality Remediation
6
© 2015 IBM Corporation
What Are Business Challenges Today?
 The business needs reliable data to:
– Operate efficiently
– Predict accurately
– Market precisely
 The business lives on the edge of data uncertainty
– With Big Data, mobile data, and cloud data, constant change is now part of
every business
 Strong domain expertise separate IT and business teams
– There are few skilled people that understand the business requirement and the
current process, data models, and IT infrastructure
– Companies must allocate a majority of the IT operation cost on labor to get
better business results
 IT owns the tool and business owns the process
– Companies must spend a lot of money to find the right software and domain
expertise to get the project done on time
7
© 2015 IBM Corporation
IBM InfoSphere Stewardship Center
Key capabilities
delivered within
customizable and
collaborative interfaces
Mobile
Social
Collaboration
Web
Workflow &
Rules
Dashboard
Governance Officers
Data Stewards (IT and LOB)
Addressing the needs of
various roles across the
governance organization
Data Analysts/SMEs
Provide a single collaborative environment for business users to
define and monitor compliance with data quality policies and to
manage data quality issues to resolution
8
© 2015 IBM Corporation
InfoSphere Stewardship Center: Event Notification
with Workflow and Remediation
Exception
Fixes
Catalog
Updates
Business Term
Updates
Suspect
Duplicates
Read File
Errors
Notifications/
Email
Duplicate
Resolution
9
Quality Exception
Notification
© 2015 IBM Corporation
Meets the Needs of Critical Business Roles
Data Steward
Stewie Silvers
Data Steward
Manager
Martin McGregor
Governance
Council Member
Gary Grayson
10
Traditional Data Steward and LOB users
collaborate to remediate record violations,
improving data quality.
Data Steward Manager responsible
for overseeing a team of subject
matters experts.
Data Quality Champion and LOB leader,
collaborate defining data policies and
rules for the business in addition to
monitoring policy compliance.
© 2015 IBM Corporation
Stewardship Center Performance Dashboard
 The Stewardship Center provides out of the box Dashboards:
– Team Performance and Process Performance
11
© 2015 IBM Corporation
POLL QUESTION #2
12
© 2015 IBM Corporation
The Stewardship Center is built on top of
IBM Business Process Manager (BPM)
BPM is a discipline that leverages software and services to provide total visibility
into your organization. Discover, document, automate, and continuously improve
business processes to increase efficiency and reduce costs.
http://www-01.ibm.com/software/info/bpm/what-is-bpm/
Enterprise Processes
Sales
Marketing
Delivery
Onboarding
Registration
Party updates
IBM BPM & Decisions
Services
Information Server Services
Customer
Patient
Vendor
Product
Account
13
Data Governance
and Data Quality
Stewardship
Processes
BPM Standard
 BPM to govern the Data Governance and
Data Quality processes:
 BPM provides orchestration of the steps
required to improve data quality
 Information Server Governance and Data
Quality services to optimize Business
Processes:
 Information Server provides real time data
exceptions and events to be governed against
as part of a repeatable business process
© 2015 IBM Corporation
Typical Process Problems without BPM
Customer
Service
Account
Administration
Finance
and Ops
1
1.
Unstructured Tasks and
Communication (ex
Paper or email)
2
2.
Inefficient Working
Environment Spans
Systems
3
3.
Inconsistent
Prioritization
4
4.
Incomplete or
Inaccurate Data Flow
Between Systems
5
5.
Lack of Control Over
System and Business
Events (Exceptions)
6
6.
Poor Visibility Into
Process Performance
Executive 6
Management
1
3
Invoice
Reconciliation
Teams
2
4
5
14
© 2015 IBM Corporation
BPM Brings Order to the Chaos
Finance
and Ops
Executive
Management
Account
Administration
1.
1
Automate workflow &
decision making
2.
2
Reduce errors and
improve consistency
3.
3
Standardize resolution
across geographies
4.
4
Leverage existing
systems and data
5
5.
Monitor for business
events and initiate actions
6.
6
Real-time visibility and
process control
Risk Management
Teams
Customer
Service
Customer Benefits:
15
•
Huge Reduction in
Manual Work, Errors
•
Faster, More Consistent
Issue Resolution
•
Easier to Manage the
Business
•
Consistent Case Handling
© 2015 IBM Corporation
Go Mobile, Get Social, and Govern
Workflow
Social Collaboration
Mobile
Access
Reporting
Governance
16
© 2015 IBM Corporation
What is Included with Stewardship Center
 Two sample BPM applications
– Information Governance
– Data Quality Remediation
 Enhanced Information Governance Dashboard
– New SQL view and reports
 Opportunities
– Use sample BPM applications ‘as is’
– Extend and enhance the sample BPM applications
– Build custom BPM applications
17
As long as the processes are
only used in support of
Information Governance
Catalog or Data Quality
Remediation
© 2015 IBM Corporation
Agenda
 Stewardship Center Overview
 High Walk Through
– Information Governance
– Data Quality Remediation
18
© 2015 IBM Corporation
POLL QUESTION #3
19
© 2015 IBM Corporation
POLL QUESTION #4
20
© 2015 IBM Corporation
InfoSphere Stewardship Center Architecture
Information Governance Dashboard
Source
Systems
Information Analyzer
DataStage/QualityStage
Exception Stage
Common
Event
Framework
Data Quality Exception Console
Event
Management
API
(Information Analyzer,
DataStage/QualityStage
Exceptions Stage)
Information Governance
Catalog
MDM
Inbox
Workflows
Workflows
Monitoring
Collaboration
InfoSphere Stewardship Center
21
© 2015 IBM Corporation
Sample BPM Application for Governance Rule Approval
 Notification and assisted workflow for Information Governance Rules
– Aligns Information Governance team members and
encourages their interaction
– Enforces deadlines and keeps governance initiatives on-track!
– Illustrates the full power of IBM Business Process Management for custom,
site-specific workflow interfaces!
22
© 2015 IBM Corporation
Governance Rule Approval Workflow Overview
 After completing the edits to an Information Governance Rule, the
"author" starts workflow by clicking "Send for Approval"
23
© 2015 IBM Corporation
Governance Rule Approval Workflow Overview
 Retrieve Rule details
 Email Rule Approvers
and Stewards
RuleApprovers
Start
is rule
approved?


Retrieve asset details
via IGC REST API; parse
the response
Look for Stewards...
Yes
No
System
24
End
© 2015 IBM Corporation
Governance Rule Approval Workflow Overview
RuleApprover
chooses to
approve the Rule!
Email RulePublishers
and Stewards
RuleApprovers
REST API is invoked to formally
"Approve" the Rule in IGC
Start
is rule
approved?

Yes

Prepare Email for
RulePublishers and
Stewards
Send Email
No
System
25
End
© 2015 IBM Corporation
Governance Rule Approval Workflow Overview
 RulePublisher "publishes" the Rule!
26
© 2015 IBM Corporation
POLL QUESTION #5
27
© 2015 IBM Corporation
POLL QUESTION #6
28
© 2015 IBM Corporation
Agenda
 Stewardship Center Overview
 High Level Walk Through
– Information Governance
– Data Quality Remediation
29
© 2015 IBM Corporation
Sample BPM Application for Data Quality Remediation
 Workflow, Remediation, and Notification
–
–
–
–
30
Automatically assign data quality tasks to teams
Notify when tasks are waiting
Enforces deadlines and keeps remediation on-track!
Illustrates the full power of IBM Business Process Management for custom,
site-specific workflow interfaces
© 2015 IBM Corporation
Out Of the Box Exception Remediation Sample
apply fix
End
Apply fix request list
Data Source Owner
approve
resolve
reject
End
Approval
Data Steward Manager
request list
Exception
Start
Data Steward
31
submit
fixes
escalate
Exception list
© 2015 IBM Corporation
InfoSphere Stewardship Center
Single Inbox and Remediation Portal
MDM tasks
DataStage/Q
ualityStage
tasks
Information
Analyzer
tasks
Information
Governance
Catalog tasks
32
© 2015 IBM Corporation
Workflow – Data Steward (continued)
 Work with the task
“Export’ and ‘Import’ available for mass changes
‘Submit’ after changes
‘Escalate’ if you don’t know what changes to make
Select ‘Description’ to see more detail
33
© 2015 IBM Corporation
Workflow – Data Steward (continued)
 Work with the task (continued)
– See the exception description definition in IGC
The Data Steward can find what they need with a few clicks!
34
© 2015 IBM Corporation
Workflow – Data Steward (continued)
 Work with the task (continued)
– Edit and change individual records
35
© 2015 IBM Corporation
Workflow – Data Steward (continued)
 Work with the task (continued)
– Edit and View changed records
Changed records are highlighted in light blue.
Changed data is highlighted in dark blue.
Data Steward
can EDIT and
VIEW
changes!
36
© 2015 IBM Corporation
Workflow – Data Steward Manager
 When the Data Steward selects ‘Submit Fixes’
– Approve – goes on to Data Source Owner
– Reject – goes back to Data Steward
• Any fixes are also discarded
37
© 2015 IBM Corporation
Workflow – Data Source Owner
 When the Data Source Owner select ‘Approve’
– Apply Fixes
• Once changes done (however they are done)
38
© 2015 IBM Corporation
Thank You
© 2015 IBM Corporation
Upcoming Webinars at DSXchange
 InfoSphere Stewardship Center Deep Dive
– In this session, Ernie will take a closer look at how the InfoSphere Stewardship
Center enables detailed workflow for activities performed within the Information
Governance Catalog. This includes such things as new Term and Information
Governance Rule approval, and notification when someone changes a
description or decides to assign an asset or create an Extension Mapping
Document. He will briefly review "Events" and how they are managed, and
then illustrate how formal business processes are invoked to control the
approval steps and notifications that you can build into the solution. Register to
join us at Noon, CDT May 11th
 Stewardship Center for Data Quality Remediation
– In this last session, Robert will take a closer look at how the InfoSphere
Stewardship Center enables detailed workflow for Data Quality
Remediation. This includes exceptions from Information Analyzer Data Rules
and DataStage/QualityStage Exceptions. He will briefly review "Events" and
how they are managed and used, and then illustrate how formal business
processes are invoked to control the remediation ('fixing') of exceptions, and
the approval steps in the sample application. Register for our third session at
Noon on May 18th
40
© 2015 IBM Corporation