Deep Dive into Leveraging New Features and Functions of SAP NetWeaver BW 7.4

Deep Dive into
Leveraging New Features
and Functions of SAP
NetWeaver BW 7.4
Dr. Bjarne Berg
COMERIT
© Copyright 2014
Wellesley Information Services, Inc.
All rights reserved.
In This Session
•
•
•
•
You will learn what is new in SAP NetWeaver® BW 7.4 and how
you can leverage it in your organization
We will look at the SAP NetWeaver BW 7.4 on HANA capabilities
as well as the non-HANA functionality
We will show a demo of a very large dataset in SAP NetWeaver
BW 7.4 on HANA through SAP BusinessObjects and see new
font-end capabilities
At the end of the session you will have a very good understanding
of the new capabilities and how you can use it in your company
1
The Reasons for Moving to SAP NetWeaver BW 7.4
•
BW 7.4 was available as of May 2013 and has been well tested
BW Version Release Date
1.0E
Dec-98
1.2A
Feb-99
1.2B
Jun-99
2.0A
Feb-00
2.0B
Aug-00
2.1C
Dec-00
3.0A
Nov-01
3.0B
May-02
3.1C
Nov-02
3.2
Mar-03
3.3
Aug-03
3.5
Mar-04
2004S
Jun-07
7.0 (~"7.1")
Dec-08
7.3
Mar-11
7.4
May 13
End of mainstream maintenance
Jan-99
Jun-99
Jun-04
Feb-05
Dec-05
Dec-05
Dec-05
Dec-06
Dec-06
Dec-06
Dec-06
Mar/Dec-10
Dec-10
Mar-14
Mar-16
May-19
BW has now been around for over 16 years!
2
SAP HANA and BW 7.4
•
For BW 7.4 on HANA, SAP has continued to
move more of the process intensive
functions from the application to the DB
server
•
This takes advantage of the performance
improvements of an in-memory DB
•
It also reduces the need for data transfers
between application and DB server
As we will see later, the benefits of this approach are dramatically
faster data activation, data transformations, and query executions
3
What We’ll Cover
•
•
•
•
•
•
•
Taking advantage of New Development capabilities
Leveraging New Front-end Enhancements in BW 7.4
Using New ETL Features
Demo of BW 7.4 on HANA
New Security capabilities
Planning and Consolidation with BW 7.4
Wrap-up
4
SAP HANA and BW 7.4: Unified Modeling Tool Platform
•
SAP has spent significant
time on simplifying the
modeling tools in their
landscape. This includes tools
in SAP HANA Studio, inside
SAP NetWeaver BW, and also
for the ABAP development
tools.
•
All new tools are based on the
Eclipse platform for simplicity
and to make each tool easier
to use
There are also new BW Modeling capabilities for the new “Open
ODS View” and the new “CompositeProvider”
5
New Business Content Optimized for BW on HANA
•
SAP has developed
specific new
content for BW on
HANA
• This takes advantage of HANA
optimized transformations,
consolidated InfoObjects, more
line item details, and in some
cases leverages the BW models
and the HANA models in
combined scenarios
For those “green fielding” a HANA implementation, or planning to develop analytics
in these areas, serious consideration should be spent on leveraging this new content
6
BW Workspaces and Agile Data Marts
•
•
BW 7.4 continues to leverage
the concepts of BW workspaces
for technically savvy business
people to be allowed to develop
their own data marts that can be
changed on-the-fly without IT
support
This creates more flexibility for
business units that are sharing
a BW 7.4 environment
You can leverage the concept of Workspaces in both SAP NetWeaver BW 7.4 as well as in
SAP BusinessObjects 4.x for increased agility for developers located in the business units
7
HANA Optimized BW 7.4 DSOs and Performance
Improvements
•
HANA-optimized DSOs are also available for BW 7.3, but as of 7.4
Optimized DSOs are now obsolete — sufficient improvements have been
made to push logic down into HDB that standard DSOs perform as well
as (if not better than) optimized DSOs
•
This means that data activations are done much faster at the HANA
database layer
The change log is no longer a calculated view, it is now a DB table
•
There is no need to migrate 3.x outbound flows from DSOs
to realize activation performance
8
Moving OLAP from Application to the Database
Layer
•
•
•
•
To share workload in traditional DWs, systems
relied on splitting execution of logic between the
database and multiple application servers
BW 7.4 is moving as much logic as possible to
the much faster in-memory database. It also
reduces time spent on data transfers between
application and database servers.
This trend started with BW 7.3 with RKFs,
exception aggregation, and handling of
hierarchies
With BW 7.4 this is enhanced to remove
temporary result tables and the execution of joins
and unions
In SP6, we see even more movement of OLAP functionality to the DB. This
includes exception aggregations of formulas, advanced hierarchy handling,
and the treatment of non-cumulative key figures at the database server level.
9
Enhancements to BW 7.4 OLAP Cache
In BW 7.4 there are some improvements to the OLAP cache. It is now an Analytic
Engine function, which means that the Analytic Engine can also run without an OLAP
cache.
Mode 0: The Local cache
In this mode, the database cache is activated. The system then works exclusively with
the local cache.
Cache mode D: Database cache
In the D-mode, the cache data is persistent in database tables. In this mode, no data is
displaced, and the memory size is unlimited. The database instance that the table sits
on carries the load. More space is required, but this method also saves time.
Cache mode I: Cache inactive
The data is read again in every navigation step
Consider using cache mode D for the most frequently used queries that require calculations and
are relatively slow. In this mode, the use of aggregates (for non-HANA systems), is not needed.10
Creating a Logical or Federated EDW with BW 7.4
•
•
•
•
By using the BW virtualization
layer, you can now create a
federated EDW
Data can be linked and accessed
through the HANA Smart Data
Access (SDA) and ODBC to any
source
You can use a single query to BW
and non-BW based EDWs through
an Open ODS View or a Composite
Provider
There is no need to physically
move data from other EDWs to BW
to have a Federated EDW
Many companies have multiple reporting systems that they want to integrate without writing
ETL programs and moving data. SAP NetWeaver BW 7.4 on HANA can help you avoid this.
11
SAP HANA and BW 7.4
•
•
BW 7.4 on HANA introduces the Smart
Data Access that allows us to create:

Virtual table (real-time) links to a
source system

CompositeProviders to link BW DSOs
and “native” HANA views and tables

A flexible logical EDW that can be
remodeled without moving data
We also get a shared modeling tool
based on Eclipse
Using the new Operational Data Provisioning (ODP) we can also remove the need
for PSAs, thereby simplifying data architectures and reducing data latency
12
BW 7.4 Virtualization Layer
•
Using Smart Data Access (SDA),
an OpenODS view can read data
in Hadoop, IQ, Teradata, ASE,
and other HANA systems
•
For managed persistence
developers can switch from
virtual to persistent storage
without a need for a PSA, or to
make any changes to queries
SAP is currently piloting the Persistence
option in BW (for updates on this, see SAP Note 1922533)
13
BW 7.4 Managed Persistence and Modeling
•
In BW 7.4 we also get much more
flexible modeling. For example, the
managed persistence scenario may
include transformations for field-level
DSOs and the use of DTP.
•
Individual source fields may also be
linked to existing InfoObjects and
Open ODS views
•
While an object from a source, such
as views, data source, and tables may
be flagged as facts, master data, or
text
SAP is currently piloting the Persistence
option in BW (for updates on this, see SAP Note 1922533)
14
Enhanced DBA Cockpit for BW 7.4 on HANA
•
With the new DBA cockpit you can now see memory
consumption and disk size for row tables. Before you
could only see column tables.
•
There is also major new functionality in the DBA
Cockpit
 Cancel backups is possible and backint backups is available
 Display blocked threads and session information
 Kernel profiler can now accept custom trace thresholds
 The replication status is available if errors occurred
The DBA cockpit is available from transaction code DBACOCKPIT as long as you
have the authorizations for S_TCODE and S_RZL_ADM in your security profile
15
Model Integration with BW 7.4 and HANA
•
Many companies have developed “standalone” HANA systems and are now
moving their BW systems to HANA
•
With the Open DataStore layer, these customers can link HANA views,
tables, and BW DSO data to create models for simplified querying
•
You can even include InfoObjects in your modeling efforts
•
Using virtual tables and HANA’s Smart Data Access (SDA) methods, you can
also include data from external systems
SAP is currently piloting field-based modeling in OpenODS Views
(for updates on this, see SAP Note 1922533)
16
SAP HANA and BW 7.4 — Open ODS View
•
•
For BW 7.4 we get a new object called an Open ODS View
This new object allows us to include external data models in BW and
to query BW and non-BW data in a single BEx query
In the past, BW had been criticized for the complexity to integrate non-BW data in an EDW.
The new Open ODS view and the new CompositeProvider solves most of these issues.
17
Enhanced CompositeProviders
•
•
•
The enhanced
CompositeProvider allows
you to consolidate BW
MultiProviders, HANA-based
Virtual and Transient
Providers, and InfoSets
You can also use the
CompositeProvider join data
from other HANA DataMarts
and applications
There is also new support for
non-cumulative key figures
(i.e., inventory numbers)
Note: VirtualProviders and InfoSets are currently planned for BW 7.4 SP6
18
Building a CompositeProvider
•
In this example from SAP, data from two InfoCubes and One DSO is joined in
a CompositeProvider using the graphical view (there is also a form view)
Another new feature: DB Connect can now be used to
replicate data to BW from any schema in SAP HANA
19
Changes to BW Accelerator for BW 7.4
•
HANA is the preferred database for
all BW 7.4 systems
•
However, for those with a traditional
database and BWA, the upgrade to
BW 7.4 consists of only minor
changes to how BWA works
•
After the upgrade, calculating the exception aggregation for a
single key figure in BWA is possible for conversions before
aggregation, but no longer available for quantity conversions
In real client tests, HANA has been found to be up to 2.9 times faster than
BWA due to better handling of OLAP functionality as well as data retrieval
20
Cool New Feature: Automatically Generate
HANA Models from BW
•
You can now automatically
create new HANA models
based on InfoCubes and DSOs
in BW
•
The generated HANA views
access the data in the
InfoProviders
•
All HANA view capabilities are
available for the BW data
• BW Security is leveraged and views can be accessed by tools such as SAP
BusinessObjects Explorer, Lumira, and other SAP BusinessObjects tools
In addition to the BW model import in the HANA modeler, this
functionality leverages the existing metadata in BW to create new views
21
HANA Analysis Processes (HAP) with BW
•
Since BW 3.5, we have had a tool called
Analysis Process Designer (APD)
•
This tool can be used for regression,
forecasting, clustering, association rules,
and basic statistical functions
•
In BW 7.4 with HANA, many of these
functions can be executed much faster at
the database level (HAP) using even more
advanced functions from libraries such as
the R-statistical functions, L scripts, SQL
scripts, procedures, PAL, and much more
You can automatically store the results from
these processes and use them for reporting
22
What We’ll Cover
•
•
•
•
•
•
•
Taking advantage of New Development capabilities
Leveraging New Front-end Enhancements in BW 7.4
Using New ETL Features
Demo of BW 7.4 on HANA
New Security capabilities
Planning and Consolidation with BW 7.4
Wrap-up
23
Taking Advantage of the Fiori Launchpad
•
The SAP Fiori Launchpad is a tile-based entry
point to Fiori apps for mobile or desktop devices.
When it was launched in May 2013, it came with
25 pre-developed applications from SAP.
•
With BW 7.4, it can be enriched with specific
analytical objects, reports, and planning
applications.
•
The tiles displayed to a user depend on the role assigned. Users can also
personalize their interface by selecting from any published ready-to-use
tiles from the “tile catalog.”
The Fiori Launchpad is basically a shell with search and organization
capabilities back to applications, reports, and analytical objects
24
Deploying More Social Media Integration with BW 7.4
•
With SAP’s social media called
SAP Jam you can deploy your
analytics in a shared environment
for comments, collaboration, and
sharing of key reports and
findings. This is also available in
SAP BusinessObjects BI 4.1
•
You can also use the
programming interface of the
Social Media ABAP Integration
Library (SAIL) and build
customized objects based on
common tasks supported in the
library
25
Other Enhancements — Easy Query and ODATA
•
A cool new feature is that if you flag a BEx Query as “Easy Query”
and as interfaced by “OData,” you get a planning and reporting
interface you can deploy to mobile devices
After you flag the Query in BEx Query Designer as “Easy Query” under advanced
properties, go to the Easy Query Manager, use the transaction code: EQMANAGER
26
What We’ll Cover
•
•
•
•
•
•
•
Taking advantage of New Development capabilities
Leveraging New Front-end Enhancements in BW 7.4
Using New ETL Features
Demo of BW 7.4 on HANA
New Security capabilities
Planning and Consolidation with BW 7.4
Wrap-up
27
Leveraging Enhanced Graphical Dataflow Modeling
•
The graphical dataflow modeling in
BW 7.4 has been enhanced with
two new functions that are useful
•
You can now activate objects
inside the dataflow without having
to leave the ETL modeling screen
•
You can also save all dataflows as a web page and place it on a portal
(i.e., SAP portal, SharePoint) and use it for accessible documentation
that is easy to maintain
DB Connect can be used to replicate data to BW
from any schema in the SAP HANA database
28
BW 7.4 and Operational Data Provisioning (ODP)
•
•
•
In BW 7.4 SAP has enhanced ODP
to allow for using SLT and other
BW systems as sources for BW
This creates a share technology
platform for data extraction and
allows for single extraction and
multiple data targets
It also removes the need for a
Persistent Staging Area (PSA) for
the data loads based on ODP
Data in the Operational Delta Queue is highly compressed and
therefore does not require as much space as the PSA
29
Real-Time Data Warehousing Becomes Much Simpler
•
•
•
Since SLT is now supported for
Operational Data Provisioning to
BW, we can push data real time to
BW InfoProviders in a much simpler
manner
The data in the Operational Delta
Queue (ODQ) can also be used by
other applications
Again, since PSA is not required, the
dataflows get much easier to
develop and maintain
You should seriously consider this technology
for real-time operational reporting and for the
month-end financial close process
30
Use ODP/ODQ to Simplify Data Movement
•
•
•
Using standard extractors from ERP,
you can use the Operational Delta
Queue (ODQ) to move data to one or
more BW systems
SAP’s ETL tool, Data Services, can
access the ODQ and also move data
to other non-BW applications
without the need to extract the data
twice
An ODQ inside BW can also be used
to move data to other BW systems
The old Application Link Enablement (ALE)
and IDocs are replaced with synchronous
Remote Function Calls (RFC)
31
Optimized Transformations and Data Activation
•
Activating data for reporting
against the BW NIRV table was a
very slow process in the older
BW systems. With some number
range buffering (BW 7.0) and
package fetch (BW 7.3) this was
somewhat improved, but it was
still not extremely fast.
•
To speed up activation in BW 7.3
on HANA, and transformations in
BW 7.4 on HANA, more of this
was moved to the database layer
•
Currently, transformations
include conversions, master data
reads, formulas, data mapping,
and SQL scripts using most
InfoProviders and loading to a
DSO
32
BW 7.4 — OpenHub Enhancements
•
•
•
A cool feature is that a query can now be used as the data source
of a data transfer process (DTP) of type full
 This means that you can use the extraction of query data and
the subsequent data distribution to an OpenHub Destination
You can also send data using a query provider on an ad-hoc basis
and OpenHub can be used to send data to other HANA systems
It is even possible to create delta data movements for
DataSources and InfoProviders, making OpenHub a key
technology in any EDW landscape
With OpenHub, SAP BW is not a “data jail” and data can easily be
integrated between platforms and other reporting systems
33
Non-Active, Data Archiving, and Near-Line Storage
in BW 7.4 on HANA
•
•
For most companies that have been using
BW for many years, significant benefits
can be gained by implementing Near-Line
Storage (NLS) based on Sybase IQ
NLS support for InfoProviders with noncumulative key-figures are planned for
release in BW 7.4 Service Pack 7 (Source: Brian
Wood, SAP AG, TechEd 2013,
http://blasthemy.com/sap/TechEd13/1_Session_PDFs/RDP/RDP207/RDP207.pdf)
•
•
With BW on HANA, non-active data such
as PSAs can be held on disks, thereby
reducing the memory consumed by BW.
Traditional data archiving is still available via the BW SARA transaction
Currently, there are DBSL-based direct connections to Sybase IQ version 15.4 for very large
databases (VLDB) and large binary objects (LOB). Platforms supported include Sybase IQ
ODBC NLS client for BW Application Server on Windows and Linux (x86 64 bit).
34
What We’ll Cover
•
•
•
•
•
•
•
Taking advantage of New Development capabilities
Leveraging New Front-end Enhancements in BW 7.4
Using New ETL Features
Demo of BW 7.4 on HANA
New Security capabilities
Planning and Consolidation with BW 7.4
Wrap-up
35
SAP NetWeaver BW 7.4 on HANA
36
What We’ll Cover
•
•
•
•
•
•
•
Taking advantage of New Development capabilities
Leveraging New Front-end Enhancements in BW 7.4
Using New ETL Features
Demo of BW 7.4 on HANA
New Security capabilities
Planning and Consolidation with BW 7.4
Wrap-up
37
Read Access Logging
•
In BW 7.4 you can also start
logging read access for
specific domains and users
•
You can select specific
fields to be monitored
•
You can also monitor all
operating processes of BW
7.4 using SAP Solution
Manager 7.1.
Do not turn on read access monitoring for all fields and users in
large active BW systems. If you do so, the logs can get very large.
38
Using New Security Features
•
For even more restrictive access and control, there are five new
Authorization Objects in BW 7.4
1. S_RS_ODSV: Open ODS view
2. S_RS_ODSP_H ODP: Extraction from SAP HANA
3. RSHAAP for HANA analysis process
4. RSHAOT for HANA analysis elements
5. S_RS_HCPR SAP HANA for CompositeProvider authorizations
For those on obsolete BW 3.5, or those who has not done a security
conversion in 7.0, the new amortizations have to be activated
39
What We’ll Cover
•
•
•
•
•
•
•
Taking advantage of New Development capabilities
Leveraging New Front-end Enhancements in BW 7.4
Using New ETL Features
Demo of BW 7.4 on HANA
New Security capabilities
Planning and Consolidation with BW 7.4
Wrap-up
40
Updated Interface and BPC Copy Planning
Functions for BW 7.4
•
BPC recently got a new
redesigned Web 2.0
interface to simplify and
modernize the tasks in
BPC
•
With SAP BW 7.4 you
can now copy planning
functions to save
development time when
extending basic
planning models
The BPC 10 functionality for BW 7.4 is found in Support Pack 10 and there is
new terminology: The Planning Engine is now called “the Planning Processor”41
New DSO for BW-Integrated Planning and More
•
Planning on a DataStore Object for Direct Update
 With BW 7.4 you can use DataStore objects for direct update in
planning mode as planning-specific InfoProviders
•
Planning Applications Kit
 In BW 7.4 you can use the new technical scenario for planning
 The planning engine can have read access to the HANA database
and use the ABAP Planning Applications Kit (PAK) internal
routines in HANA for faster execution
 For BW 7.4, you can also perform planning using internal database
routines
If you set Key Figure Values as “available” in planning. You can
use the new planning function type that will set values for key
figures and distribute them according to reference data.
42
BW 7.4 — Unified Planning and High Cardinality
•
•
BW 7.4 is also taking the unified planning in BPC on SAP
NetWeaver® further
 You can now use the speed of HANA while keeping the Excel
interface, leveraging the BPC admin interface, and continuing
to use the PAK planning manager in Integrated Planning.
You can also overcome the 2 billion limitation in BW by flagging
the correct InfoObjects as “High Cardinality” (no SIDs are
generated)
 This can be used for planning and in DSOs as well
For Integrated Planning on BW 7.4, you can now push some of the logic down to HANA
script and you can now also delete DSO records instead of just removing values
43
What We’ll Cover
•
•
•
•
•
•
•
Taking advantage of New Development capabilities
Leveraging New Front-end Enhancements in BW 7.4
Using New ETL Features
Demo of BW 7.4 on HANA
New Security capabilities
Planning and Consolidation with BW 7.4
Wrap-up
44
Other Fixes and Enhancements in BW 7.4
•
•
•
For Integrated Planning on BW 7.4 you can now push some of the
logic down to HANA script and you can now also delete DSO
records instead of just removing values
The Analytical Manager in BW has also been improved for faster
calculations for MTD, YTD, exception aggregation, period
comparisons, and rolling averages
You can now also get more than 60 Characters in BW. The new
attribute and output length can be up to 250 characters and longtext for Characteristics can now be stored as CHAR 1333.
BW 7.4 has addressed much of the smaller fixes
that were minor irritation items in BW 7.3
45
Some of
the
features
in BW 7.4
are HANAspecific
Others are
available
for
traditional
RDBMs
This is an
overview
of what is
available
for HANA
and nonHANA
BWs
46
Future Changes to SAP NetWeaver BW
•
While SAP has not formally committed to new features on BW.
They have indicated that a focus will continue to be on:
 Cloud deployment enhancements
 Simplified data modeling
 Unification of planning functions
 Tight integration to NLS for Sybase IQ
 Tight integration of mobile planning functions
 Enhancements to Hadoop integration
These enhancements will be ongoing in 2014 and some
are included in SP6
47
Where to Find More Information
•
•
•
http://scn.sap.com/docs/DOC-35096
 SAP Community Network – SAP NetWeaver Business
Warehouse 7.4
http://help.sap.com/nw_platform
 SAP Help Portal – SAP NetWeaver BW 7.4
www.stechno.net/sap-notes.html?view=sapnote&id=153967
 SAP Business content release note 153967 for BW 7.4
48
7 Key Points to Take Home
•
BW 7.4 is the first release to take full advantage of SAP HANA
•
Many of the functions in 7.4 are also available to non-HANA
customers
•
The new CompositeProviders and the Open ODS View makes
HANA and BW tightly integrated and capable to support EDWs
better
•
Real-time data warehousing is fastly becoming the new norm
•
Social integration and mobile deployment is now mainstream
•
BW 7.4 provides a platform that should break from the past
development approaches of BW (real-time, LSA++, virtual, and
in-memory)
•
Most customers should consider this move in 2014!
49
Your Turn!
How to contact me:
Dr. Bjarne Berg
[email protected]
Please remember to complete your session evaluation
50
Disclaimer
SAP, R/3, mySAP, mySAP.com, SAP NetWeaver®, Duet®, PartnerEdge, and other SAP products and services mentioned herein as well as their
respective logos are trademarks or registered trademarks of SAP AG in Germany and in several other countries all over the world. All other product and
service names mentioned are the trademarks of their respective companies. Wellesley Information Services is neither owned nor controlled by SAP.
51