Download Report

1
Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
The following is intended to outline our general product direction. It is intended
for information purposes only, and may not be incorporated into any contract.
It is not a commitment to deliver any material, code, or functionality, and should
not be relied upon in making purchasing decisions. The development, release,
and timing of any features or functionality described for Oracle’s products
remains at the sole discretion of Oracle.
2
Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
Next-Generation Data
Integration on Oracle Exadata
3
Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
Insert Information Protection Policy Classification from Slide 13
Program Agenda
 Introduction
 Oracle Data Integration Overview
 Engineered Together
 Customers
 Summary
4
Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
Change is Inevitable and Unstoppable
Data Volumes and Retention Times Grow Continually
Data volumes continue to increase exponentially
Infrastructure costs go up
Data Volume
Data processing tasks take longer
Overall data complexity increases
Data lifetimes are getting longer
Storage requirements and costs increase
“Active” vs. “Archive” data must be defined
Regulatory requirements = immediate data access
Data Lifetime
5
Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
Change is Inevitable and Unstoppable
Batch Processing Windows Are Shrinking
Hours
Batch processing takes too long
8x5
Global 24 x7 operations limit downtime
Processing volumes exceed batch windows
Even the best hardware will struggle eventually
Insufficient
Time
Minutes
24x7
Seconds
MB
GB
Amount of Data
6
Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
TB
Change is Inevitable and Unstoppable
Reacting Quickly to Your Data, Creates Value for the Enterprise
Faster business decisions for operational excellence
Business Value
Business event
Time available to capture data is decreasing
Analysis of increasing data volumes = delays
Data captured
Operational excellence requires immediate action
Real-time capture and action is available already
Analysis completed
Action taken
Action Time
Based on Richard Hackethorn’s Component’s of Action Time
7
Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
Oracle Data Integration
Overview
8
Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
Oracle Data Integration
Complete Offering for Enterprise Data Integration
Legacy
Oracle Data Integrator
Applications
Oracle GoldenGate
OLTP
Oracle Enterprise Data Quality
Unstructured
Modernization
9
Oracle Data Service Integrator
Migration
Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
MDM
BI
Big Data
 Complete and best-of-breed
approach for enterprise data
integration
 Maximum performance with
lower TCO, ease of use and
reliability
 Certified for leading
technologies to deliver fast
time to value
Oracle Customers Report:
 80% lower TCO
 Five times higher performance
 70% reduction in development costs
Synchronization
SOA
Oracle Data Integrator
Bulk Data Processing and Data Transformation
Legacy
Applications
OLTP
Unstructured
Oracle Data Integrator
Declarative Design
High Performance E-LT
 Lightweight deployment
Extensible Knowledge
Modules
 Flexible, easy to enrich
functionality
CEP Data Services
10
Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
 High-performance, low
cost of ownership E-LT
architecture
Oracle GoldenGate
Real-time Data Integration
Legacy
Applications
Oracle GoldenGate
Log-based Change Data
Capture and Delivery
Bidirectional Replication
OLTP
Unstructured
CEP Integration,
Real-time Events
Heterogeneous Sources
and Targets
Reliability and
Transaction Integrity
11
Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
 High-performance, lowimpact real-time data
integration
 Timely data for improved
business insight
 Continuous availability for
24/7 operations
Summary: Oracle Data Integration
Private
Cloud
Any Data,
Any Source,
Any Latency
Public
Cloud
Oracle SOA Suite, BPM Suite, Oracle Business Analytics
On Premise,
On Cloud
Zero Downtime,
High Performance
Oracle Enterprise Data Quality
Oracle
GoldenGate
Oracle Data
Integrator
Big Data
Connectors
Data Service
Integrator
Oracle Cloud Application Foundation
Trusted Data
Fast
Time-to-Value
12
Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
OLTP
OLAP
Legacy
Unstructured
Engineered Together
13
Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
Exadata Database Machine
Best Platform to Run the Oracle Database
 Best Machine for Data Warehousing
 Best Machine for OLTP
 Best Machine for Database Consolidation
14
Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
Data Integration Solutions for Exadata
Use Cases
Warehouse
Bulk Loading
Real-Time DW
Updates
Database
Consolidations
DW Appliances
Migration
• Fastest E-LT
optimized for
Exadata
• High Speed
Data Capture
& Streaming
• Zero
Downtime
Upgrades
• Native
Non-Oracle
Connectivity
• Protects Your
Exadata
Investments
• Integrated
Monitoring &
Management
• Any Latency:
from Batch to
Real-Time
• Active-Active
Phased
Consolidation
• Efficient
Tool-Based
Solution
• Offload
Workloads
and Backups
15
Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
Maximum
Availability
Data Warehouse Bulk Loading with E-LT
Fastest ETL Solution for Exadata
Extract
Solution
Load

ODI for bulk loading Exadata

Run ODI Agent on Exadata JVM

Fastest possible data transformations
Benefits
 No extra ETL servers
Transform
16
Copyright © 2012, Oracle and/or its affiliates. All rights reserved.

Uses Exadata advanced SQL functions

Parallel statements in Exadata, not ETL server

Integrated Management & Monitoring

Easier to deploy than conventional ETL tools

Faster time to market
Nobody Beats ODI on Exadata
7.5TB per Hour of Real World Data Loading and Transformations
ODI ELT w/ Exadata

ODI scales with Exadata

ODI runs on Exadata – no ETL hardware required



No new hardware required as data sets grow
ODI processes used only during integration runs
Exadata continually available for OLTP, BI, DW, etc

Common administration, monitoring and management

All the benefits of rapid tool-based ETL development
Conventional ETL
17
Copyright © 2012, Oracle and/or its affiliates. All rights reserved.

Additional hardware ($$) needed to scale

ETL parallel optimization and design ($$$) is heavily
dependent on resources available to the ETL environment

ETL engine hardware resources only used for ETL 

Different management, monitoring and administration from
database and BI infrastructure ($$)
Oracle Data Integrator Enterprise Edition
Best ETL Platform for Exadata
 ODI’s E-LT architecture is best for Exadata
– Exadata powers all transformations
 No additional hardware is required
–
ODI performance scales linearly with Exadata infrastructure
–
ODI transforms the data without it ever leaving the Exadata Machine
 ODI implements Exadata best practices
– Fastest Loading Mechanisms
 External Tables, SQL*Loader, DBLINK, Data Pump
18
–
Out of the box Index Management
 Support for bitmap indexes, unique/non-unique indexes
–
Advanced Oracle Features Support
 Optimizer hints (Direct Path loading, Parallel, etc)
 Merge & Multi-Table Insert statement
 Any Oracle function can be leveraged (incl. analytic functions)
Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
Real-Time Data Warehouse Updates
Fastest
Get Data into Exadata at Any Latency
Solution
GoldenGate
 Any data, any time – at the right time!
 OGG & ODI for data delivery to Exadata
 OGG for true Real Time and ODI to cover all other
OGG
ODI
DB Triggers
Benefits
 OGG is non-invasive – no load on Sources!
 ODI tools can model data delivery at any latency –
Supporting
most
popular
DBMS’s
using Oracle GoldenGate, Triggers or Delta ETL jobs
Delta ETL
19
intra-day or daily latencies
Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
 Lower costs, and data delivered at the speed of
Business (at the right time)
Zero Downtime Database Consolidation
Consolidating Old DBs into Exadata Doesn’t Require Downtime
Solution
 Seamless migration of on-premise data to private
database clouds without downtime
 Bi-directional transaction replication between old
databases and Exadata (or Oracle Database
Appliance) using GoldenGate
 Data transformations, loads using Oracle Data
Integrator
Benefits
 Zero Downtime for key databases and apps
 Minimize risk with phased, rolling upgrades
 Faster return on investment, due to faster
consolidation
20
Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
Cloud Enablement: Migration to Oracle Exadata
Migrate Non-Oracle Appliances to Exadata with Native Tools
Solution
 ODI for modeling and mapping non-Exadata
sources into the Exadata data models
 Native support for Netezza, Teradata, and DB2/z
SQLs and DB Utilities
 GoldenGate for real-time CDC from Teradata or
DB2 zSeries
Benefits
 Tool-based migration is more repeatable and more
automate-able
 Active-Active phased transition option
 More maintainable solution that can also be part of
the long-term plans
21
Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
Data Integration for Big Data and Exadata
Improving Productivity and Efficiency for Big Data
Benefits
Transforms
Via MapReduce
Oracle Data Integrator
Activates

Improves productivity for
transforming Big Data

Optimizes the loading of Big Data
with Oracle Loader for Hadoop

Reduce complexities of processing
Hadoop through graphical tooling

Consistent tooling across BI/DW,
SOA, Integration and Big Data
Oracle Loader for Hadoop
Loads
Oracle Exadata
22
Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
Adoption of Oracle Data Integration @ Oracle
Oracle ERP Applications
Oracle Industry Applications
EBS
PeopleSoft
JDE E1
Agile PLM
Retail
Fusion
Applications
Fusion
MDM
Fusion
Financials
Insurance
Comms
Business Intelligence
Performance Management
Integration Packs
CRM
On-Demand
Life
Sciences
Trade
Promotions
Transportation
Management
BI
Applications
BI EE
Server
Planning
Essbase
Financial
Management
Spend
Analyzer
EPMA
Profitability
Management
Retail
Financials
Integration Middleware
SOA
Suite
Activity
Monitor
Oracle Database (Standard)
ODI
Integrated
23
OWB
Embedded
Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
Event
Processor
Service
Bus
BPEL
PM
WebLogic
Oracle Database (Enterprise Edition & Exadata)
ODI
Integrated
TimesTen
Integrated
Exadata
Certified
Enterprise
Manager
Big Data Appliance
ODI
Embedded
Best Data Integration Solution for Exadata
Top Performance, Integrated and “Red Stack” Optimized





Run Data Integration Products Directly on Exadata
Use Data Integration Products to Migrate, Consolidate, and for Data Warehousing
Support Any Heterogeneous Data Feeds
Non-Invasive Source Capture
Most Cost-Effective and High-Performance Data Loading
Oracle Data Integrator
DIM
Oracle GoldenGate
EMP
24
DEPT
Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
Batch Feeds, Incremental
Updates and in-DB
transformations via ELT
DIM
FACT
24
EMP
DEPT
DIM
DIM
Customers
25
Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
Customer Example: Turkcell
Data Warehousing on Oracle Exadata
High-Performance E-LT for Data
Warehousing
 Integrated network operations systems
to the data warehouse to offer a global
reporting solution
 Achieved 167% ROI after 9 months by
implementing an E-LT architecture
 20X Performance improvement using
Oracle Data Integrator on Exadata
 The combined solution helped
decrease data preparation time for data
mining from 27–29 days to 2–3 days
26
Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
ODI and Exadata – Real World Example
Job execution time in minutes
A Disruptive Improvement in Performance
5hrs 11mins
350
300
250
42X
IMPROVEMENT
tax allocation process runs 5 hrs 11
mins during quarter close
200
150
7min 20sec
100
 Exadata and ODI (E-LT) combined
is able to execute the process
42X faster (7mins 20 secs)
50
0
ODI on Exadata
Conventional ETL
27
 A complex branch of the customer’s
Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
Summary
28
Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
Optimized for Oracle Engineered Systems
Real-Time
Analytics
 Optimized bulk loads, Leverages Infiniband, Smart Storage
 No data transfer to/from separate ETL server
 Transformations use Exadata optimized SQL
 Native Batch And Real-Time integration capability
 Zero down-time migrations to Exadata
 Bridge for your Enterprise data and Big Data Appliance
 Tightly integrated with Exadata, Exalytics
29
Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
Oracle Data Integration
Oracle OpenWorld Shanghai - Schedule
30
Wednesday (24 – July)
Thursday (25-July)
Session ID: CON1732 Session Title: Managing
Your Data with Oracle’s Data Integration
Platform Venue / Room: Expo Centre - Room
425 Date and Time: 7/24/13, 14:00 - 15:00
Session ID: CON2068 Session Title: Real-Time Data
Warehousing with Oracle Data Integrator and Oracle
GoldenGate Venue / Room: Expo Centre - Room
425 Date and Time: 7/25/13, 10:15 - 11:15
HOL1738 Hands-On Lab Session Title: Deep
Dive into Oracle GoldenGate Venue / Room:
Expo Centre - Room 407/408 Date and Time:
7/24/13, 17:15 - 18:15
Session ID: CON2067 Session Title: Oracle Data
Integration Services Product Update: Oracle
GoldenGate and Oracle Data Integrator Venue /
Room: Expo Centre - Room 616 Date and Time:
7/25/13, 14:00 - 15:00
Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
Join the Data Integration Community
Twitter
twitter.com/ORCLGoldenGate
LinkedIn
“Oracle Data Integration”
Facebook
facebook.com/OracleDataIntegration
Oracle’s Data Integration blog
blogs.oracle.com/dataintegration
Oracle’s Data GoldenGate YouTube channel
youtube.com/oraclegoldengate
Oracle.com/goto/dataintegration
31
Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
32
Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
The preceding is intended to outline our general product direction. It is intended
for information purposes only, and may not be incorporated into any contract.
It is not a commitment to deliver any material, code, or functionality, and should
not be relied upon in making purchasing decisions. The development, release,
and timing of any features or functionality described for Oracle’s products
remains at the sole discretion of Oracle.
33
Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
34
Copyright © 2012, Oracle and/or its affiliates. All rights reserved.