1. No category

OEP BOF9272
SOA Event Delivery Network
empowered by Fast Data
Simone Geib
Director of Product Management
Service Integration
Lloyd Williams
Principal Product Manager
Business Integration
September 30, 2014
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
Safe Harbor Statement
The following is intended to outline our general product direction. It is intended for
information purposes only, and may not be incorporated into any contract. It is not a
commitment to deliver any material, code, or functionality, and should not be relied upon
in making purchasing decisions. The development, release, and timing of any features or
functionality described for Oracle’s products remains at the sole discretion of Oracle.
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
3
Agenda
• Oracle Event Processing (OEP) Product Overview
• Event Delivery Network (EDN) Overview
• OEP & SOA EDN
• Demo: Service Request SLA Monitoring
• Demo: Wire Transfer Fraud Monitoring
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
4
Oracle Event Processing Applications
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
5
Connecting the Internet-of-Things to Your Enterprise
Oracle Event Processing: From Noise to Value
Internet of Things
SOA / Enterprise
SOA
Devices /
Gateways
• High Volume
• Continuous Streaming
• Sub-Millisecond Latency
• Disparate Sources
• Time-Window Processing
• Pattern Matching
OEP
OEP
embedded
OEP
Distributed
Intelligence
•
•
•
•
Filtering
Correlation
Aggregation
Pattern matching
Macro-event
High-value
Actionable
In-context
• High Availability / Scalability
• Unique Coherence Integration
• Geospatial, Geo-fencing
• Big Data & IoT Integration
• Action!
“Sea of data”
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
Modern Computing Challenges
Conditions for Event Processing
Does the problem have any one or more of the following conditions:
① Requires high-throughput and low latency processing
② Continuously streaming data
③ Real-Time correlation between multiple incoming data sources
④ Time-sensitive alerts, aggregations and calculations
⑤ Patterns in the data stream
⑥ Problem is more easily solved by analyzing before storing in DB
⑦ Data does not need to be stored, if there is nothing of interest in it
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
7
Solution Product Overview
Oracle Event Processing
Streaming
Event Data
Filtering,
Pattern Matching,
Missing Events,
Aggregations,
Correlations,
Calculations,
Geo-Spatial
Solution involves one or more of the following:
• High Volume
• Continuous Streaming
OEP
• Sub-Millisecond Latency
• Disparate Sources
Alerts,
Actions
• Time-Window Processing
• Pattern Matching
• Business Event Visualization
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
Oracle Event Processing (OEP)
 High-Volume, Low-Latency Event Processing Infrastructure
 Time-Sensitive Processing & Pattern Matching
 Light-weight Java Application Server
 Deploy in Data Center or Distributed Locations
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
9
Solution Overview
Time Management & Pattern Matching
 Continuous Query Language (CQL)
 Pattern Matching
 Detect Absence of Events & Missing Events
 Event “A” NOT followed by Event “B” within 10 minutes
 Event “A”, Event “B” should occur next, but Event “C” occurs
instead.
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
10
Oracle Event Processing Application
Input
Adapter
DB
Business
Logic
Channel
Output
Adapter
Channel
Output
Adapter
(CQL)
Channel
Business
Logic
Channel
(CQL)
Input
Adapter
Channel
Business
Logic
(CQL)
Coherence
Big
Data
Output
adapters
sendthe
data
andHadoop
alerts
to
downstream
systems
and
business
processes
Databases,
Coherence
caches,
(HDFS)
and
NoSQL
database
can
be referenced
directly
Channels
Input
adapters
help
control
connect
tofiltering,
flow
data
of
sources
data
and
canaggregation
be tuned
for
optimal
performance
CQL processors
contain
correlation,
and
pattern
matching
business
logic in CQL processors
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
High-Performance In-Memory Data Processing
Data
Input
Adapter
Data
Channel
Business
Analytics
Logic
Data
Channel
Data
(CQL)
Data
Input
Adapter
Data
Business
Enrich
Logic
(CQL)
Data
Output
Adapter
Data
Channel
Analytics: Continuously Sliding Windows of Streaming Data, Filtering, Correlations,
Calculations, Aggregations, Pattern Matching, Missing Event Detection, Spatial Analysis, etc.
Enrichment: Integrate with data from DB, Coherence, NoSQL, Hadoop etc.
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
Oracle Event Processing
Oracle Event Processing 12c
What’s new?
1
① New development environment
(JDev)
2
② Big Data extensions
3
③ Coherence Integration
enhancements
4
④ Library of patterns to choose from
(ex: missing event rule)
⑤ Easily connects with SOA
infrastructure through EDN
5
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
Event Delivery Network (EDN)
• Easy integration for event driven
patterns
newSupplier
event
OEP
SOA composite
• Provides a declarative way to generate
and consume business events
• Business events are managed by the
event engine
• Publishers and subscribers only need to
know event name, and data format
Subscribe/Publish
EDN
T
T
• Configuration of queues and topics and
any associated filters is hidden
• Delivery details hidden under the covers
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
T
T
T
T
Scalable
JMS
Event Delivery Network (EDN)
• Wizard driven approach to create
typed event definitions
• Browse and choose events for
subscription/publication
• Easy mapping of event types to
topics from EM FMWC
• Support for JMS and AQ
• Leverages durable, reliable and
store/forward features of JMS
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
SOA Event Delivery Network & OEP
Integrate SOA Composite Architecture with OEP Event Processing Networks
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
16
SOA Composite vs. OEP Application
SOA
Request
SOA Composite
Instances
Request
OEP Application
OEP
Event Data
Event Data
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
Demo
Service Request SLA Monitoring
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
18
SOA Composite with Event Delivery Network (EDN)
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
OEP Application Receiving Events From EDN
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
Service Request Status
= ‘OPEN’
Oracle Business Activity
Monitoring
Oracle SOA Infrastructure
Service Request Status
= ‘CLOSED’
Action!
Oracle User
Messaging
Service
SLA Alert!
EDN
CQL
Oracle Event
Processing
Oracle Coherence
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
Was the service request
completed in time?
SOA Composite vs. OEP Application
SOA
Service Request Status
= ‘OPEN’
SOA Composite
Instances
Service Request Status
= ‘CLOSED’
OEP
CLOSED
OEP Application
SLA
Alert!
OPEN
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
23
Demo
Wire Transfer Fraud Check
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
24
SX: Empower Business Users for Real-Time Streaming
Data Analytics
• Fast exploration of Real Time
Streams
• Fast definition & re-use of Real
Time Event Patterns
• Fast Testing and Deployment
of Projects
Streaming Event-Driven Architecture (EDA) , Server Platform
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
Stream Explorer Features for Business Users
• Explorer: The application User Interface
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
26
Stream Explorer Features for Business Users
• Catalog: The repository for browsing resources
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
27
Stream Explorer Features for Business Users
• Exploration: An application that correlates events from streams, data from data
sources, even other Explorations. It uses filters, groupings, summaries, ranges,
and more to Identify, Qualify and Expose a Real Time Business Solution.
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
28
Stream Explorer Features for Business Users
• Pattern: A pre-built Exploration that addresses a particular business scenario in a
focused and simplified User Interface
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
29
Stream Explorer: Empowers Business Users for
Real-Time Streaming Data Analytics and IOT
Proactively identify and act on emerging threats and opportunities in the
Streaming data related to your enterprise
Improve operational efficiencies with actionable insight from real-time
information
Improve signal-to-noise ratio by only processing and storing data that is
relevant
Build real-time applications in half the time and with no complexity
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
Wire Transfer Fraud Demo
•
•
•
Check to see if someone is receiving multiple wire transfers in small amounts within
a few hours to try to avoid detection.
Crosses multiple SOA composite instances.
Simple example to demonstrate the EDN – OEP Stream Explorer integration.
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
31
SOA Composite vs. OEP Application
Wire Transfer 1
$8000
Wire Transfer 2
$9000
WT 1
WT 2
> $50,000 received in 3
hours
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
When to Use OEP?
1
Business Logic Layer for Event-Driven Coherence Applications
2
High-Volume Business Activity Monitoring Applications
3
Real-Time Spatial Applications
4
Fast Data: Real-Time Requirements with Big Data Infrastructure
5
High Volume Batch to Real-Time Conversion Projects
6
Internet of Things (IoT): Processing Data On and From Devices
7
Pattern Matching / Missing Events / Alerting / Fraud Detection
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
33
Oracle Event Processing (OEP)
 High-Volume Low-Latency Event Processing Infrastructure
 Event Processing Network (EPN)
 Light-weight Java Application Server (embeddable)
 Easily Customizable
 Integrate with existing infrastructure and other Oracle Products (e.g. Coherence,
BAM, RTD, Database, Big Data, Data Mining, Spatial, NoSQL Database etc.)
 Time Management & Pattern Matching
 Continuously Perform Calculations Over Time Windows or Number of Events
 Partition Event Streams By Key Values
 Perform Complex Pattern Matching
 Adjust Core Business Logic in Real-time without Redeploying
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
35