How to reduce costs & manage more data with open source software

How to reduce costs &
manage more data with open
source software
Greg Kleiman
Director, Big Data
Jan. 22, 2014
1
RED HAT | Greg Kleiman
How to reduce costs & manage more data?
2
●
Why big data?
●
Why open source software?
●
Why Red Hat?
RED HAT | Greg Kleiman
How to reduce costs & manage more data?
●
3
Why big data?
●
Data overwhelming
●
Infrastructure breaking
●
Multiple stakeholders
●
Why open source software?
●
Why Red Hat?
RED HAT | Greg Kleiman
How to reduce costs & manage more data?
●
Why big data?
●
Data overwhelming
●
Infrastructure breaking
●
Multiple stakeholders
●
Why open source software?
●
Why Red Hat?
The "digital universe" will
grow to 2.7ZB in 2012, up
48% from 2011 and
rocketing toward nearly
8ZB by 2015.
Information overload and the high cost of finding the right
information are significant issues for many organizations and
present an opportunity that can be addressed with Big Data
technology.
IDC 2012 Market Analysis: Worldwide Big Data Technology and Services 2012–2015
Forecast
4
RED HAT | Greg Kleiman
How to reduce costs & manage more data?
●
Why big data?
●
Data overwhelming
●
Infrastructure breaking
●
Multiple stakeholders
●
Why open source software?
●
Why Red Hat?
CTO of CIA;
‘the challenge is to
make 6,998,329,787
(world population)
a small number”
Google >100PB; Facebook >100PB; YouTube >750PB
All use commodity hardware & open source software
5
RED HAT | Greg Kleiman
6
RED HAT | Greg Kleiman
How to reduce costs & manage more data?
●
7
Why big data?
●
Data overwhelming
●
Infrastructure breaking
●
Multiple stakeholders
●
●
Why open source software?
●
Why Red Hat?
Business analyst,
Data scientist
●
Developer
●
Data architect
●
Operations
RED HAT | Greg Kleiman
How to reduce costs & manage more data?
●
●
8
Why big data?
●
Data overwhelming
●
Infrastructure breaking
●
Multiple stakeholders
Why open source software?
●
Cost effective
●
Flexible
●
Community innovation
RED HAT | Greg Kleiman
How to reduce costs & manage more data?
●
●
Why big data?
●
Data overwhelming
●
Infrastructure breaking
●
Multiple stakeholders
Why open source software?
●
Cost effective
●
Flexible
●
Community innovation
●
●
●
9
Free software on
commodity hardware
Can modify source
code
Open interfaces to
inter-operate
RED HAT | Greg Kleiman
B ig D a t a @
Red H at
10
RED HAT | Greg Kleiman
How to reduce costs & manage more data?
●
●
11
Why big data?
●
Data overwhelming
●
Infrastructure breaking
●
Multiple stakeholders
Why open source software?
●
Cost effective
●
Flexible
●
Community innovation
RED HAT | Greg Kleiman
Turn Data into Actionable Information
Store, Process and Integrate Data Volume, Velocity, Variety
BI Analytics
(historical, operational, predictive)
SOA Composite Applications
JBoss Data Virtualization
JBoss Data Grid
JBoss Messaging &
Event Processing
Structured Data
Streaming
Data
Hadoop
Semi-Structured Data
Red Hat Enterprise Linux
Red Hat Storage
12
RED HAT | Greg Kleiman
How to reduce costs & manage more data?
●
●
13
Why big data?
●
Data overwhelming
●
Infrastructure breaking
●
Multiple stakeholders
Why open source software?
●
Cost effective
●
Flexible
●
Community innovation
RED HAT | Greg Kleiman
Upstream Community Innovation
E-mail: [email protected] (#gluster)
E-mail: [email protected]
(#fedora-bigdata)
E-mail: [email protected]
(#savanna)
14
RED HAT CONFIDENTIAL
How to reduce costs & manage more data?
●
●
●
15
Why big data?
●
Data overwhelming
●
Infrastructure breaking
●
Multiple stakeholders
Why open source software?
●
Cost effective
●
Flexible
●
Community innovation
Why Red Hat?
●
100% open source software
●
Big data ready
●
Enterprise hardened
RED HAT | Greg Kleiman
How to reduce costs & manage more data?
●
●
●
16
Why big data?
●
Data overwhelming
●
Infrastructure breaking
●
Multiple stakeholders
●
Why open source software?
●
Cost effective
●
Flexible
●
Community innovation
Why Red Hat?
●
●
●
100% open source software
●
Big data ready
●
Enterprise hardened
#1 worldwide open
source software
($1B) company
Comprehensive
portfolio of products
and services; always
upstream first
Deliver cost
effective, innovative
enterprise IT
solutions
RED HAT | Greg Kleiman
How to reduce costs & manage more data?
●
●
Why big data?
●
Data overwhelming
●
Infrastructure breaking
●
Multiple stakeholders
17
●
Flexible
●
Community innovation
●
●
●
100% open source software
●
Big data ready
●
Enterprise hardened
JBoss, OpenJDK
Data architect
●
Why Red Hat?
JBoss
Developer
●
Cost effective
●
Business analyst, Data
scientist
●
Why open source software?
●
●
●
Red Hat Storage
Operations
●
RED HAT | Greg Kleiman
Red Hat Enterprise
Linux OpenStack
Platform
How to reduce costs & manage more data?
●
●
●
18
Why big data?
●
Data overwhelming
●
Infrastructure breaking
●
Multiple stakeholders
Why open source software?
●
Cost effective
●
Flexible
●
Community innovation
●
●
Why Red Hat?
●
100% open source software
●
Big data ready
●
Enterprise hardened
RED HAT | Greg Kleiman
20+ years of global
enterprise support
Engineer, test,
package, maintain,
and support
enterprise quality
software
How to reduce costs & manage more data?
●
●
●
19
Why big data?
●
Data overwhelming
●
Infrastructure breaking
●
Multiple stakeholders
Why open source software?
●
Cost effective
●
Flexible
●
Community innovation
Why Red Hat?
●
100% open source software
●
Big data ready
●
Enterprise hardened
RED HAT | Greg Kleiman