1. technology and computing

EMC Atmos
- Der Weg vom Hochschulrechenzentrum
zum Service Provider für interne und
externe Kunden?
Winfried Machotta
Business Development Manager, EMEA
Cloud Infrastructure Group
[email protected]
+49 172 8666960
© Copyright 2009 EMC Corporation. All rights reserved.
Mittwoch, 10. März 2010
1
Agenda
 EMC Cloud Division
 Cloud Überlegungen
– Warum gibt es den „Cloud Hype“?
– Warum „Cloud Storage“?
 EMC CIG Portfolio
 EMC Atmos
– Policy Management
– Funktions Überblick
– Atmos Hardware
 Kommentare zu EMC Atmos
– Referenzen, Analysten, Partner
 Use Cases
– Applikation Integration
 Atmos onLine
2
Mittwoch, 10. März 2010
What is Cloud Computing?
© Copyright 2009 EMC Corporation. All rights reserved.
Mittwoch, 10. März 2010
What is Cloud Computing?
© Copyright 2009 EMC Corporation. All rights reserved.
Mittwoch, 10. März 2010
What is Cloud Computing?
Cloud - a visible mass of particles of condensed vapor (as water or ice) suspended in
the atmosphere of a planet (as the earth) or moon
Computing - mathematical work done by a machine that takes in software and data as
input and produces data as a result.
Cloud + Computing - A logically centralized computing infrastructure that is accessed
remotely via the World Wide Web (WWW).
© Copyright 2009 EMC Corporation. All rights reserved.
Mittwoch, 10. März 2010
What is Cloud Computing?
Cloud - a visible mass of particles of condensed vapor (as water or ice) suspended in
the atmosphere of a planet (as the earth) or moon
Computing - mathematical work done by a machine that takes in software and data as
input and produces data as a result.
Cloud + Computing - A logically centralized computing infrastructure that is accessed
remotely via the World Wide Web (WWW).
© Copyright 2009 EMC Corporation. All rights reserved.
Mittwoch, 10. März 2010
What is Cloud Computing?
Cloud - a visible mass of particles of condensed vapor (as water or ice) suspended in
the atmosphere of a planet (as the earth) or moon
Computing - mathematical work done by a machine that takes in software and data as
input and produces data as a result.
Cloud + Computing - A logically centralized computing infrastructure that is accessed
remotely via the World Wide Web (WWW).
1. Internet Scale –
People (or their software-based agents) have ubiquitous
access to software-based applications and related data via the Internet.
2. Web Services -
Access is via Web Browsers and/or REST-based web service
APIs
3. Self-Service -
End Users administer their own resources via a self-service portal
and/or REST-based web-service APIs
4. Multi-tenancy -
The underlying infrastructure is shared by many service
providers that deliver software-based services to users who span multiple
organizations across the globe.
5. Federation -
This infrastructure is contributed by one or more organizations;
both Enterprise and 3rd party.
© Copyright 2009 EMC Corporation. All rights reserved.
Mittwoch, 10. März 2010
What’s Generating Cloud Computing Buzz?
“11 Million Articles Created in 24 hours”
 Easy
 Quick
 Cost effective
 Developer “brain candy”
 Value add service
© Copyright 2009 EMC Corporation. All rights reserved.
Mittwoch, 10. März 2010
4
EMC’s Cloud Division
 Cloud Infrastructure Group
– Address service providers and the
enterprise—“Business Cloud”
– Deliver purpose-built cloud infrastructure
products and solutions
– Target service providers building external clouds
– Target enterprises building internal clouds
 Decho (“digital echo”)
– “Consumer cloud”
– Deliver Mozy online backup—The leader
for consumers and business
– Preserve, manage and enrich
personal information
© Copyright 2009 EMC Corporation. All rights reserved.
Mittwoch, 10. März 2010
5
Looking at the IT Landscape Differently
How Can My Business Benefit From Cloud?
© Copyright 2009 EMC Corporation. All rights reserved.
Mittwoch, 10. März 2010
6
Looking at the IT Landscape Differently
How Can My Business Benefit From Cloud?
“6 weeks to provision a resource”
“70% of budget for status quo”
“30% utilization”
“DC’s location restrictions”
© Copyright 2009 EMC Corporation. All rights reserved.
Mittwoch, 10. März 2010
6
Looking at the IT Landscape Differently
How Can My Business Benefit From Cloud?
“6 weeks to provision a resource”
“I instantly provision”
“70% of budget for status quo”
“I only pay for what I use”
“30% utilization”
“I don’t care about utilization”
“DC’s location restrictions”
“I’m global”
© Copyright 2009 EMC Corporation. All rights reserved.
Mittwoch, 10. März 2010
6
Looking at the IT Landscape Differently
How Can My Business Benefit From Cloud?
“6 weeks to provision a resource”
“I instantly provision”
“70% of budget for status quo”
“I only pay for what I use”
“30% utilization”
“I don’t care about utilization”
“DC’s location restrictions”
“I’m global”
Cloud Infrastructure Group
Delivering HYBRID cloud architectures to benefit the Enterprise
© Copyright 2009 EMC Corporation. All rights reserved.
Mittwoch, 10. März 2010
6
Cloud is interesting…
 2007: Zero interest
 2010: In 2+ years, interest in Cloud Computing is up over 3000%
 Cloud is an opportunity for a new conversation with IT
Source: www.elasticvapor.com, www.google.com/insights/search
EMC CONFIDENTIAL—INTERNAL USE ONLY
Mittwoch, 10. März 2010
7
…and its real
EMC CONFIDENTIAL—INTERNAL USE ONLY
Mittwoch, 10. März 2010
8
The NIST* definition of cloud deployment
models serves as the foundation for EMC’s
strategy
Private Cloud
Community Cloud
Hybrid Cloud
Public Cloud
Cloud infrastructure is
operated solely for an
organization
Cloud infrastructure is
shared by several
organizations and supports
a specific community that
has shared concerns
Cloud infrastructure is a
composition of two or more
clouds (private, community or
public)
Cloud infrastructure is made
available to the general public
or a large group
Primary IT
Ownership
IT managed by professional internal staff with back-end vendor
support (primarily Enterprise segment) or by a third party
Any combination of internal
management and external cloud
services vendor
Owned by an organization selling
cloud services (e.g. Telco, ISV, SI,
Hosting Provider or OEM)
Cloud
Location
May exist on or off customer premise
Both on and off premise
Exists off premise
NIST
Definition
Consumer
of IT
Services
Internal customers of the IT
organization: Finance, HR, etc.
Internal customers of the
community
Both the internal customers of
the organization as well as the
IT organization itself
Companies across all segments
(SOHO, SMB, Mid-Market and
some Enterprise)
Examples
NASA Nebula Cloud
Google Cloud for US
Government (planned for
2010)
GeoEye (satellite and aerial
imagery company)
Amazon EC2
EMC CONFIDENTIAL—INTERNAL USE ONLY
Mittwoch, 10. März 2010
Source: *National Institute of Standards and Technology, V15 Oct 2009; The Cloud –
The New Paradigm in Enterprise Computing, Lazard Capital Markets, Nov 2009
9
Overview of Cloud Computing
Applications
SaaS
Infrastructure
Platforms
IaaS
PaaS
EMC CONFIDENTIAL—INTERNAL USE ONLY
Mittwoch, 10. März 2010
10
EMC Cloud Offering
 One size does not fit all –
Cloud technology addresses many business needs
 Cloud is vast –
touches companies of all sizes and across multiple industries
 Through its unique approach to cloud, EMC provides
complementary solutions
Private Cloud,
Global Services
Structure
(Commercial, Enterprise)
VCE
Vblock
Acadia
Atmos
Atmos Online
Cloud Object Store, Cloud Infrastructure Services
(Start up – Enterprise)
Decho
Consumer Cloud, Cloud Information Services
(Consumer/SMB focus)
EMC CONFIDENTIAL—INTERNAL USE ONLY
Mittwoch, 10. März 2010
11
CIG Offerings
© Copyright 2009 EMC Corporation. All rights reserved.
Mittwoch, 10. März 2010
11
CIG Offerings
EMC Atmos
Cloud Storage Infrastructure
•
•
© Copyright 2009 EMC Corporation. All rights reserved.
Mittwoch, 10. März 2010
Software and hardware
Internal cloud
11
CIG Offerings
Cloud Storage Infrastructure
EMC Atmos
•
•
EMC Atmos onLine
© Copyright 2009 EMC Corporation. All rights reserved.
Mittwoch, 10. März 2010
Software and hardware
Internal cloud
On-demand External Cloud Storage
•
•
Internet-based service
Federated cloud
11
CIG Offerings
Cloud Storage Infrastructure
EMC Atmos
•
•
EMC Atmos onLine
Software and hardware
Internal cloud
On-demand External Cloud Storage
•
•
Internet-based service
Federated cloud
EMC Atmos
onLine
EMC Atmos
External
Cloud
Internal Cloud
© Copyright 2009 EMC Corporation. All rights reserved.
Mittwoch, 10. März 2010
11
CIG Offerings
Cloud Storage Infrastructure
EMC Atmos
•
•
EMC Atmos onLine
© Copyright 2009 EMC Corporation. All rights reserved.
Mittwoch, 10. März 2010
Software and hardware
Internal cloud
On-demand External Cloud Storage
•
•
Internet-based service
Federated cloud
11
CIG Offerings
Cloud Storage Infrastructure
EMC Atmos
•
•
EMC Atmos onLine
EMC Storage Utility
for Service Providers
© Copyright 2009 EMC Corporation. All rights reserved.
Mittwoch, 10. März 2010
Software and hardware
Internal cloud
On-demand External Cloud Storage
•
•
Internet-based service
Federated cloud
Turnkey Cloud Storage Infrastructure
•
•
Software, billing, metering, IDM
Physical infrastructure
11
CIG Offerings
Cloud Storage Infrastructure
EMC Atmos
•
Software and hardware
Internal cloud
•
EMC Atmos onLine
EMC Storage Utility
for Service Providers
On-demand External Cloud Storage
•
•
Internet-based service
Federated cloud
Turnkey Cloud Storage Infrastructure
•
•
EMC Managed Storage
Utility for Service Providers
© Copyright 2009 EMC Corporation. All rights reserved.
Mittwoch, 10. März 2010
Software, billing, metering, IDM
Physical infrastructure
Your Cloud Storage Service
•
Run by EMC
11
CIG Offerings
Cloud Storage Infrastructure
EMC Atmos
•
•
EMC Atmos onLine
Software and hardware
Internal cloud
On-demand External Cloud Storage
•
•
Internet-based service
Federated cloud
Tomorrow:
 Federation Between Cloud Products and Services
– Seamless integration of internal and public clouds
 Expand Federation
– Integration between other clouds
 Leverage Economics
– Embrace and create a “market economy”
 VMware vCloud Collaboration
© Copyright 2009 EMC Corporation. All rights reserved.
Mittwoch, 10. März 2010
11
Extending Your IT Infrastructure
Internal
Atmos Cloud
© Copyright 2009 EMC Corporation. All rights reserved.
Mittwoch, 10. März 2010
13
Extending Your IT Infrastructure
• Content from multiple sources
• Available to multiple consumers
Internal
Atmos Cloud
© Copyright 2009 EMC Corporation. All rights reserved.
Mittwoch, 10. März 2010
13
Extending Your IT Infrastructure
• Content from multiple sources
• Available to multiple consumers
Internal
Atmos Cloud
• Internet scale
• Easily managed
• Single infrastructure
© Copyright 2009 EMC Corporation. All rights reserved.
Mittwoch, 10. März 2010
13
Extending Your IT Infrastructure
• Content from multiple sources
• Available to multiple consumers
Internal
Atmos Cloud
Seamless Federation to
on-demand resources
External
Atmos onLine Cloud
• Internet scale
• Easily managed
• Single infrastructure
© Copyright 2009 EMC Corporation. All rights reserved.
Mittwoch, 10. März 2010
13
Extending Your IT Infrastructure
• Content from multiple sources
• Available to multiple consumers
Internal
Atmos Cloud
Seamless Federation to
on-demand resources
External
Atmos onLine Cloud
• Internet scale
• Easily managed
• Single infrastructure
© Copyright 2009 EMC Corporation. All rights reserved.
Mittwoch, 10. März 2010
13
Extending Your IT Infrastructure
• Content from multiple sources
• Available to multiple consumers
Internal
Atmos Cloud
External
Atmos onLine Cloud
• Internet scale
• Easily managed
• Single infrastructure
© Copyright 2009 EMC Corporation. All rights reserved.
Mittwoch, 10. März 2010
Seamless Federation to
on-demand resources
• No-hardware to own
• Pay-as-you-use
• Self service
13
Extending Your IT Infrastructure
Internal
Atmos Cloud
© Copyright 2009 EMC Corporation. All rights reserved.
Mittwoch, 10. März 2010
External
Atmos onLine Cloud
13
Extending Your IT Infrastructure
Single Entity
Internal
Atmos Cloud
© Copyright 2009 EMC Corporation. All rights reserved.
Mittwoch, 10. März 2010
External
Atmos onLine Cloud
13
Extending Your IT Infrastructure
Single Entity
Private
Cloud
Internal
Atmos Cloud
© Copyright 2009 EMC Corporation. All rights reserved.
Mittwoch, 10. März 2010
External
Atmos onLine Cloud
13
Atmos Technologies – built with Cloud in mind
Cloud Attributes and Capabilities
Architecture
Public Cloud
Enterprise Cloud
Modern Enterprise
Architecture
Adapted from the451Group: The Cloud Codex
Mittwoch, 10. März 2010
14
Atmos Technologies – built with Cloud in mind
Cloud Attributes and Capabilities
• Federation
• Elasticity
• Web Services and Programmatic Interfaces
Architecture
Public Cloud
• Self-Service
• Rich Web Management
Enterprise Cloud
• Multi-tenancy
• Granular Metering
• Rapid Provisioning
• Scalability
• Virtualization
Modern Enterprise
Architecture
Adapted from the451Group: The Cloud Codex
Mittwoch, 10. März 2010
14
Full Turn-Key Service Enablement Stack
ISV and Developer
Partners
Service Provider
Partners
EMC Installation,
Management
and Monitoring
Technology
Partners
EMC Atmos
Storage Service
EMC Atmos
Compute Service
EMC Cloud
Delivery Platform
EMC Service
Networking Kit
15
Mittwoch, 10. März 2010
The Secret Sauce: EMC Atmos Software
Increasing Operational Efficiency
 Massively scalable infrastructure
– Multiple petabytes; billions of objects
– Hundreds of sites, fully distributed
– Unified namespace
 Policy-based management
– Policy tells content where to go, what
actions to take
– Integrated object based metadata
– Event driven policy evaluation
 Data services and access methods
– Replication, compression, de-duplication,
spin-down, Erasure Coding
– Web services (REST/SOAP) and file
system access
 Management at scale
– Auto-config and auto-healing architecture
– Multi-tenancy
– Manage more with fewer people
© Copyright 2009 EMC Corporation. All rights reserved.
Mittwoch, 10. März 2010
16
Multiple User Tiers with Atmos
Reducing Complexity With Value Added Services
Free
• 500GB
• compressed
• SpinDown
• De-Duplication
• No Backup (?)
© Copyright 2009 EMC Corporation. All rights reserved.
Mittwoch, 10. März 2010
„Premium“
• Unlimitted Capacity
• 1 Synch Copy
„Platinum“
• Unlimitted Capacity
• 1x Synch Copy Local
• 1x ASynch Copy Remote
• Archive (Retention,
Expiration)
13
Policy-Based Information Management
Free
Object metadata matches policies
• Policies map to business objectives
• Set it and forget it
Policies drive actions
• Where to store information
• What services to apply
• How many copies
• Actions determined based on object
metadata
© Copyright 2009 EMC Corporation. All rights reserved.
Mittwoch, 10. März 2010
Premium
CustType = Free
CustType = Premium
ContentType = Hot Movie
Hot Movie
:Bronze
:Gold
:Platinum
Bronze:
Compressed, Spin down, 1 copy
New Jersey
Gold:
2 synchronous copies
New York
Boston
2 asynchronous copies
Los Angeles
London
Platinum: 4 copies all locations
15
Policy-based Information Management
Increasing Operational Efficiency
Digital Image Policy
Application
API
File
2 Sync replicas in Miami
1 Async replica in Seattle
© Copyright 2009 EMC Corporation. All rights reserved.
Mittwoch, 10. März 2010
19
Policy-based Information Management
Increasing Operational Efficiency
Each tenant has policies
“Tasks match business rules”
Policies drive constraints
“What operations to perform”
Constraints dictate locations
“Where and when”
Policy triggered by events
“Set it and forget it!”
© Copyright 2009 EMC Corporation. All rights reserved.
Mittwoch, 10. März 2010
20
Policy-based Information Management
Increasing Operational Efficiency
Each tenant has policies
“Tasks match business rules”
Policies drive constraints
“What operations to perform”
Constraints dictate locations
“Where and when”
Policy triggered by events
“Set it and forget it!”
© Copyright 2009 EMC Corporation. All rights reserved.
Mittwoch, 10. März 2010
20
Policy-based Information Management
Increasing Operational Efficiency
Synchronous,
Asynchronous
Each tenant has policies
Replica
Location
“Tasks match business rules”
Policies drive constraints
“What operations to perform”
Constraints dictate locations
“Where and when”
Policy triggered by events
Green,
Optimal,
Fast
© Copyright 2009 EMC Corporation. All rights reserved.
Mittwoch, 10. März 2010
“Set it and forget it!”
Compression,
De-duplication,
20
EMC Atmos Features
Scalability
Policy-based Control
• 100s of TB to PB
• Multiple datacenters
spanning the world
• Global unified namespace
• Multi-tenancy support
• User defined policies
• User defined metadata
• Metadata controlled
policies
• Asynchronous and
Synchronous replication
Accessibility
Security
• REST/SOAP API
• Linux Installable File
System (IFS)
• NFS
• CIFS via Samba
• Client/admin authentication/
authorization
• SSL support
• Data path, user integration
for AD
• Admin auditing
© Copyright 2009 EMC Corporation. All rights reserved.
Mittwoch, 10. März 2010
Operational
Efficiency
• Web based management
• Role management
• Scriptable interface
Self Management
• Balancing content across
nodes
• HA metadata
• Background consistency
checking
• Policy evaluation
• Compression
• Deduplication
• Spin-down
21
Reference Architecture
SOAP/REST
DNS Load
Balancer
CIFS/NFS/IFS
Access Points
Access Points
TCP/IP
Location 1
“Boston”
EMC CONFIDENTIAL—INTERNAL USE ONLY
Mittwoch, 10. März 2010
TCP/IP
Location 2
“London”
Location 3
“Tokyo”
22
Hardware Design Philosophy
 Industry standard components
 Standard data center environments
 Factory configured, racked and cabled
 Flexible, cost effective service model
 Optional HA and redundancy
 User serviceable
 30 drives per 3U drawer
 Up to 360 TB per rack
 120TB, 240TB or 360TB configurations
© Copyright 2009 EMC Corporation. All rights reserved.
Mittwoch, 10. März 2010
23
One Infrastructure, Many Uses
© Copyright 2009 EMC Corporation. All rights reserved.
Mittwoch, 10. März 2010
24
One Infrastructure, Many Uses
Web
Applications
© Copyright 2009 EMC Corporation. All rights reserved.
Mittwoch, 10. März 2010
“Cloud
Drive”
Backup
Target
24
One Infrastructure, Many Uses
Web
Applications
“Cloud
Drive”
Backup
Target
Archive/
Retention
Content
Distribution
Infrastructure
as-a-Service
© Copyright 2009 EMC Corporation. All rights reserved.
Mittwoch, 10. März 2010
24
What Analysts are Saying…
“The Atmos announcement provides EMC with
what I consider the next generation of storage
systems.”
“Organizations that leverage this architecture with a
highly flexible and granular policy engine will gain
a significant competitive advantage.”
… “[Management software] is the elusive piece; that's
what we've been waiting for. EMC has built a
whole new category around bulk storage"
"It's for providing large amounts of storage for low cost
with basic redundancy. These don't have to be the
fastest systems. It's about good speed, large
capacity, management and low cost.”
- Ben Woo, Vice President, IDC, Network World
Greg Schulz, StorageIO Group, SearchStorage
“[EMC] Atmos a "game changer" for service providers
that want to provide storage services.”
"EMC is bringing a sophisticated policy engine to the table to
provide data storage optimization and hosted file storage in
the cloud.”
Atmos has the potential to reinvent the way we look at
storage -- how we store, interact, and use file data. I think it
will have a rippling effect on the industry over the years.”
Jeff Boles, Taneja Group,Byte and Switch
© Copyright 2009 EMC Corporation. All rights reserved.
Mittwoch, 10. März 2010
25
What Customers are Saying…
“Working with EMC, AT&T can provide our customers with a
flexible and cost-effective solution for storing, delivering and
retrieving data that helps them meet their changing business
needs”
Roman Pacewicz,
Senior VP of Strategy and Application Services
AT&T Business Solutions
“eBay and EMC have worked closely for more than a year to create
a reliable, scalable cloud storage infrastructure that meets the
demands of eBay’s expanding business”
Mazen Rawashdeh,
VP Technology Operations
eBay Inc.
© Copyright 2009 EMC Corporation. All rights reserved.
Mittwoch, 10. März 2010
26
What Customers are Saying…
© Copyright 2009 EMC Corporation. All rights reserved.
Mittwoch, 10. März 2010
27
Mittwoch, 10. März 2010