EMC ISILON
SCALE-OUT NAS
Focco van Eek
Sr. SE Isilon Specialist
EMC Isilon Storage Division
April 2015
© Copyright 2015 EMC Corporation. All rights reserved.
1
Unstructured Data Growth
80%
74%
67%
2013
2015
2017
37 EB
71 EB
133 EB
Total Capacity Shipped, Worldwide
Unstructured Data
Source: IDC
EMC CONFIDENTIAL—INTERNAL USE ONLY
2
Digital Archiving is Growing Rapidly
Petabytes
350 000
302 995
300 000
250 000
200 000
197 334
Backup Exec
150 000
123 157
100 000
50 000
0
15 034
22 071
33 217
2008
2009
2010
51 992
2011
79 151
2012
2013
2014
2015
Source: ESG: Total Worldwide Digital Archive Capacity, All Content Types, 2008-2015
© Copyright 2015 EMC Corporation. All rights reserved.
3
The Vicious Storage Cycle
Higher
Management
Costs
Rapid
Data
Growth
$$$$$
Exhaust
Available
Capacity
ore Power,
Cooling,
Space
More
Backup
Complexity
& Cost
© Copyright 2014 EMC Corporation. All rights reserved.
Buy
More
Disk
4
Guess what
“There is no question
that data
management and
analysis has become
the new bottleneck in
in big data.”
© Copyright 2015 EMC Corporation. All rights reserved.
5
Strengthen Data Lake Foundation
© Copyright 2014 EMC Corporation. All rights reserved.
6
WHY DO YOU NEED IT
© Copyright 2014 EMC Corporation. All rights reserved.
7
BIG DATA…. ?
© Copyright 2015 EMC Corporation. All rights reserved.
8
The treasure is in the Archive
When does data lose its value?
Who knows?
© Copyright 2015 EMC Corporation. All rights reserved.
9
2ND PLATFORM
3RD PLATFORM
DAS
NAS
Analytics
File Shares
SAN
CLOUD
Mobile
HPC
TAPE
Backup/Archive
© Copyright 2015 EMC Corporation. All rights reserved.
OBJECT
Cloud Apps
10
2ND PLATFORM
3RD PLATFORM
DAS
NAS
Analytics
File Shares
Isilon
Scale-Out
Data Lake
SAN
HPC
TAPE
Backup/Archive
© Copyright 2015 EMC Corporation. All rights reserved.
CLOUD
Mobile
OBJECT
Cloud Apps
11
Next-Gen Multi-Protocol Support
File Shares
FILE
Analytics
FILE
HPC
Mobile
Backup/Archive
Cloud Apps
© Copyright 2015 EMC Corporation. All rights reserved.
12
Unstructured Data Strategy Challenges
DB Dumps
File Shares
Archive
VMware
Log Files
BLOBS
SAN
NAS
OBJECT
TAPE
Remote Office
Cloud/Object
High Performance
Compute
Hadoop
Data Analytics
ANDROID IPHONE
Video
© Copyright 2015 EMC Corporation. All rights reserved.
IPAD
Call Recording
13
You can do it all today with Isilon
DB Dumps
File Shares
Archive
VMware
Log Files
BLOBS
Remote Office
Cloud/Object
High Performance
Compute
Hadoop
Data Analytics
ANDROIDIPHONE IPAD
Video
© Copyright 2015 EMC Corporation. All rights reserved.
Call Recording
14
Isilon OneFS Operating System
Single Volume/
File System
High
Performance
Unmatched
Efficiency
© Copyright 2014 EMC Corporation. All rights reserved.
Simplicity &
Ease of Use
Linear
Scalability
Easy
Growth
15
Isilon Scale-Out Data Lake Advantages
• Eliminate inefficient
islands of storage
• Simplify management
and reduce costs
• Enable better information
sharing
© Copyright 2014 EMC Corporation. All rights reserved.
• Increase data protection and
security
• Accelerate data analytics to
gain new insight
• Support data-driven decision
making
16
Isilon Simplicity and Ease of Use
 Single volume and file system
SINGLE FILE SYSTEM
– Directories and files striped across cluster nodes
© Copyright 2014 EMC Corporation. All rights reserved.
 Automation:
– NO manual intervention
– NO reconfiguration
– NO server or client mount point or
application changes
– NO data migrations
– NO RAID
17
Massively Scalable
More scalable than traditional storage systems
Isilon scales from
16TB to 50PB
in a single file system,
single volume cluster
 Under 60 seconds to
scale with no downtime
© Copyright 2014 EMC Corporation. All rights reserved.
18
Gain New Levels of Efficiency
Isilon AutoBalance
AutoBalance
BALANCED
EMPTY
Automated data balancing across nodes reduces
costs, complexity, and risks for scaling storage
FULL
BALANCED
EMPTY
FULL
BALANCED
EMPTY
FULL
• AutoBalance automatically moves content
to new storage nodes
• Eliminates “hot spots”
• Enables unmatched storage capacity
utilization of more than 80%
BALANCED
EMPTY
FULL
BALANCED
EMPTY
© Copyright 2014 EMC Corporation. All rights reserved.
19
Linear, Predictable Scalability
SPECsfs2008 performance test results
1,800,000
File Ops/second
1,600,000
1,400,000
1,200,000
1,000,000
800,000
600,000
400,000
200,000
7
14
CIFS
© Copyright 2014 EMC Corporation. All rights reserved.
28
56
NFS
140
Predictable SLAs
20
Isilon Platform Portfolio
S-SERIES
X-SERIES
NL-SERIES
HD-SERIES
A-SERIES
High Transactional
Platform
High Throughput
Platform
Nearline Storage
Platform
High Density
Platform
Backup and
Performance
Accelerators
S210
X410
X400
S200
A100 Performance
Accelerator
NL400
HD400
A100 Backup
Accelerator
X200
SSD and SAS
(16 TB – 4.15 PB)*
SSD and SATA
(24 TB –20.7 PB)*
SSD and SATA
(108 TB – 30 PB)*
SSD and SATA
(1 PB – 50 PB)*
Scale performance
without capacity
*Scales from 3 node cluster to 144 node cluster
© Copyright 2014 EMC Corporation. All rights reserved.
21
Isilon Platforms
Current
New Class
S210
S210
A100
High IOPS workloads
X410
Cache Accelerator &
Backup Accelerator
Performance
High Throughput, Dense Storage
X200
NL400
HD400
Entry Level File Shares
Active Archive
Deep Archive
Capacity
© Copyright 2015 EMC Corporation. All rights reserved.
22
Node Types & Applications
Recommended Use Cases
• S210
 Media & entertainment
(streaming, rendering), Hadoop &
analytics
• X410
 File shares & home directories,
next-gen sequencing, Hadoop &
analytics, Syncplicity, Healthcare
(PACS cache, VNA), Seismic
• X200
 File shares & home directories,
media & entertainment (editing)
• NL400
 Archive, backup, PACS long-term
archive, video surveillance
• HD400
 Long-term archive, data
basement
© Copyright 2015 EMC Corporation. All rights reserved.
23
Optimize Resources with Automated Tiering
Isilon SmartPools
•
Single point of management
– Single file system/single volume
– Multiple performance tiers
•
Automatic data movement
– Policy-based tiering management
– Transparent reallocation
– NO application changes
•
S-Series
Performance
Reduced
cost/TB
Optimize storage resources
– Automatically match storage resources
with data requirements
– Eliminate data migration
X-Series
Collaboration
NL-Series
Active archives
© Copyright 2014 EMC Corporation. All rights reserved.
24
Isilon Scale-Out NAS for Big Data
Single file system, single volume simplicity for active, persistent, and archive
data
Virtualized
Servers
• Quota
management
• Thin provisioning
S-Series
• High speed replication
• Disaster recovery
• Business continuance
Backup
Accelerator
Virtualized Servers
X-Series
• WORM data security
• Protection from
deletion/change
WAN/LAN
Network
Clients
NL-Series
• Load balancing
• Seamless failover
• Performance
zones
Client/Application
Layer
• Automated
storage tiering
© Copyright 2015 EMC Corporation. All rights reserved.
NL-series
• Instant recovery
• Data protection
Primary and
Nearline Storage
Local/Remote
Archive
25
Comprehensive Enterprise Software
DATA PROTECTION
DATA MANAGEMENT
SnapshotIQ
SmartPools
SyncIQ
SmartDedupe
SmartConnect
SmartQuotas
SmartLock
InsightIQ
Fast, Efficient Data Backup And Recovery
Fast And Flexible Asynchronous Replication For
Disaster Recovery Protection
Policy-based Client Failover With Load Balancing
Policy-based WORM Data Protection
EMC CONFIDENTIAL—INTERNAL USE ONLY
Policy-based Automated Tiering
Data Deduplication to reduce storage requirements
and costs without impacting performance
Quota Management And Thin Provisioning
Performance Monitoring And Reporting To Manage
Storage Resources
26
Unmatched Data Protection and Availability
Highly resilient, clustered architecture
WithN+1
N+2,protection,
N+3, and
With
N+4 protection,
data is 100%
data is 100% available
available
a
if multiple even
drivesifor
single
nodesdrive
fail
or node fails
100%
100%
FAILED
100%
100%
And with Isilon, the
more nodes in the
cluster, the faster
drive rebuild time
100%
100%
100%
FAILED
© Copyright 2015 EMC Corporation. All rights reserved.
100%
27
Enterprise Data Protection Options
Fast, easy backup and disaster recovery
Disk-to-disk backup
Isilon S-Series and
X-Series Cluster
Isilon NLSeries Cluster
Remote archive and DR
Efficient snapshots with SnapshotIQ
Data replication with SyncIQ
Push-button simple failover/failback
WAN/LAN
EMC CONFIDENTIAL—INTERNAL USE ONLY
28
“Never Refresh Again” Architecture
Meet Your Life Sciences
Big Data Requirements
with EMC Isilon
• One File System, One Volume Storage
Management Simplicity
• Zero Downtime Expansion
• Greater than 80% utilization rates
• Adapt your existing storage resources
• Robust Security Options and Enterprise
Data Protection
• Investment Protection: Pay As You Go
• Eliminate Silos and Hot Spots
© Copyright 2015 EMC Corporation. All rights reserved.
29
Node compatibility in OneFS
• Node compatibility enabled by node class (series)
– S200 & S210
– X400 & X410
• Compatibility Requirements
– Same node class (S2xx-Series or X4xx-Series)
– Requires same drive configuration
• Same number & capacity of SSDs, HDDs or SEDs
– Requires compatible RAM configuration
– Same configuration requirements
• Must be enabled in OneFS
– Created after node is added to cluster
– Can be enabled or disabled at any time
© Copyright 2014 EMC Corporation. All rights reserved.
30
HD400 High Density
Platform

2.5X Increase in cluster capacity to 50 PB

354 TB per node and 3.2 PB per rack

Pre-Racked Configuration Options



© Copyright 2015 EMC Corporation. All rights reserved.
Massive scalability for unstructured data
consolidation and storage
50% lower operational expenses
Ideal for deep archiving, DR & Data Lake
Foundation
31
Isilon Security and Compliance Options
•
Roles-based access control (RBAC)
•
Access Zones for secure isolation
•
WORM Data Protection
•
File System Auditing
•
Data at Rest Encryption (DARE) with SelfEncrypting Drives (SEDs)
© Copyright 2015 EMC Corporation. All rights reserved.
32
NFS Access Zones
7.2
• An access zone is:
– A way to carve the cluster into smaller clusters
– A way to control access based on individual authentication
– Provide Multi-Tenancy and Chargebacks
Domain Controller-1
Kerberos-1
Group Database - 2
Group Database - 1
Kerberos-2
Domain Controller-2
LDAP-1
© Copyright 2015 EMC Corporation. All rights reserved.
NIS - 1
Access
Zone-1
System
Zone
Access
Zone-2
33
HDFS and Access Zones
7.1.1
• HDFS is now integrated with access zones
• Each zone has an HDFS base directory
• Multiple Hadoop deployments, one cluster
• HDFS benefits from access zone features
Customer
Analysis
Zone 1
Blue Sky
Research
Zone 2
Web Analytics
Zone 3
Trend Analysis
Zone 4
© Copyright 2014 EMC Corporation. All rights reserved.
Isilon
34
Support for Multiple Hadoop Distributions
Node
reply
MAP Reduce
NameNode
NFS
MAP Reduce
MAP Reduce
Data
MAP Reduce
MAP Reduce
SMB
SMB
MAP Reduce
name
node
name
node
name
node
NFS
name
node
MAP Reduce
MAP Reduce
data node
SMB, NFS,
HTTP, FTP,
HDFS
MAP Reduce
MAP Reduce
MAP Reduce
HDFS
MAP Reduce
MAP Reduce
MAP Reduce
MAP Reduce
MAP Reduce
MAP Reduce
MAP Reduce
© Copyright 2015 EMC Corporation. All rights reserved.
35
HDFS: Integrated Isilon and vHadoop
Node
reply
NameNode
NFS
Data
SMB
Apache
SMB
name
node
name
node
name
node
NFS
© Copyright 2015 EMC Corporation. All rights reserved.
data node
SMB, NFS,
HTTP, FTP,
HDFS
HDFS
name
node
36
Swift as a Protocol
“EMC’s Isilon is the only Enterprise File Storage
system that can offer File & Object & Hadoop
access to the same data simultaneously”
OneFS
Scale-Out Data
Lake
© Copyright 2015 EMC Corporation. All rights reserved.
•
•
•
Metadata with Hierarchical File system structure
Allows for OneFS Enterprise Features
Multi protocol Access
37
Syncplicity Panorama features
7.2
Next Generation Mobile Access to EMC Isilon/VNX/VNXe/Atmos
• Secure mobile read/write access to EMC file
storage home directories and file shares from
within and outside corporate network
• In-place access: No data migration, No cloud
component
• Augments EMC Isilon Authentication and
Permissions with advance mobile device
policies
• Access via Syncplicity Mobile App – one app, all
content
• Easy set up, with or without Syncplicity
• Available free of charge to Isilon/ VNX/ Atmos
customers
Powered by
© Copyright 2015 EMC Corporation. All rights reserved.
38
Isilon Scale-Out NAS
Simple to manage
 Single file system, single volume, global namespace
Massively scalable
 Scales from 16 TB to over 50 PB in a single cluster
Unmatched efficiency
 Over 80% storage utilization, automated tiering and SmartDedupe
Enterprise data protection
 Efficient backup and disaster recovery, and N+1 thru N+4 redundancy
Robust security and compliance options
 RBAC, Access Zones, WORM data security, File System Auditing
 Data At Rest Encryption with SEDs
Operational flexibility
 Multi-protocol support including NFS, SMB, HTTP, FTP, and HDFS
 Syncplicity support for mobile computing
 Object and Cloud computing including OpenStack Swift
© Copyright 2015 EMC Corporation. All rights reserved.
39