Aurélie Pericchi
SSP APS
Laurent Marzouk
Data Insight & Cloud Architect
2005
Concert de Coldplay
2014
Concert de Coldplay
90%
of the world’s
data has been
created over the
last two
years alone1
1. Source IDC
Big Data is
changing how
business gets
done…
smart
machines
crowdsourcing
and data
anticipating
what’s next
customers
with richer
experiences
intelligent
operations
“Digital business is the
creation of new business
designs by blurring the
digital and physical worlds.”
Source: Putting Digital Business to Work in 2015. Gartner.
5
Why leadings companies use Big Data and analytics ?
Cost reductions
Time reductions
New product
development and
optimized offerings
Smarter business
decision making
42% of businesses are developing new products and
business models using big data
6
Leading enterprises are reimagining their business
with Big Data
Identifying and
retaining top
talent
PageUp People
Automating
manufacturing
operations
KUKA Systems
Group
Transforming
healthcare
Ascribe
Targeting
customers better
Creating engaging
customer
experiences
Kimberly Clark
City of Barcelona
Creating
business value
with Big Data
Redesigning
operational
processes
Reimagining
the customer
journey
Challenging
business
models
Endless
possibilities
for your
business
IT infrastructure
optimization
Churn
analysis
Fraud
detection
Life sciences
research
Legal
discovery
Social network
analysis
Traffic flow
optimization
Natural resource
exploration
Weather
forecasting
Healthcare
outcomes
Advertising
analysis
Equipment
monitoring
Web app
optimization
Smart meter
monitoring
Big data is everywhere. Be first and move fast in your industry.
9
How can Microsoft help you make
smarter, faster, data-driven decisions?
Discover and manage
The power to discover, explore, and combine any type or size
of data from anywhere
Visualize and analyze
Easy, familiar ways to analyze, visualize, predict and ask
questions of your data
Share and decide
The speed to share across the enterprise and access data
anywhere, on any device
10
How can Microsoft help you make
smarter, faster, data-driven decisions?
Harness big data
across the business with a modern data warehouse and cloud-based
analytics solutions
Empower business leaders
with powerful self-service business analytics
Build mission critical database solutions
with a trusted platform and cloud-based testing infrastructure
Unleash the full potential of the Internet of Things
with intelligent systems
11
Empowering
the digital business
Trusted
platform
Modern
productivity
Connected
things
Integrated
data
Advanced
analytics
“”
12
Reimagining the enterprise with Microsoft
Empowering
people
Connecting
digital platforms
…to be more responsive, agile, and
customer-obsessed in the digital age.
…and protecting assets in a
mobile-first, cloud-first world.
Global excellence in hybrid cloud services…
…culture of reliability, security and privacy…
…comprehensive, cross-platform and connected solutions…
…familiar and fluid experiences…
…spanning consumer and business
13
14
Breaking points of traditional approach
Hardware and software engineered together
The ease of an appliance
Analytics Platform System
SQL Server
Parallel Data
Warehouse
Pre-built hardware + software appliance
•
Co-engineered with Dell, HP, and Quanta
•
Pre-built hardware
•
Pre-installed software
Plug and play
Built-in best
practices
Time savings
Built for Big
Data
PolyBase
Microsoft
HDInsight
(Hadoop)
Microsoft Analytics Platform System
The turnkey modern data warehouse appliance
APS delivers enterprise-ready Hadoop with HDInsight
Manageable, secured, and highly available Hadoop integrated into the appliance
SQL Server
Parallel Data
Warehouse
High performance
and tuned within the
appliance
End-user
authentication with
Active Directory
At rest data encryption of
data pages on disk,
transactional logs, and
database backups
100-percent Apache
Hadoop
Managed and
monitored using
System Center
Accessible insights
for everyone with
Microsoft BI tools
PolyBase
Microsoft
HDInsight
Connecting islands of data with PolyBase
Bringing Hadoop point solutions and the data warehouse together for users and IT
Select…
Microsoft Azure
HDInsight
Hortonworks for
Windows and Linux
Cloudera
Result set
SQL Server
Parallel Data
Warehouse
Provides a single T-SQL query model for PDW
and Hadoop with rich features of T-SQL,
including joins without ETL
Uses the power of MPP to enhance query
execution performance
PolyBase
Supports Windows Azure HDInsight to enable
new hybrid cloud scenarios
Microsoft
HDInsight
Provides the ability to query non-Microsoft
Hadoop distributions, such as Hortonworks and
Cloudera
Enhanced compatibility and ease of use with PolyBase
Improve APS operations by extending PolyBase
HDFS file formats
Textfile and
RCFile support
Security and
permission model
External table
source and file
format syntax
•
Microsoft Azure HDInsight
•
HDInsight on APS
•
Hortonworks Data Platform
1.3 and 2.0 (Linux/Windows
Server)
•
Cloudera Linux 4.3
Microsoft
Azure
Storage
Blobs
PolyBase
Analytics Platform
System
(powered by PolyBase)
Big Data insights for anyone
New insights with familiar tools through native Microsoft BI integration
Takes advantage
of high adoption
of Excel, Power
View, PowerPivot,
and SQL Server
Analysis Services
Minimizes IT
intervention for
discovering data
with tools such as
Microsoft Excel
Offers Hadoop
tools like
MapReduce,
Hive, and Pig for
data scientists
Enables DBA and
power users to
join relational and
Hadoop data with
T-SQL
Everyone else using
Microsoft BI tools
Power users
Data scientist
Microsoft Analytics Platform System
The turnkey modern data warehouse appliance
Scale-out technologies in the Analytics Platform System
Scale out
PDW /
HDInsight
Multiple nodes with dedicated CPU,
memory, and storage
PDW /
HDInsight
PDW /
HDInsight
PDW /
HDInsight
PDW /
HDInsight
Ability to handle query complexity and
concurrency at scale
PDW /
HDInsight
No “forklift” of prior warehouse to
increase capacity
PDW
0 terabytes
Ability to incrementally add hardware
for near-linear scale to multiple
petabytes
6 petabytes
Ability to scale out HDInsight and PDW
25
Columnstore index representation
100x
Up to
faster queries
15x
Up to
more compression
Updateable clustered columnstore vs. table with customary indexing
Parallel query execution
Query
•
•
Results
•
Store data in columnar format for massive
compression
Load data into or out of memory for nextgeneration performance with up to 60%
improvement in data loading speed
Updateable and clustered for real-time trickle
loading
26
Concurrency that fuels rapid adoption
Great performance with mixed workloads
ETL/ELT with SSIS, DQS, MDS
ERP
CRM
LOB
Analytics Platform System
Intra-Day
CRTAS
APPS
ETL/ELT with DWLoader
SQL Server SMP
Link Table
Near real-time
PDW
Real-Time
Reporting and cubes
Columnstore
ROLAP / MOLAP
DirectQuery
Hadoop / Big Data
Ad hoc queries
Polybase
PolyBase
Fast ad hoc
HDInsight
(Hadoop)
SNAC
BI Tools
Microsoft Analytics Platform System
The turnkey modern data warehouse appliance
Hardware and software engineered together
The ease of an appliance
PDW
PolyBase
HDInsight
Integrated
support plan with
a single Microsoft
contact
Co-engineered
with HP, Dell, and
Quanta best
practices
Pre-configured,
built, and tuned
software and
hardware
Leading
performance with
commodity
hardware
Compelling Events For APS
Analytics
Platform
System
APS = Speed and Scale
Right-time
analytics
Mixed
workloads /
high
concurrency
Significant
data growth
Daily
information
available too
late
Analyzing new
data types and
sources = Big
Data
Poor query or
report
performance
Current DWH
is burden on
infrastructure
Current
environment
too expensive
HP ConvergedSystem 300
for Microsoft Analytics Platform
Top 10 features and benefits of APS
Analytics
Platform
System
1
Great Price /
Performance
with low TCO
2
Reduce risk
through
appliances and
existing
skillsets
Appliance
5
simplicity and
ease of
administration
for DBA and
Sys admin
Big Data ready
through
Hadoop
integration
9
10
Linear
scalability with
true MPP
architecture
6
Tier 1 Data
Warehouse
Appliance
Offering
3
4
Distributed
Data
Warehouse
Architecture
Flexibility
7
Complete
solution
through
integration with
MS BI
8
Blazing fast
performance
with shared
nothing
architecture
Reimagining the enterprise with Microsoft
Next steps
Get connected
• Industry, business & IT perspectives
• Events & webcasts
www.microsoft.com/aps
 Please visit us at our stand today to
ask questions and see demos
 Envisionning workshop