Scratching the surface And now you have… Datameer RapidMiner Windows Azure Marketplace by Prateek Burman Datameer • • • • Integrate, Analyze, Visualize • Targeted at Hadoop users • Around since 2009 Scalable Secured access Excel like interface Integration • • • • Oracle, DB2, MS SQL, MySQL Teradata, Greenplum XML, JSON, CSV Hbase, Cassandra Datameer cont’d. • • • • Twitter, Facebook, LinkedIn Email Log files SaaS – CRM, GitHub, JIRA Analytics • • • • • • Time series analysis Clustering Decision trees Built-in Recommendation engine Column Dependencies Predictive analysis with R, PMML Datameer cont’d. Visualization • Graphs • Shapes • Maps • Tables • Dashboard • HTML5 • Visualization apps from apps market RapidMiner – Yet Another Learning Environment (YALE) • • • • • Around since 2001 Open source - Older versions Client/Server model w/ Server as SaaS Most popular for data analytics GUI based – no need to write code • • • • • Predictive analysis Text mining Sentiment analysis Direct Marketing Predictive Maintenance RapidMiner cont’d… • • • • • LabView type layout No coding – min. likelihood of error One operator's output is another operator’s input Only structured datasets 3D graphics & Interactive dashboards Windows Azure Marketplace • • • • • • Launched in 2010 Hundreds of apps Thousands of subscriptions Trillions of data point Scalable – load balance No need to move data Data • • • • • • • GitHub/svn of data Point of discoverability Clean - Ready to use data An economic model for broad access OData standard Excel, SQL server, Office, Deliver using RESTful web-service access • • • • • • Marketplaces Infochimps Factual Datamarket Gnip Datasift Kasabi R RapidMiner • Cutting edge Algorithms • Learning curve • Need to import data • Slow Datameer • • • • • • • • • Intuitive • Can execute R scripts • Can be extended using Java or Ruby scripts • Pretty graphics Azure Marketplace • Need to import data Point & click • Known tools like • Cron scheduler Excel like interface Excel Extensible to R, Python • Data readily etc. available Need to import data • Cleaner data Supports many Hadoop • Other Windows Distributions services Optimized for Hadoop Business Infograpics & Dashboards HTML5 – view anywhere • Q&A