KNIME Big Data Extension Leveraging your Hadoop Infrastructure With the KNIME Big Data Extension, access to your data is now even easier. As part of the commercial KNIME.com AG offerings, the extension provides a set of nodes for accessing Hadoop/HDFS via Hive from inside KNIME Analytics Platform. It brings with it all required libraries — after installing the extension from KNIME’s update website no additional steps are needed. The Big Data Extension is certified by Cloudera for CDH 5.0.x and has also been tested against Hadoop 2.4.0 and Hive 0.13. The Big Data Extension can be easily installed via the KNIME Update Manager. Analyze & Data Mining Data Access Big Data Deployment Database Reader PMML Writer Decision Tree Learner Access Oracle DB Loading & Preprocessing on Hadoop Database Table Selector XLS Reader Merge Data Auto-Binner Decision Tree Predictor Partitioning Enrich database with external data Database GroupBy Twitter API Connector Twitter Search Scorer Determine model accuracy Concatenate Text Preprocessing Text Analytics Filtering and stemming Extract important terms R View (Table) Image to Report Call out to R to view Contigency Table Include this image in a report Tag Cloud Image to Report Save model for later re-use XLS Writer Export to Excel JavaScript Scatter Plot Include this image in a report Interactive Table Hive Connector Database Joiner Create aggregate Statistics Database Writer Highlight Database Connection Table Reader Joiner Scatter Plot Color Manager Bar Chart (JFreeChart) Database Table Selector Write results to database Interactive data plot Crosstab Data to Report Database Row Filter Include this table in a report KNIME Big Data Extension as part of a complete KNIME workflow The Power of Hadoop Mix and Match within KNIME Cloudera Certified KNIME allows you to take advantage of the power of Hadoop from within your KNIME environment. All Hive infrastructure features may be utilized from the well documented and maintained KNIME Analytics Platform. The real power of Hadoop comes when you can mix and match as needed across all steps of an analytic application. KNIME Big Data Extensions are Cloudera certified. Building a Hadoop cluster from the ground up can be challenging. There are numerous choices to be made at all levels of the stack and making those choices can be complex. Database nodes may be combined with all features of KNIME, allowing advanced features like flow variables and flow control to automate which elements are executed at a given stage within your Hadoop environment. When combined with KNIME Server, you can go even further to provide all types of access control to your users, not only for the data but also for the types of queries and manipulation that can be performed. With KNIME, you can mix data sources as well as pick and choose exactly where a particular operation or task should complete, giving you total control over the workflows that you build. Starting with a subset of Hadoop data, KNIME may be used to optimize exactly which portions of the workflow application should be in Hadoop, in another database, or in KNIME itself. You have total control of your Big Data. If you have KNIME Server, you can also surface all or portions of the workflows to your casual users via KNIME WebPortal, giving those users access to sensible Big Data as well. The Cloudera Certified Technology program is designed to make selecting the right technology easier. When you see the Cloudera Certified Technology logo, you can trust that the product has been tested and validated to work with CDH, Cloudera’s open source and enterprise-ready distribution of Apache Hadoop and related projects. KNIME Big Data Extensions are easy to use Hive Connector Hive Loader Impala and more The Hive Connector node establishes a connection to a Hadoop/HDFS database. Connection details may be specified and stored using the node dialog box . The Big Data Extension provides a special Hive Loader node to get your data into Hadoop. The node makes use of the File Handling extensions and first copies the data to the HiveServer (using SSH, FTP, or any other supported protocol ‒ note that remote access to the HiveServer is currently required). Next, a Hive command is executed to import the data into Hadoop/HDFS. The node’s output is a database connection operating on the imported table. Impala support will be added late in 2014. As with all KNIME commercial products, enhancements to KNIME Big Data Extension are automatically included as they become available. Once executed, the node returns a database connection that can be used with almost any of KNIME’s standard database nodes. You can easily upgrade to all new features via the standard upgrade process built into your KNIME Analytics Platform. KNIME Analytics Platform ...is an open source platform for integrated data access, data mining, statistics, visualization, and reporting. KNIME Collaborative Extensions ...activate the full potential of KNIME for teams. Features include user rights & authentication, remote & scheduled execution, shared workflow repository, data space, and metanodes, plus access to workflows, reports, and web services. KNIME Productivity Extensions ...increase the speed at which KNIME workflows can be created, reused, and maintained for both individuals and partners who use KNIME for their clients. KNIME Performance Extensions KNIME Community & Partner Extensions ...enable distributed storage and scalable execution of KNIME workflows, enabling scale for large data sets and complex computation requirements. ...are nodes created by and given back to the KNIME community. These range from broadly useful application nodes simplifying the work of anyone using KNIME, to domainspecific solutions to pressing problems for specialists. About KNIME KNIME is the leading open platform for data-driven innovation helping organizations to stay ahead of change. Innovative organizations use our open-source, enterprise-grade analytics platform to discover the potential hidden in their data, mine for fresh insights or predict new futures. Quick to deploy, easy to scale, and intuitive, KNIME is used in over 60 countries on data of every kind: from numbers to images, molecules to humans, signals to complex networks, from kilo- to petabytes or simple reports to complex analyses. KNIME is developed and supported by KNIME.com AG. Learn more at www.knime.com KNIME.com AG Technoparkstrasse 1 8005 Zurich Switzerland [email protected] http://www.knime.com Tel.: +41 44 445 2660 Fax: +41 44 445 2662 Copyright © 2014 KNIME.com AG. All rights reserved. KNIME TM is a registered trademark of KNIME GmbH, Germany. All other brands or product names mentioned are trademarks owned by their respective organizations. V09/14
© Copyright 2024