(SM-1811) Hadoop

Owned by SNP
Oct 29, 2018

Hadoop is an open source distributed processing framework that manages data processing and storage for big data applications running in clustered systems. It can handle various forms of structured and unstructured data, giving users more flexibility for collecting, processing and analyzing data than relational databases and data warehouses provide.

For more information, use this link.

Supported Versions


Hadoop Components

The Hadoop ecosystem refers to the various components of the Apache Hadoop software library, as well as to the accessories and tools provided by the Apache Software Foundation for these types of software projects, and to the ways that they work together.

In Datavard Storage Management, the following components of the Hadoop ecosystem are used:

Hive 1.1.0 and higher

Impala 2.3.0 and higher

Oozie 4.1.0 and higher


Hadoop Distributions

Commercial distributions of Hadoop are offered by various vendors of big data platforms.

Datavard Storage Management basically supports all the distributions which use Hive and HDFS. 

Verified vendors:

  • Cloudera (5.x and higher)
  • Hortonworks (min 2.6)
  • Altiscale

Datavard is certified by

Setup

Use this link for instructions on Hadoop storage setup.

Detailed Technical Information

Use this link for more detailed technical information regarding communication between SAP and Hadoop.