Project

General

Profile

Actions

Hadoop Add-on » History » Revision 2

« Previous | Revision 2/16 (diff) | Next »
Henning Blohm, 20.09.2012 16:39


The Hadoop add-on

The Hadoop add on actually contains the client parts of the Cloudera Hadoop and HBase distribution plus some integration features that are described in How to Hadoop and related samples.

It is provided via the repository z2-addons.hadoop.

As Hadoop and HBase do not have a clear client - server compatibility vector, you may only use the Hadoop add-on with a matching server version. Currently, in Z2 version 2.1, the contained distribution is CDH 4.0.1.

We do - for experimental use only! - provide an easy to install and use, pre-configured single-node CDH 4.0.1 via the Git repository z2-samples.cdh4-base. The samples [Sample-hadoop-basic-TBD] and [Sample-hbase-full-stack-TBD] make use of that.

Extensions that help working with Hadoop are implemented by the modules com.zfabrik.hadoop and com.zfabrik.hbase.

Details on com.zfabrik.hadoop

Javadocs can be found here: TBD

Component type com.zfabrik.hadoop.configuration

Components of this type provide Hadoop or HBase connectivity configuration via a component resource file "core-site.xml". There is no further configuration applicable.

Component type com.zfabrik.hadoop.job

A Hadoop Map/Reduce job implementation. Using this component type, Jobs may be programmatically scheduled and run within the Z2 runtime.

Properties:

Name Description
component.className The name of a class provided by the module that implements IMapReduceJob

Updated by Henning Blohm over 11 years ago · 2 revisions