The Hadoop add-on¶

The Hadoop add on actually contains the client parts of the Cloudera Hadoop and HBase distribution plus some integration features that are described in How to Hadoop and related samples.

It is provided via the repository z2-addons.hadoop.

As Hadoop and HBase do not have a clear client - server compatibility vector, you may only use the Hadoop add-on with a matching server version. Currently, in Z2 version 2.1, the contained distribution is CDH 4.0.1.

We do - for experimental use only! - provide an easy to install and use, pre-configured single-node CDH 4.0.1 via the Git repository z2-samples.cdh4-base. The samples [Sample-hadoop-basic-TBD] and [Sample-hbase-full-stack-TBD] make use of that.

Extensions that help working with Hadoop are implemented by the modules com.zfabrik.hadoop and com.zfabrik.hbase.

Details on com.zfabrik.hadoop¶

Javadocs can be found here: Javadocs

Component type com.zfabrik.hadoop.configuration¶

Components of this type provide Hadoop or HBase connectivity configuration via a component resource file "core-site.xml". There is no further configuration applicable.

Component type com.zfabrik.hadoop.job¶

A Hadoop Map/Reduce job implementation. Using this component type, Jobs may be programmatically scheduled and run within the Z2 runtime.

Properties:

Name	Value or Description
com.zfabrik.component.type	com.zfabrik.hadoop.job
component.className	The name of a class provided by the module that implements IMapReduceJob

Details on com.zfabrik.hbase¶

This module provides additional utilities and types on top of com.zfabrik.hadoop that simplify and help working with HBase.

Javadocs can be found here: Javadocs

This module does not provide component types. It does however providing a narrowing interface IHBaseMapReduceJob that extends IMapReduceJob for Map/Reduce jobs over HBase tables.

See also Sample-hbase-full-stack-TBD.