Project

General

Profile

Hadoop Add-on » History » Version 2

Henning Blohm, 20.09.2012 16:39

1 1 Henning Blohm
h1. The Hadoop add-on
2
3 2 Henning Blohm
The Hadoop add on actually contains the client parts of the Cloudera Hadoop and HBase distribution plus some integration features that are described in [[How to Hadoop]] and related samples.
4 1 Henning Blohm
5 2 Henning Blohm
It is provided via the repository "z2-addons.hadoop":http://redmine.z2-environment.net/projects/z2-addons/repository/z2-addons-hadoop.
6
7 1 Henning Blohm
As Hadoop and HBase do not have a clear client - server compatibility vector, you may only use the Hadoop add-on with a matching server version. Currently, in Z2 version 2.1, the contained distribution is CDH 4.0.1.
8
9 2 Henning Blohm
We do - for experimental use only! - provide an easy to install and use, pre-configured single-node CDH 4.0.1 via the Git repository "z2-samples.cdh4-base":http://redmine.z2-environment.net/projects/z2-samples/repository/z2-samples-cdh4-base. The samples [Sample-hadoop-basic-TBD] and [Sample-hbase-full-stack-TBD] make use of that.
10 1 Henning Blohm
11 2 Henning Blohm
Extensions that help working with Hadoop are implemented by the modules *com.zfabrik.hadoop* and *com.zfabrik.hbase*.
12 1 Henning Blohm
13 2 Henning Blohm
h2. Details on *com.zfabrik.hadoop*
14
15
Javadocs can be found here: TBD
16
17
h3. Component type com.zfabrik.hadoop.configuration
18
19
Components of this type provide Hadoop or HBase connectivity configuration via a component resource file "core-site.xml". There is no further configuration applicable.
20
21
h3. Component type com.zfabrik.hadoop.job
22
23
A Hadoop Map/Reduce job implementation. Using this component type, Jobs may be programmatically scheduled and run within the Z2 runtime. 
24
25
Properties:
26
27
|_. Name |_. Description|
28
|component.className|The name of a class provided by the module that implements "IMapReduceJob":http://www.link.de |