Hadoop Add-on » History » Version 2
Henning Blohm, 20.09.2012 16:39
1 | 1 | Henning Blohm | h1. The Hadoop add-on |
---|---|---|---|
2 | |||
3 | 2 | Henning Blohm | The Hadoop add on actually contains the client parts of the Cloudera Hadoop and HBase distribution plus some integration features that are described in [[How to Hadoop]] and related samples. |
4 | 1 | Henning Blohm | |
5 | 2 | Henning Blohm | It is provided via the repository "z2-addons.hadoop":http://redmine.z2-environment.net/projects/z2-addons/repository/z2-addons-hadoop. |
6 | |||
7 | 1 | Henning Blohm | As Hadoop and HBase do not have a clear client - server compatibility vector, you may only use the Hadoop add-on with a matching server version. Currently, in Z2 version 2.1, the contained distribution is CDH 4.0.1. |
8 | |||
9 | 2 | Henning Blohm | We do - for experimental use only! - provide an easy to install and use, pre-configured single-node CDH 4.0.1 via the Git repository "z2-samples.cdh4-base":http://redmine.z2-environment.net/projects/z2-samples/repository/z2-samples-cdh4-base. The samples [Sample-hadoop-basic-TBD] and [Sample-hbase-full-stack-TBD] make use of that. |
10 | 1 | Henning Blohm | |
11 | 2 | Henning Blohm | Extensions that help working with Hadoop are implemented by the modules *com.zfabrik.hadoop* and *com.zfabrik.hbase*. |
12 | 1 | Henning Blohm | |
13 | 2 | Henning Blohm | h2. Details on *com.zfabrik.hadoop* |
14 | |||
15 | Javadocs can be found here: TBD |
||
16 | |||
17 | h3. Component type com.zfabrik.hadoop.configuration |
||
18 | |||
19 | Components of this type provide Hadoop or HBase connectivity configuration via a component resource file "core-site.xml". There is no further configuration applicable. |
||
20 | |||
21 | h3. Component type com.zfabrik.hadoop.job |
||
22 | |||
23 | A Hadoop Map/Reduce job implementation. Using this component type, Jobs may be programmatically scheduled and run within the Z2 runtime. |
||
24 | |||
25 | Properties: |
||
26 | |||
27 | |_. Name |_. Description| |
||
28 | |component.className|The name of a class provided by the module that implements "IMapReduceJob":http://www.link.de | |