Project

General

Profile

Hadoop Add-on » History » Revision 2

Revision 1 (Henning Blohm, 11.09.2012 22:11) → Revision 2/16 (Henning Blohm, 20.09.2012 16:39)

h1. The Hadoop add-on 

 The Hadoop add on actually contains the client parts of the Cloudera Hadoop and HBase distribution plus some integration features that are will be described in [[How to Hadoop]] and related samples. on this Wiki page. 

 It is provided via the repository "z2-addons.hadoop":http://redmine.z2-environment.net/projects/z2-addons/repository/z2-addons-hadoop. 

 As Hadoop and HBase do not have a clear client - server compatibility vector, you may only use the Hadoop add-on with a matching server version. Currently, in Z2 version 2.1, the contained distribution is CDH 4.0.1. 

 We do - for experimental use only! of course - provide an easy to install and use, pre-configured single-node CDH 4.0.1 via the Git repository "z2-samples.cdh4-base":http://redmine.z2-environment.net/projects/z2-samples/repository/z2-samples-cdh4-base. *TBD*. The samples [Sample-hadoop-basic-TBD] [sample-hadoop-basic] and [Sample-hbase-full-stack-TBD] [sample-hbase-basic] make use of that. 

 Extensions that help working with Hadoop If you are implemented by the modules *com.zfabrik.hadoop* and *com.zfabrik.hbase*. 

 h2. Details on *com.zfabrik.hadoop* 

 Javadocs can be found here: TBD 

 h3. Component type com.zfabrik.hadoop.configuration 

 Components bound to another version of this type provide Hadoop or and HBase connectivity configuration via a component resource file "core-site.xml". There is no further configuration applicable. 

 h3. Component type com.zfabrik.hadoop.job 

 A Hadoop Map/Reduce job implementation. Using this component type, Jobs may be programmatically scheduled we ask you to start your own repositories and run within the Z2 runtime.  

 Properties: replace binaries as required. 

 |_. Name |_. Description| 
 |component.className|The name of a class provided by the module that implements "IMapReduceJob":http://www.link.de | 

 TBC