Project

General

Profile

How to Hadoop » History » Revision 3

Revision 2 (Henning Blohm, 06.09.2012 11:00) → Revision 3/8 (Henning Blohm, 11.09.2012 22:22)

h1. How to use Z2 with Hadoop 

 *DRAFT* 
 
 One of Z2's most intriguing capabilities is to seamlessly integrate with Hadoop in the sense that Map-Reduce jobs are just (really!!) ordinary application components. 

 This means that M/R Job implementations can re-use other application modules just like a Web app. Job implementations may be build on Spring, use Hibernate, use the very same data source definitions etc. No more special assembly and wiring - just because you want to run Map-Reduce with Hadoop. 

 This howto explains what is needed and how it is done. We assume some basic understanding of Hadoop. There is an instructive sample *z2-samples.hadoop-simple* that we will refer to thoughout and that you should make sure to have up and running before you continue to more complex setups. 

 !z2_hadoop.png!