How to use Z2 with Hadoop¶

• DRAFT *

One of Z2's most intriguing capabilities is to seamlessly integrate with Hadoop in the sense that Map-Reduce jobs are just (really!!) ordinary application components.

This means that M/R Job implementations can re-use other application modules just like a Web app. Job implementations may be build on Spring, use Hibernate, use the very same data source definitions etc. No more special assembly and wiring - just because you want to run Map-Reduce with Hadoop.

This howto explains what is needed and how it is done. We assume some basic understanding of Hadoop. There is an instructive sample z2-samples.hadoop-simple that we will refer to thoughout and that you should make sure to have up and running before you continue to more complex setups.