Project

General

Profile

Install prepacked CDH4 » History » Revision 2

Revision 1 (Henning Blohm, 20.09.2012 14:23) → Revision 2/20 (Henning Blohm, 20.09.2012 14:36)

h2. Install CDH4 from a preconfigured repository 

 This site provides a pre-configured one-ckeck out user space installation of Cloudera's CDH4 Hadoop and HBase distributions. This page explains how to install it on your machine - which is really, really simple compared to normally suggested Hadoop installation procedures. 

 *Note #1:* This will only work on Linux or Mac OS 

 *Note #2:* The repository also contains an Eclipse project file and has Eclipse launchers for most functions required. 

 In short there are two steps: 

 # Clone the repository 
 # Adapt your local environment 

 h3. Clone the repository 

 The pre-configured distribution is stored in the repository "z2-samples-cdh4-base":http://redmine.z2-environment.net/projects/z2-samples/repository/z2-samples-cdh4-base. We assume you install everything (including an Eclipse workspace - if you run the samples) in *install*. 

 <pre><code> 
 cd install 
 git clone -b http://git.z2-environment.net/z2-samples.cdh4-base 
 </code></pre> 

 h3. Adapt your environment 

 Before you can run anything really there are two customizations needed: 

 h4. Set important environment variables 

 There is a shell script "env.sh":http://redmine.z2-environment.net/projects/z2-samples/repository/z2-samples-cdh4-base/revisions/master/entry/env.sh that you should open and change as described. At the time of this writing it is required that you define your JAVA_HOME (please do, even if set elsewhere already) and the NOSQL_HOME, which is the absolute path to the folder that has the *env.sh* file. This script is called from many places. 

 h4. Enable password-less SSH 

 Currently this is still required to have the start / stop scripts running. This requirement may be dropped in the future.  

 If you have not created a unique key for SSH or have no idea what that is, run 

 <pre><code> 
 ssh-keygen 
 </code></pre> 

 (just keep hitting enter). Next copy that key over to the machine you want to log on to without password, i.e. localhost in this case: 

 <pre><code> 
 ssh-copy-id <your user name>@localhost 
 </code></pre> 

 If this fails because your SSH works differently, or ssh will refuse to log on without password please "ask the internet". Sorry. 

 All that matters is that in the end 

 <pre><code> 
 ssh <your user name>@localhost 
 </code></pre> 

 (substituting <your user name> with your actual user name of course) works without asking for a password.