Install prepacked CDH4 » History » Version 2
Henning Blohm, 20.09.2012 14:36
1 | 1 | Henning Blohm | h2. Install CDH4 from a preconfigured repository |
---|---|---|---|
2 | |||
3 | This site provides a pre-configured one-ckeck out user space installation of Cloudera's CDH4 Hadoop and HBase distributions. This page explains how to install it on your machine - which is really, really simple compared to normally suggested Hadoop installation procedures. |
||
4 | |||
5 | *Note #1:* This will only work on Linux or Mac OS |
||
6 | |||
7 | *Note #2:* The repository also contains an Eclipse project file and has Eclipse launchers for most functions required. |
||
8 | |||
9 | In short there are two steps: |
||
10 | |||
11 | # Clone the repository |
||
12 | # Adapt your local environment |
||
13 | |||
14 | h3. Clone the repository |
||
15 | |||
16 | The pre-configured distribution is stored in the repository "z2-samples-cdh4-base":http://redmine.z2-environment.net/projects/z2-samples/repository/z2-samples-cdh4-base. We assume you install everything (including an Eclipse workspace - if you run the samples) in *install*. |
||
17 | |||
18 | <pre><code> |
||
19 | cd install |
||
20 | git clone -b http://git.z2-environment.net/z2-samples.cdh4-base |
||
21 | </code></pre> |
||
22 | 2 | Henning Blohm | |
23 | h3. Adapt your environment |
||
24 | |||
25 | Before you can run anything really there are two customizations needed: |
||
26 | |||
27 | h4. Set important environment variables |
||
28 | |||
29 | There is a shell script "env.sh":http://redmine.z2-environment.net/projects/z2-samples/repository/z2-samples-cdh4-base/revisions/master/entry/env.sh that you should open and change as described. At the time of this writing it is required that you define your JAVA_HOME (please do, even if set elsewhere already) and the NOSQL_HOME, which is the absolute path to the folder that has the *env.sh* file. This script is called from many places. |
||
30 | |||
31 | h4. Enable password-less SSH |
||
32 | |||
33 | Currently this is still required to have the start / stop scripts running. This requirement may be dropped in the future. |
||
34 | |||
35 | If you have not created a unique key for SSH or have no idea what that is, run |
||
36 | |||
37 | <pre><code> |
||
38 | ssh-keygen |
||
39 | </code></pre> |
||
40 | |||
41 | (just keep hitting enter). Next copy that key over to the machine you want to log on to without password, i.e. localhost in this case: |
||
42 | |||
43 | <pre><code> |
||
44 | ssh-copy-id <your user name>@localhost |
||
45 | </code></pre> |
||
46 | |||
47 | If this fails because your SSH works differently, or ssh will refuse to log on without password please "ask the internet". Sorry. |
||
48 | |||
49 | All that matters is that in the end |
||
50 | |||
51 | <pre><code> |
||
52 | ssh <your user name>@localhost |
||
53 | </code></pre> |
||
54 | |||
55 | (substituting <your user name> with your actual user name of course) works without asking for a password. |