Bug #1027: Running MR job on /mt-admin fails - z2-Environment

Bug #1027

Running MR job on /mt-admin fails

Added by Udo Offermann over 11 years ago. Updated over 11 years ago.

Status:

Closed

Priority:

Normal

Assignee:

Henning Blohm

Category:

z2-addon-hadoop

Target version:

Start date:

09.04.2013

Due date:

% Done:

100%

Estimated time:

origin:

Description

2013-04-09 17:10:48,844 FATAL [IPC Server handler 4 on 61241] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Task: attempt_1365436923337_0001_m_000000_0 - exited : java.lang.RuntimeException: Failed to init Z2 process
    at com.zfabrik.hadoop.impl.HadoopProcessRunner.start(HadoopProcessRunner.java:226)
    at com.zfabrik.hadoop.impl.DelegatingMapper.setConf(DelegatingMapper.java:33)
    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:70)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:130)
    at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:685)
    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:332)
    at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:152)
    at java.security.AccessController.doPrivileged(Native Method)
    at javax.security.auth.Subject.doAs(Subject.java:396)
    at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1232)
    at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:147)
Caused by: java.lang.RuntimeException: work failed
    at com.zfabrik.hadoop.impl.HadoopProcessRunner.work(HadoopProcessRunner.java:256)
    at com.zfabrik.hadoop.impl.HadoopProcessRunner.work(HadoopProcessRunner.java:244)
    at com.zfabrik.hadoop.impl.HadoopProcessRunner.start(HadoopProcessRunner.java:212)
    ... 10 more
Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at com.zfabrik.hadoop.impl.HadoopProcessRunner.work(HadoopProcessRunner.java:254)
    ... 12 more
Caused by: java.lang.IllegalArgumentException: Failed to retrieve job component com.gi-de.samples.moneytracker.analytics.jobs/aggregations
    at com.zfabrik.hadoop.impl.HadoopProcessRunner$1.run(HadoopProcessRunner.java:218)
    at com.zfabrik.work.WorkUnit.work(WorkUnit.java:344)
    at com.zfabrik.impl.launch.ProcessRunnerImpl.work(ProcessRunnerImpl.java:243)
    ... 17 more
Caused by: javax.naming.NoInitialContextException: Need to specify class name in environment or system property, or as an applet parameter, or in an application resource file:  java.naming.factory.initial
    at javax.naming.spi.NamingManager.getInitialContext(NamingManager.java:645)
    at javax.naming.InitialContext.getDefaultInitCtx(InitialContext.java:288)
    at javax.naming.InitialContext.getURLOrDefaultInitCtx(InitialContext.java:325)
    at javax.naming.InitialContext.lookup(InitialContext.java:392)
    at com.zfabrik.hadoop.impl.HadoopProcessRunner$1.run(HadoopProcessRunner.java:215)
    ... 19 more

2013-04-09 17:10:48,844 INFO [IPC Server handler 4 on 61241] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Diagnostics report from attempt_1365436923337_0001_m_000000_0: Error: java.lang.RuntimeException: Failed to init Z2 process
    at com.zfabrik.hadoop.impl.HadoopProcessRunner.start(HadoopProcessRunner.java:226)
    at com.zfabrik.hadoop.impl.DelegatingMapper.setConf(DelegatingMapper.java:33)
    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:70)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:130)
    at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:685)
    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:332)
    at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:152)
    at java.security.AccessController.doPrivileged(Native Method)
    at javax.security.auth.Subject.doAs(Subject.java:396)
    at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1232)
    at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:147)
Caused by: java.lang.RuntimeException: work failed
    at com.zfabrik.hadoop.impl.HadoopProcessRunner.work(HadoopProcessRunner.java:256)
    at com.zfabrik.hadoop.impl.HadoopProcessRunner.work(HadoopProcessRunner.java:244)
    at com.zfabrik.hadoop.impl.HadoopProcessRunner.start(HadoopProcessRunner.java:212)
    ... 10 more
Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at com.zfabrik.hadoop.impl.HadoopProcessRunner.work(HadoopProcessRunner.java:254)
    ... 12 more
Caused by: java.lang.IllegalArgumentException: Failed to retrieve job component com.gi-de.samples.moneytracker.analytics.jobs/aggregations
    at com.zfabrik.hadoop.impl.HadoopProcessRunner$1.run(HadoopProcessRunner.java:218)
    at com.zfabrik.work.WorkUnit.work(WorkUnit.java:344)
    at com.zfabrik.impl.launch.ProcessRunnerImpl.work(ProcessRunnerImpl.java:243)
    ... 17 more
Caused by: javax.naming.NoInitialContextException: Need to specify class name in environment or system property, or as an applet parameter, or in an application resource file:  java.naming.factory.initial
    at javax.naming.spi.NamingManager.getInitialContext(NamingManager.java:645)
    at javax.naming.InitialContext.getDefaultInitCtx(InitialContext.java:288)
    at javax.naming.InitialContext.getURLOrDefaultInitCtx(InitialContext.java:325)
    at javax.naming.InitialContext.lookup(InitialContext.java:392)
    at com.zfabrik.hadoop.impl.HadoopProcessRunner$1.run(HadoopProcessRunner.java:215)
    ... 19 more

2013-04-09 17:10:48,847 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Diagnostics report from attempt_1365436923337_0001_m_000000_0: Error: java.lang.RuntimeException: Failed to init Z2 process
    at com.zfabrik.hadoop.impl.HadoopProcessRunner.start(HadoopProcessRunner.java:226)
    at com.zfabrik.hadoop.impl.DelegatingMapper.setConf(DelegatingMapper.java:33)
    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:70)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:130)
    at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:685)
    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:332)
    at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:152)
    at java.security.AccessController.doPrivileged(Native Method)
    at javax.security.auth.Subject.doAs(Subject.java:396)
    at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1232)
    at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:147)
Caused by: java.lang.RuntimeException: work failed
    at com.zfabrik.hadoop.impl.HadoopProcessRunner.work(HadoopProcessRunner.java:256)
    at com.zfabrik.hadoop.impl.HadoopProcessRunner.work(HadoopProcessRunner.java:244)
    at com.zfabrik.hadoop.impl.HadoopProcessRunner.start(HadoopProcessRunner.java:212)
    ... 10 more
Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at com.zfabrik.hadoop.impl.HadoopProcessRunner.work(HadoopProcessRunner.java:254)
    ... 12 more
Caused by: java.lang.IllegalArgumentException: Failed to retrieve job component com.gi-de.samples.moneytracker.analytics.jobs/aggregations
    at com.zfabrik.hadoop.impl.HadoopProcessRunner$1.run(HadoopProcessRunner.java:218)
    at com.zfabrik.work.WorkUnit.work(WorkUnit.java:344)
    at com.zfabrik.impl.launch.ProcessRunnerImpl.work(ProcessRunnerImpl.java:243)
    ... 17 more
Caused by: javax.naming.NoInitialContextException: Need to specify class name in environment or system property, or as an applet parameter, or in an application resource file:  java.naming.factory.initial
    at javax.naming.spi.NamingManager.getInitialContext(NamingManager.java:645)
    at javax.naming.InitialContext.getDefaultInitCtx(InitialContext.java:288)
    at javax.naming.InitialContext.getURLOrDefaultInitCtx(InitialContext.java:325)
    at javax.naming.InitialContext.lookup(InitialContext.java:392)
    at com.zfabrik.hadoop.impl.HadoopProcessRunner$1.run(HadoopProcessRunner.java:215)
    ... 19 more

Updated by Henning Blohm over 11 years ago

Project changed from 25 to z2-Environment
Category set to z2-addon
Status changed from New to In Progress

Problem due to not having the job component lookup executed with an appropriate thread context class loader in conjunction with the naming integration changes as of #1012.

Updated by Henning Blohm over 11 years ago

Category changed from z2-addon to z2-addon-hadoop

Updated by Anonymous over 11 years ago

Status changed from In Progress to Resolved
% Done changed from 0 to 100

Applied in changeset z2-addons:z2-addons-hadoop|commit:8aa90555fdfed5407bdafe790ecdbe37c1eae607.

Updated by Henning Blohm over 11 years ago

Status changed from Resolved to Closed

Also available in: Atom PDF

Project

General

Profile

z2-Environment

Custom queries

Bug #1027

Running MR job on /mt-admin fails

Updated by Henning Blohm over 11 years ago

Updated by Henning Blohm over 11 years ago

Updated by Anonymous over 11 years ago

Updated by Henning Blohm over 11 years ago