Foro Formación Hadoop

Lanzamiento Workflow Wordcount en Hue KILLED

 
Imagen de MANUEL TURNER VERGEL
Lanzamiento Workflow Wordcount en Hue KILLED
de MANUEL TURNER VERGEL - domingo, 7 de mayo de 2017, 17:37
 

Buenas tardes, al intentar lanzar el workflow en Hue, con el mapreduce de Wordcount. Me lleva al paso KILL, sin embargo, lo único que identifico dentro del log como error es:

LauncherMapper died, check Hadoop LOG for job [quickstart.cloudera:8032:job_1494164666250_0007]

ERROR is considered as FAILED for SLA

He investigado, pero no consigo determinar cual es el error concreto. ¿Alguna idea para solucionarlo? Gracias.

 

El log completo es:

2017-05-07 08:05:07,457 INFO org.apache.oozie.command.wf.ActionStartXCommand: SERVER[quickstart.cloudera] USER[cloudera] GROUP[-] TOKEN[] APP[Wordcount_workflow] JOB[0000001-170507073509715-oozie-oozi-W] ACTION[0000001-170507073509715-oozie-oozi-W@:start:] Start action [0000001-170507073509715-oozie-oozi-W@:start:] with user-retry state : userRetryCount [0], userRetryMax [0], userRetryInterval [10]
2017-05-07 08:05:07,480 INFO org.apache.oozie.command.wf.ActionStartXCommand: SERVER[quickstart.cloudera] USER[cloudera] GROUP[-] TOKEN[] APP[Wordcount_workflow] JOB[0000001-170507073509715-oozie-oozi-W] ACTION[0000001-170507073509715-oozie-oozi-W@:start:] [***0000001-170507073509715-oozie-oozi-W@:start:***]Action status=DONE
2017-05-07 08:05:07,483 INFO org.apache.oozie.command.wf.ActionStartXCommand: SERVER[quickstart.cloudera] USER[cloudera] GROUP[-] TOKEN[] APP[Wordcount_workflow] JOB[0000001-170507073509715-oozie-oozi-W] ACTION[0000001-170507073509715-oozie-oozi-W@:start:] [***0000001-170507073509715-oozie-oozi-W@:start:***]Action updated in DB!
2017-05-07 08:05:07,901 INFO org.apache.oozie.command.wf.ActionStartXCommand: SERVER[quickstart.cloudera] USER[cloudera] GROUP[-] TOKEN[] APP[Wordcount_workflow] JOB[0000001-170507073509715-oozie-oozi-W] ACTION[0000001-170507073509715-oozie-oozi-W@mapreduce-af0c] Start action [0000001-170507073509715-oozie-oozi-W@mapreduce-af0c] with user-retry state : userRetryCount [0], userRetryMax [0], userRetryInterval [10]
2017-05-07 08:05:14,087 INFO org.apache.oozie.action.hadoop.MapReduceActionExecutor: SERVER[quickstart.cloudera] USER[cloudera] GROUP[-] TOKEN[] APP[Wordcount_workflow] JOB[0000001-170507073509715-oozie-oozi-W] ACTION[0000001-170507073509715-oozie-oozi-W@mapreduce-af0c] checking action, hadoop job ID [job_1494164666250_0007] status [RUNNING]
2017-05-07 08:05:14,128 INFO org.apache.oozie.command.wf.ActionStartXCommand: SERVER[quickstart.cloudera] USER[cloudera] GROUP[-] TOKEN[] APP[Wordcount_workflow] JOB[0000001-170507073509715-oozie-oozi-W] ACTION[0000001-170507073509715-oozie-oozi-W@mapreduce-af0c] [***0000001-170507073509715-oozie-oozi-W@mapreduce-af0c***]Action status=RUNNING
2017-05-07 08:05:14,141 INFO org.apache.oozie.command.wf.ActionStartXCommand: SERVER[quickstart.cloudera] USER[cloudera] GROUP[-] TOKEN[] APP[Wordcount_workflow] JOB[0000001-170507073509715-oozie-oozi-W] ACTION[0000001-170507073509715-oozie-oozi-W@mapreduce-af0c] [***0000001-170507073509715-oozie-oozi-W@mapreduce-af0c***]Action updated in DB!
2017-05-07 08:06:34,642 INFO org.apache.oozie.servlet.CallbackServlet: SERVER[quickstart.cloudera] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000001-170507073509715-oozie-oozi-W] ACTION[0000001-170507073509715-oozie-oozi-W@mapreduce-af0c] callback for action [0000001-170507073509715-oozie-oozi-W@mapreduce-af0c]
2017-05-07 08:06:36,748 INFO org.apache.oozie.action.hadoop.MapReduceActionExecutor: SERVER[quickstart.cloudera] USER[cloudera] GROUP[-] TOKEN[] APP[Wordcount_workflow] JOB[0000001-170507073509715-oozie-oozi-W] ACTION[0000001-170507073509715-oozie-oozi-W@mapreduce-af0c] External ID swap, old ID [job_1494164666250_0007] new ID [job_1494164666250_0008]
2017-05-07 08:06:36,756 INFO org.apache.oozie.action.hadoop.MapReduceActionExecutor: SERVER[quickstart.cloudera] USER[cloudera] GROUP[-] TOKEN[] APP[Wordcount_workflow] JOB[0000001-170507073509715-oozie-oozi-W] ACTION[0000001-170507073509715-oozie-oozi-W@mapreduce-af0c] checking action, hadoop job ID [job_1494164666250_0008] status [RUNNING]
2017-05-07 08:09:04,147 INFO org.apache.oozie.servlet.CallbackServlet: SERVER[quickstart.cloudera] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000001-170507073509715-oozie-oozi-W] ACTION[0000001-170507073509715-oozie-oozi-W@mapreduce-af0c] callback for action [0000001-170507073509715-oozie-oozi-W@mapreduce-af0c]
2017-05-07 08:09:05,827 INFO org.apache.oozie.action.hadoop.MapReduceActionExecutor: SERVER[quickstart.cloudera] USER[cloudera] GROUP[-] TOKEN[] APP[Wordcount_workflow] JOB[0000001-170507073509715-oozie-oozi-W] ACTION[0000001-170507073509715-oozie-oozi-W@mapreduce-af0c] External ID swap, old ID [job_1494164666250_0007] new ID [job_1494164666250_0008]
2017-05-07 08:09:06,134 INFO org.apache.oozie.action.hadoop.MapReduceActionExecutor: SERVER[quickstart.cloudera] USER[cloudera] GROUP[-] TOKEN[] APP[Wordcount_workflow] JOB[0000001-170507073509715-oozie-oozi-W] ACTION[0000001-170507073509715-oozie-oozi-W@mapreduce-af0c] action completed, external ID [job_1494164666250_0007]
2017-05-07 08:09:06,142 WARN org.apache.oozie.action.hadoop.MapReduceActionExecutor: SERVER[quickstart.cloudera] USER[cloudera] GROUP[-] TOKEN[] APP[Wordcount_workflow] JOB[0000001-170507073509715-oozie-oozi-W] ACTION[0000001-170507073509715-oozie-oozi-W@mapreduce-af0c] LauncherMapper died, check Hadoop LOG for job [quickstart.cloudera:8032:job_1494164666250_0007]
2017-05-07 08:09:06,766 INFO org.apache.oozie.command.wf.ActionEndXCommand: SERVER[quickstart.cloudera] USER[cloudera] GROUP[-] TOKEN[] APP[Wordcount_workflow] JOB[0000001-170507073509715-oozie-oozi-W] ACTION[0000001-170507073509715-oozie-oozi-W@mapreduce-af0c] ERROR is considered as FAILED for SLA
2017-05-07 08:09:07,157 INFO org.apache.oozie.command.wf.ActionStartXCommand: SERVER[quickstart.cloudera] USER[cloudera] GROUP[-] TOKEN[] APP[Wordcount_workflow] JOB[0000001-170507073509715-oozie-oozi-W] ACTION[0000001-170507073509715-oozie-oozi-W@Kill] Start action [0000001-170507073509715-oozie-oozi-W@Kill] with user-retry state : userRetryCount [0], userRetryMax [0], userRetryInterval [10]
2017-05-07 08:09:07,225 INFO org.apache.oozie.command.wf.ActionStartXCommand: SERVER[quickstart.cloudera] USER[cloudera] GROUP[-] TOKEN[] APP[Wordcount_workflow] JOB[0000001-170507073509715-oozie-oozi-W] ACTION[0000001-170507073509715-oozie-oozi-W@Kill] [***0000001-170507073509715-oozie-oozi-W@Kill***]Action status=DONE
2017-05-07 08:09:07,232 INFO org.apache.oozie.command.wf.ActionStartXCommand: SERVER[quickstart.cloudera] USER[cloudera] GROUP[-] TOKEN[] APP[Wordcount_workflow] JOB[0000001-170507073509715-oozie-oozi-W] ACTION[0000001-170507073509715-oozie-oozi-W@Kill] [***0000001-170507073509715-oozie-oozi-W@Kill***]Action updated in DB!

Imagen de Admin Formación Hadoop
Re: Lanzamiento Workflow Wordcount en Hue KILLED
de Admin Formación Hadoop - lunes, 8 de mayo de 2017, 08:48
 

Hola Manuel, 

¿Podrías indicarnos la configuración exacta del workflow? Puedes copiar el xml que se genera una vez estás ejecutando el workflow.

Gracias,