栏目分类:
子分类:
返回
名师互学网用户登录
快速导航关闭
当前搜索
当前分类
子分类
实用工具
热门搜索
名师互学网 > IT > 前沿技术 > 大数据 > 大数据系统

azkaban报错:azkaban.jobExecutor.utils.process.ProcessFailureException: Process exited with code 64

azkaban报错:azkaban.jobExecutor.utils.process.ProcessFailureException: Process exited with code 64

报错如下:

05-01-2022 10:21:01 CST ods_to_dwd_log INFO - No Stats for sonkwo@ods_event_log, Columns: ip_region, create_time, ip, source_parameter, v_uuid, account_region, visit_page_time, version, url, path, account_id, event_type, detail_parameter, account_register_time, page_name, host, page_parameter, client, goto_parameter, id, event_time
05-01-2022 10:21:01 CST ods_to_dwd_log INFO - No Stats for sonkwo@ods_event_log, Columns: account_id, v_uuid, id, event_time
05-01-2022 10:21:01 CST ods_to_dwd_log INFO - No Stats for sonkwo@ods_event_log, Columns: ip_region, create_time, ip, source_parameter, v_uuid, account_region, visit_page_time, version, url, path, account_id, event_type, detail_parameter, account_register_time, page_name, host, page_parameter, client, goto_parameter, id, event_time
05-01-2022 10:21:04 CST ods_to_dwd_log INFO - FAILED: SemanticException Failed to get a spark session: org.apache.hadoop.hive.ql.metadata.HiveException: Failed to create Spark client for Spark session 4492e628-e0f9-430e-a994-9e9e476586d6
05-01-2022 10:21:05 CST ods_to_dwd_log INFO - Process with id 11720 completed unsuccessfully in 10 seconds.
05-01-2022 10:21:05 CST ods_to_dwd_log ERROR - Job run failed!
java.lang.RuntimeException: azkaban.jobExecutor.utils.process.ProcessFailureException: Process exited with code 64
	at azkaban.jobExecutor.ProcessJob.run(ProcessJob.java:312)
	at azkaban.execapp.JobRunner.runJob(JobRunner.java:823)
	at azkaban.execapp.JobRunner.doRun(JobRunner.java:602)
	at azkaban.execapp.JobRunner.run(JobRunner.java:563)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
Caused by: azkaban.jobExecutor.utils.process.ProcessFailureException: Process exited with code 64
	at azkaban.jobExecutor.utils.process.AzkabanProcess.run(AzkabanProcess.java:125)
	at azkaban.jobExecutor.ProcessJob.run(ProcessJob.java:304)
	... 8 more
05-01-2022 10:21:05 CST ods_to_dwd_log ERROR - azkaban.jobExecutor.utils.process.ProcessFailureException: Process exited with code 64 cause: azkaban.jobExecutor.utils.process.ProcessFailureException: Process exited with code 64
05-01-2022 10:21:05 CST ods_to_dwd_log INFO - Finishing job ods_to_dwd_log at 1641349265106 with status FAILED

看到这个错误我就网上一顿搜索并修改,但是都没有找到解决方案。

在我灰心意冷的时候看到了错误中关于sql的日志,如下:

No Stats for sonkwo@ods_event_log, Columns: ip_region, create_time, ip, source_parameter, v_uuid, account_region, visit_page_time, version, url, path, account_id, event_type, detail_parameter, account_register_time, page_name, host, page_parameter, client, goto_parameter, id, event_time
05-01-2022 10:21:01 CST ods_to_dwd_log INFO - No Stats for sonkwo@ods_event_log, Columns: account_id, v_uuid, id, event_time
05-01-2022 10:21:01 CST ods_to_dwd_log INFO - No Stats for sonkwo@ods_event_log, Columns: ip_region, create_time, ip, source_parameter, v_uuid, account_region, visit_page_time, version, url, path, account_id, event_type, detail_parameter, account_register_time, page_name, host, page_parameter, client, goto_parameter, id, event_time

我心想,为什么会有这个日志线上呢,是不是我使用了“select * from” ,因为对于hive来说最好把要查询的列都写出来,那我就改一下这个问题吧,省的看的心烦。

奇迹出现了,改完这个问题后,重新跑azkaban竟然跑成功了。

启发,日志有时候并不能很明确的爆出错误,但是要尽量去看去解决,也许一些小问题就是导致错误的根本原因!!!!

转载请注明:文章转载自 www.mshxw.com
本文地址:https://www.mshxw.com/it/699768.html
我们一直用心在做
关于我们 文章归档 网站地图 联系我们

版权所有 (c)2021-2022 MSHXW.COM

ICP备案号:晋ICP备2021003244-6号