Mapreduce运行异常Container exited with a non-zero exit code 1

cxy好好先生

7931人浏览 · 2022-03-08 10:18:30

cxy好好先生 · 2022-03-08 10:18:30 发布

昨天在配置完mapreduce和yarn之后，想着用集群运行一个demo，就是官方的wordcount，结果我发现没办法运行，报了错，我就去查看日志，datanode日志是好的，我就去查看resourcemanager的log，结果发现报了以下错误，我仔细看了以下大概意思是我的mapred-site.xml文件中少了一些参数，导致无法运行。

然后我就一五一十地把参数都补了进去，在重启hdfs，发现还是报错，但是没有说缺少啥参数了，我再仔细一看还有个错误，但我不会，就是标题地这个错误和我上面这个错误还不一样，标题地错误是Container exited with a non-zero exit code 1。

[2022-03-07 16:22:22.775]Container exited with a non-zero exit code 1. Error file: prelaunch.err.
Last 4096 bytes of prelaunch.err :
Last 4096 bytes of stderr :
Error: Could not find or load main class org.apache.hadoop.mapreduce.v2.app.MRAppMaster

Please check whether your etc/hadoop/mapred-site.xml contains the below configuration:
<property>
  <name>yarn.app.mapreduce.am.env</name>
  <value>HADOOP_MAPRED_HOME=${full path of your hadoop distribution directory}</value>
</property>
<property>
  <name>mapreduce.map.env</name>
  <value>HADOOP_MAPRED_HOME=${full path of your hadoop distribution directory}</value>
</property>
<property>
  <name>mapreduce.reduce.env</name>
  <value>HADOOP_MAPRED_HOME=${full path of your hadoop distribution directory}</value>
</property>

我就上csdn查资料，我发现了以下链接：

终其原因还是配置的问题，在hadoop3.0需要加上ResourceManager的webapp地址参数配置，yarn.resourcemanager.webapp.address.rm1， yarn.resourcemanager.scheduler.address.rm2。

MapReduce程序运行异常Container exited with a non-zero exit code 1. Error file: prelaunch.err._SolitaryWalker_0的博客-CSDN博客Container exited with a non-zero exit code 1. Error file: prelaunch.err.https://blog.csdn.net/qq_38780623/article/details/121452217?ops_request_misc=%257B%2522request%255Fid%2522%253A%2522164664398316781685398619%2522%252C%2522scm%2522%253A%252220140713.130102334.pc%255Fall.%2522%257D&request_id=164664398316781685398619&biz_id=0&utm_medium=distribute.pc_search_result.none-task-blog-2~all~first_rank_ecpm_v1~rank_v31_ecpm-4-121452217.pc_search_result_cache&utm_term=Container+exited+with+a+non-zero+exit+code+1.+Error+file%3A+prelaunch.err.+Last+4096+bytes+of+prelaunch.err+%3A+Last+4096+bytes+of+stderr+%3A+log4j%3AWARN+No+appenders+could+be+found+for+logger+%28org.apache.ha&spm=1018.2226.3001.4187加红的是连接中的原句，但是我知道这个事情而且我早就把这两个参数加进去了，抱着试一试的态度我打开了yarn-site.xml文件，结果映入眼帘地就是这样地画面