17/11/24 05:08:44 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2017-11-24 21:20:25
1:什么叫失望,什么叫绝望。总之是一脸懵逼的继续......
之前部署的hadoop都是hadoop-2.4.1.tar.gz,这几天换成了hadoop-2.6.4.tar.gz,部署老生常谈,启动就不一样了,本来吧,也就是warn,不是error,启动hdfs和yarn,节点都可以正常启动,但是对于我这种强迫症,能容忍下面这一大推错误吗?当你看到这篇的时候,显然是不能,虽然网上已经有很多了,但是貌似好多还是不好使。我呢,也算脑补。记录一下。
[root@master hadoop]# start-dfs.sh
// :: WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Starting namenodes on [Java HotSpot(TM) Client VM warning: You have loaded library /home/hadoop/soft/hadoop-2.6./lib/native/libhadoop.so.1.0. which might have disabled stack guard. The VM will try to fix the stack guard now.
It's highly recommended that you fix the library with 'execstack -c <libfile>', or link it with '-z noexecstack'.
master]
sed: -e expression #, char : unknown option to `s'
-c: Unknown cipher type 'cd'
master: starting namenode, logging to /home/hadoop/soft/hadoop-2.6./logs/hadoop-root-namenode-master.out
stack: ssh: connect to host stack port : Connection refused
highly: ssh: connect to host highly port : Connection refused
disabled: ssh: connect to host disabled port : Connection refused
Client: ssh: connect to host Client port : Connection refused
Java: ssh: Could not resolve hostname Java: Temporary failure in name resolution
'-z: ssh: Could not resolve hostname '-z: Temporary failure in name resolution
might: ssh: Could not resolve hostname might: Temporary failure in name resolution
now.: ssh: Could not resolve hostname now.: Temporary failure in name resolution
It's: ssh: Could not resolve hostname It's: Temporary failure in name resolution
HotSpot(TM): ssh: Could not resolve hostname HotSpot(TM): Temporary failure in name resolution
it: ssh: Could not resolve hostname it: Temporary failure in name resolution
or: ssh: Could not resolve hostname or: Temporary failure in name resolution
to: ssh: Could not resolve hostname to: Temporary failure in name resolution
fix: ssh: Could not resolve hostname fix: Temporary failure in name resolution
warning:: ssh: Could not resolve hostname warning:: Temporary failure in name resolution
You: ssh: Could not resolve hostname You: Temporary failure in name resolution
<libfile>',: ssh: Could not resolve hostname <libfile>',: Temporary failure in name resolution
fix: ssh: Could not resolve hostname fix: Temporary failure in name resolution
'execstack: ssh: Could not resolve hostname 'execstack: Temporary failure in name resolution
loaded: ssh: Could not resolve hostname loaded: Temporary failure in name resolution
VM: ssh: Could not resolve hostname VM: Temporary failure in name resolution
try: ssh: Could not resolve hostname try: Temporary failure in name resolution
you: ssh: Could not resolve hostname you: Temporary failure in name resolution
link: ssh: Could not resolve hostname link: Temporary failure in name resolution
noexecstack'.: ssh: Could not resolve hostname noexecstack'.: Temporary failure in name resolution
with: ssh: connect to host with port : Connection refused
The: ssh: connect to host The port : Connection refused
that: ssh: Could not resolve hostname that: Temporary failure in name resolution
recommended: ssh: Could not resolve hostname recommended: Temporary failure in name resolution
have: ssh: Could not resolve hostname have: Temporary failure in name resolution
will: ssh: Could not resolve hostname will: Temporary failure in name resolution
VM: ssh: Could not resolve hostname VM: Temporary failure in name resolution
library: ssh: Could not resolve hostname library: Temporary failure in name resolution
with: ssh: Could not resolve hostname with: Temporary failure in name resolution
guard: ssh: Could not resolve hostname guard: Temporary failure in name resolution
the: ssh: connect to host the port : Connection refused
have: ssh: connect to host have port : Connection refused
stack: ssh: connect to host stack port : Connection refused
library: ssh: connect to host library port : Connection refused
the: ssh: connect to host the port : Connection refused
guard.: ssh: connect to host guard. port : Connection refused
which: ssh: connect to host which port : Connection refused
master: starting datanode, logging to /home/hadoop/soft/hadoop-2.6./logs/hadoop-root-datanode-master.out
slaver1: starting datanode, logging to /home/hadoop/soft/hadoop-2.6./logs/hadoop-root-datanode-slaver1.out
slaver2: starting datanode, logging to /home/hadoop/soft/hadoop-2.6./logs/hadoop-root-datanode-slaver2.out
Starting secondary namenodes [Java HotSpot(TM) Client VM warning: You have loaded library /home/hadoop/soft/hadoop-2.6./lib/native/libhadoop.so.1.0. which might have disabled stack guard. The VM will try to fix the stack guard now.
It's highly recommended that you fix the library with 'execstack -c <libfile>', or link it with '-z noexecstack'.
master]
sed: -e expression #, char : unknown option to `s'
-c: Unknown cipher type 'cd'
master: starting secondarynamenode, logging to /home/hadoop/soft/hadoop-2.6./logs/hadoop-root-secondarynamenode-master.out
Client: ssh: connect to host Client port : Connection refused
recommended: ssh: connect to host recommended port : Connection refused
VM: ssh: connect to host VM port : Connection refused
VM: ssh: connect to host VM port : Connection refused
stack: ssh: connect to host stack port : Connection refused
disabled: ssh: connect to host disabled port : Connection refused
guard.: ssh: connect to host guard. port : Connection refused
library: ssh: connect to host library port : Connection refused
stack: ssh: connect to host stack port : Connection refused
you: ssh: Could not resolve hostname you: Temporary failure in name resolution
HotSpot(TM): ssh: Could not resolve hostname HotSpot(TM): Temporary failure in name resolution
warning:: ssh: Could not resolve hostname warning:: Temporary failure in name resolution
to: ssh: Could not resolve hostname to: Temporary failure in name resolution
You: ssh: Could not resolve hostname You: Temporary failure in name resolution
'execstack: ssh: Could not resolve hostname 'execstack: Temporary failure in name resolution
<libfile>',: ssh: Could not resolve hostname <libfile>',: Temporary failure in name resolution
Java: ssh: Could not resolve hostname Java: Temporary failure in name resolution
link: ssh: Could not resolve hostname link: Temporary failure in name resolution
It's: ssh: Could not resolve hostname It's: Temporary failure in name resolution
noexecstack'.: ssh: Could not resolve hostname noexecstack'.: Temporary failure in name resolution
it: ssh: Could not resolve hostname it: Temporary failure in name resolution
'-z: ssh: Could not resolve hostname '-z: Temporary failure in name resolution
with: ssh: connect to host with port : Connection refused
loaded: ssh: connect to host loaded port : Connection refused
that: ssh: connect to host that port : Connection refused
have: ssh: connect to host have port : Connection refused
try: ssh: Could not resolve hostname try: Temporary failure in name resolution
which: ssh: connect to host which port : Connection refused
have: ssh: connect to host have port : Connection refused
fix: ssh: connect to host fix port : Connection refused
the: ssh: connect to host the port : Connection refused
guard: ssh: connect to host guard port : Connection refused
highly: ssh: connect to host highly port : Connection refused
library: ssh: connect to host library port : Connection refused
fix: ssh: connect to host fix port : Connection refused
now.: ssh: Could not resolve hostname now.: Temporary failure in name resolution
The: ssh: connect to host The port : Connection refused
the: ssh: connect to host the port : Connection refused
will: ssh: connect to host will port : Connection refused
with: ssh: connect to host with port : Connection refused
or: ssh: connect to host or port : Connection refused
might: ssh: connect to host might port : Connection refused
// :: WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
[root@master hadoop]# jps
DataNode
Jps
SecondaryNameNode
NameNode
[root@master hadoop]#
上面是启动dfs的时候报的,下面是关闭dfs的时候报的:
[root@master hadoop]# stop-dfs.sh
// :: WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Stopping namenodes on [Java HotSpot(TM) Client VM warning: You have loaded library /home/hadoop/soft/hadoop-2.6./lib/native/libhadoop.so.1.0. which might have disabled stack guard. The VM will try to fix the stack guard now.
It's highly recommended that you fix the library with 'execstack -c <libfile>', or link it with '-z noexecstack'.
master]
sed: -e expression #, char : unknown option to `s'
-c: Unknown cipher type 'cd'
master: stopping namenode
loaded: ssh: connect to host loaded port : Connection refused
library: ssh: connect to host library port : Connection refused
recommended: ssh: connect to host recommended port : Connection refused
might: ssh: connect to host might port : Connection refused
HotSpot(TM): ssh: Could not resolve hostname HotSpot(TM): Temporary failure in name resolution
noexecstack'.: ssh: Could not resolve hostname noexecstack'.: Temporary failure in name resolution
it: ssh: Could not resolve hostname it: Temporary failure in name resolution
You: ssh: Could not resolve hostname You: Temporary failure in name resolution
<libfile>',: ssh: Could not resolve hostname <libfile>',: Temporary failure in name resolution
warning:: ssh: Could not resolve hostname warning:: Temporary failure in name resolution
link: ssh: Could not resolve hostname link: Temporary failure in name resolution
now.: ssh: Could not resolve hostname now.: Temporary failure in name resolution
you: ssh: Could not resolve hostname you: Temporary failure in name resolution
'-z: ssh: Could not resolve hostname '-z: Temporary failure in name resolution
It's: ssh: Could not resolve hostname It's: Temporary failure in name resolution
'execstack: ssh: Could not resolve hostname 'execstack: Temporary failure in name resolution
fix: ssh: connect to host fix port : Connection refused
the: ssh: connect to host the port : Connection refused
with: ssh: connect to host with port : Connection refused
to: ssh: Could not resolve hostname to: Temporary failure in name resolution
Java: ssh: Could not resolve hostname Java: Temporary failure in name resolution
with: ssh: connect to host with port : Connection refused
have: ssh: connect to host have port : Connection refused
library: ssh: connect to host library port : Connection refused
disabled: ssh: connect to host disabled port : Connection refused
stack: ssh: connect to host stack port : Connection refused
VM: ssh: connect to host VM port : Connection refused
The: ssh: connect to host The port : Connection refused
which: ssh: connect to host which port : Connection refused
Client: ssh: connect to host Client port : Connection refused
will: ssh: connect to host will port : Connection refused
try: ssh: connect to host try port : Connection refused
guard.: ssh: connect to host guard. port : Connection refused
stack: ssh: connect to host stack port : Connection refused
highly: ssh: connect to host highly port : Connection refused
have: ssh: connect to host have port : Connection refused
VM: ssh: connect to host VM port : Connection refused
the: ssh: connect to host the port : Connection refused
guard: ssh: connect to host guard port : Connection refused
that: ssh: connect to host that port : Connection refused
or: ssh: connect to host or port : Connection refused
fix: ssh: connect to host fix port : Connection refused
slaver2: stopping datanode
slaver1: stopping datanode
master: stopping datanode
Stopping secondary namenodes [Java HotSpot(TM) Client VM warning: You have loaded library /home/hadoop/soft/hadoop-2.6./lib/native/libhadoop.so.1.0. which might have disabled stack guard. The VM will try to fix the stack guard now.
It's highly recommended that you fix the library with 'execstack -c <libfile>', or link it with '-z noexecstack'.
master]
sed: -e expression #, char : unknown option to `s'
-c: Unknown cipher type 'cd'
master: stopping secondarynamenode
Client: ssh: Could not resolve hostname Client: Temporary failure in name resolution
You: ssh: Could not resolve hostname You: Temporary failure in name resolution
Java: ssh: Could not resolve hostname Java: Temporary failure in name resolution
have: ssh: Could not resolve hostname have: Temporary failure in name resolution
loaded: ssh: Could not resolve hostname loaded: Temporary failure in name resolution
library: ssh: Could not resolve hostname library: Temporary failure in name resolution
have: ssh: Could not resolve hostname have: Temporary failure in name resolution
disabled: ssh: Could not resolve hostname disabled: Temporary failure in name resolution
The: ssh: Could not resolve hostname The: Temporary failure in name resolution
highly: ssh: Could not resolve hostname highly: Temporary failure in name resolution
try: ssh: Could not resolve hostname try: Temporary failure in name resolution
warning:: ssh: Could not resolve hostname warning:: Temporary failure in name resolution
guard: ssh: Could not resolve hostname guard: Temporary failure in name resolution
which: ssh: Could not resolve hostname which: Temporary failure in name resolution
stack: ssh: Could not resolve hostname stack: Temporary failure in name resolution
recommended: ssh: Could not resolve hostname recommended: Temporary failure in name resolution
the: ssh: Could not resolve hostname the: Temporary failure in name resolution
will: ssh: Could not resolve hostname will: Temporary failure in name resolution
It's: ssh: Could not resolve hostname It's: Temporary failure in name resolution
stack: ssh: Could not resolve hostname stack: Temporary failure in name resolution
now.: ssh: Could not resolve hostname now.: Temporary failure in name resolution
library: ssh: Could not resolve hostname library: Temporary failure in name resolution
fix: ssh: Could not resolve hostname fix: Temporary failure in name resolution
that: ssh: Could not resolve hostname that: Temporary failure in name resolution
with: ssh: Could not resolve hostname with: Temporary failure in name resolution
to: ssh: Could not resolve hostname to: Temporary failure in name resolution
'-z: ssh: Could not resolve hostname '-z: Temporary failure in name resolution
<libfile>',: ssh: Could not resolve hostname <libfile>',: Temporary failure in name resolution
it: ssh: Could not resolve hostname it: Temporary failure in name resolution
VM: ssh: Could not resolve hostname VM: Temporary failure in name resolution
the: ssh: Could not resolve hostname the: Temporary failure in name resolution
'execstack: ssh: Could not resolve hostname 'execstack: Temporary failure in name resolution
or: ssh: Could not resolve hostname or: Temporary failure in name resolution
link: ssh: Could not resolve hostname link: Temporary failure in name resolution
you: ssh: Could not resolve hostname you: Temporary failure in name resolution
noexecstack'.: ssh: Could not resolve hostname noexecstack'.: Temporary failure in name resolution
HotSpot(TM): ssh: Could not resolve hostname HotSpot(TM): Temporary failure in name resolution
fix: ssh: Could not resolve hostname fix: Temporary failure in name resolution
VM: ssh: Could not resolve hostname VM: Temporary failure in name resolution
might: ssh: Could not resolve hostname might: Temporary failure in name resolution
with: ssh: Could not resolve hostname with: Temporary failure in name resolution
guard.: ssh: connect to host guard. port : Connection refused
// :: WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
[root@master hadoop]#
待续.......
2:出错,解决不了,百度呗,这里贴出来,我准备百度参考的文章,不知道能不能成功呢,先记录一下,因为那是2015年,距今2年了。
http://blog.csdn.net/young_kim1/article/details/50324345
http://blog.csdn.net/young_kim1/article/details/50269501
此两篇是上下篇,希望可以帮到以后遇到这个问题的人。
3:为什么出现这个问题呢:
提示hadoop不能加载本地库。
以前官网会提供32位的安装包,但目前提供的下载包为64位的,在linux 32位系统下安装后会一直提示错误“WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform… using builtin-java classes where applicable ”,但官网又不提供32位系统下的安装包,所以我们只能自己编译打包源码。
首先看下自己的虚拟机是多少位的吧:
# uname -i 通过以上命令获取系统版本,
然后呢到
大家可以到cd /home/hadoop/soft/hadoop-2.6.4/lib/native
下,查看文件libhadoop.so.1.0.0,里面会显示Hadoop的位数,官网下载好的显示是64位的,截图如下:
4:有耐心的可以根据上面的网址操作,已经写的很详细了,这里不作多叙述,直接将lib下面的native贴出来,如果你的linux是32位的,直接替换你的/lib/native即可。替换过后再查看,如下所示:
替换的32位的lib/native包:http://download.csdn.net/download/biexiansheng/10132053
启动和关闭的时候也不warn了:
停更......
2017-11-24 22:02:20
17/11/24 05:08:44 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable的更多相关文章
- 解决讨厌的警告 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
问题: 执行任何hadoop命令,都会提示如下WARN.虽然影响不大,但是每次运行一个命令都有这么个WARN,让人很不爽,作为一个精致的男人, 必须要干掉它. [root@master logs]# ...
- Hadoop _ 疑难杂症 解决1 - WARN util.NativeCodeLoader: Unable to load native-hadoop library for your plat
最近博主在进行Hive测试 压缩解压缩的时候 遇到了这个问题, 该问题也常出现在日常 hdfs 指令中, 在启动服务 与 hdfs dfs 执行指令的时候 : 都会显示该提示,下面描述下该问题应该如何 ...
- hadoop报错WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
19/06/14 10:44:58 WARN common.Util: Path /opt/hadoopdata/hdfs/name should be specified as a URI in c ...
- Hadoop问题解决:WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
在配置好hadoop的环境之后,命令启动./start-all.sh发现经常出现这样的一个警告: WARN util.NativeCodeLoader: Unable to load native-h ...
- WARN util.NativeCodeLoader: Unable to load native-hadooplibrary for your platform… using builtin-java classes where applicable
方法1glibc 官方要求的2.14版本以上 方法2:http://www.secdoctor.com/html/yyjs/31101.html 方法3: http://dl.bintray.com/ ...
- [hadoop] WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
hadoop 启动后,有警告信息: WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform ...
- Hadoop集群“WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable”解决办法
Hadoop集群部署完成后,经常会提示 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platfo ...
- HADOOP:WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable终于解决了
WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin- ...
- WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable Exception in thread "main" java.io.IOException: No FileSystem for sc F
1.执行脚本程序报如下所示的错误: [hadoop@slaver1 script_hadoop]$ hadoop jar web_click_mr_hive.jar com.bie.hive.mr.C ...
随机推荐
- Django-路由层
URL配置(URLconf)就像Django所支撑网站的记录.它的本质是URL要为该URL调用的视图函数之间的映射表:你就是以这种方式告诉Django,对于客户端发来的某个URL调用哪一段逻辑代码对应 ...
- 【Android休眠】之PowerKey唤醒源实现【转】
转自:https://blog.csdn.net/u013686019/article/details/53677531 版权声明:本文为博主原创文章,未经博主允许不得转载. https://blog ...
- python3+selenium入门06-浏览器操作
WebDriver主要提供元素操作的方法,但也提供了一些关于浏览器操作的方法,比如设置浏览器大小,浏览器前进,后退,刷新等 设置浏览器大小 有时候需要设置浏览器大小,比如访问收集网页,设置浏览器大小跟 ...
- HttpResonse 要记得关闭
写了一个小程序,要识别网站上的图片,用到HttpRequest发请求,HttpResponse接受返回数据.刚开始循环可以跑两个,但是总是提示超时.后来查资料发现,在Http协议中,规定了同个Http ...
- Linux内核初探
内存管理之内存寻址 内存管理是迄今为止Unix内核中最复杂的活动 虚拟内存: 所有新近的Unix系统都提供一种有用的抽象, 叫作虚拟内存(virtual memory): 虚拟内存可以理解为一种逻辑层 ...
- 手动注册 Omron SYSMAC OPC Server 2
使用如下注册表操作实现 Omron SYSMAC OPC Server 2 的注册,包括COM组件和ProgID. 注意,手动注册适用于在win10等不兼容老版本程序的正常使用的情况,此方法一般在单机 ...
- 通过python脚本和zabbix配合监控zookeeper的节点数
通过python脚本和zabbix配合监控zookeeper的节点数 需求描述: 在日常zabbix监控zookeeper的时候,无法通过shell来获取zookeeper的具体节点信息,没有开放具体 ...
- ASP.NET MVC5高级编程 之 HTML辅助方法
Html属性调用HTML辅助方法,Url属性调用URL辅助方法,Ajax属性调用Ajax辅助方法. HTML辅助方法 1.Html.BeginForm @using (Html.BeginForm(& ...
- jQuery页面滚动底部加载数据
$(window).scroll(function () { var scrollTop = $(this).scrollTop(); var scrollHeight = ...
- 清北学堂 清北-Day1-R2-监听monitor
题目描述 [背景] 不阅读本题的[背景]并不影响通过本题. 三体信息中没有包含对三体⼈⽣物形态的任何描述,⼈类要在四百多年以后才能真正看到三体⼈.在阅读信息时,叶⽂洁只能把三体⼈想象成⼈类的形象. 1 ...