2017-11-24 21:20:25

1：什么叫失望，什么叫绝望。总之是一脸懵逼的继续......

之前部署的hadoop都是hadoop-2.4.1.tar.gz，这几天换成了hadoop-2.6.4.tar.gz，部署老生常谈，启动就不一样了，本来吧，也就是warn，不是error，启动hdfs和yarn，节点都可以正常启动，但是对于我这种强迫症，能容忍下面这一大推错误吗？当你看到这篇的时候，显然是不能，虽然网上已经有很多了，但是貌似好多还是不好使。我呢，也算脑补。记录一下。

[root@master hadoop]# start-dfs.sh

// :: WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable

Starting namenodes on [Java HotSpot(TM) Client VM warning: You have loaded library /home/hadoop/soft/hadoop-2.6./lib/native/libhadoop.so.1.0. which might have disabled stack guard. The VM will try to fix the stack guard now.

It's highly recommended that you fix the library with 'execstack -c <libfile>', or link it with '-z noexecstack'.

master]

sed: -e expression #, char : unknown option to `s'

-c: Unknown cipher type 'cd'

master: starting namenode, logging to /home/hadoop/soft/hadoop-2.6./logs/hadoop-root-namenode-master.out

stack: ssh: connect to host stack port : Connection refused

highly: ssh: connect to host highly port : Connection refused

disabled: ssh: connect to host disabled port : Connection refused

Client: ssh: connect to host Client port : Connection refused

Java: ssh: Could not resolve hostname Java: Temporary failure in name resolution

'-z: ssh: Could not resolve hostname '-z: Temporary failure in name resolution

might: ssh: Could not resolve hostname might: Temporary failure in name resolution

now.: ssh: Could not resolve hostname now.: Temporary failure in name resolution

It's: ssh: Could not resolve hostname It's: Temporary failure in name resolution

HotSpot(TM): ssh: Could not resolve hostname HotSpot(TM): Temporary failure in name resolution

it: ssh: Could not resolve hostname it: Temporary failure in name resolution

or: ssh: Could not resolve hostname or: Temporary failure in name resolution

to: ssh: Could not resolve hostname to: Temporary failure in name resolution

fix: ssh: Could not resolve hostname fix: Temporary failure in name resolution

warning:: ssh: Could not resolve hostname warning:: Temporary failure in name resolution

You: ssh: Could not resolve hostname You: Temporary failure in name resolution

<libfile>',: ssh: Could not resolve hostname <libfile>',: Temporary failure in name resolution

fix: ssh: Could not resolve hostname fix: Temporary failure in name resolution

'execstack: ssh: Could not resolve hostname 'execstack: Temporary failure in name resolution

loaded: ssh: Could not resolve hostname loaded: Temporary failure in name resolution

VM: ssh: Could not resolve hostname VM: Temporary failure in name resolution

try: ssh: Could not resolve hostname try: Temporary failure in name resolution

you: ssh: Could not resolve hostname you: Temporary failure in name resolution

link: ssh: Could not resolve hostname link: Temporary failure in name resolution

noexecstack'.: ssh: Could not resolve hostname noexecstack'.: Temporary failure in name resolution

with: ssh: connect to host with port : Connection refused

The: ssh: connect to host The port : Connection refused

that: ssh: Could not resolve hostname that: Temporary failure in name resolution

recommended: ssh: Could not resolve hostname recommended: Temporary failure in name resolution

have: ssh: Could not resolve hostname have: Temporary failure in name resolution

will: ssh: Could not resolve hostname will: Temporary failure in name resolution

VM: ssh: Could not resolve hostname VM: Temporary failure in name resolution

library: ssh: Could not resolve hostname library: Temporary failure in name resolution

with: ssh: Could not resolve hostname with: Temporary failure in name resolution

guard: ssh: Could not resolve hostname guard: Temporary failure in name resolution

the: ssh: connect to host the port : Connection refused

have: ssh: connect to host have port : Connection refused

stack: ssh: connect to host stack port : Connection refused

library: ssh: connect to host library port : Connection refused

the: ssh: connect to host the port : Connection refused

guard.: ssh: connect to host guard. port : Connection refused

which: ssh: connect to host which port : Connection refused

master: starting datanode, logging to /home/hadoop/soft/hadoop-2.6./logs/hadoop-root-datanode-master.out

slaver1: starting datanode, logging to /home/hadoop/soft/hadoop-2.6./logs/hadoop-root-datanode-slaver1.out

slaver2: starting datanode, logging to /home/hadoop/soft/hadoop-2.6./logs/hadoop-root-datanode-slaver2.out

Starting secondary namenodes [Java HotSpot(TM) Client VM warning: You have loaded library /home/hadoop/soft/hadoop-2.6./lib/native/libhadoop.so.1.0. which might have disabled stack guard. The VM will try to fix the stack guard now.

It's highly recommended that you fix the library with 'execstack -c <libfile>', or link it with '-z noexecstack'.

master]

sed: -e expression #, char : unknown option to `s'

-c: Unknown cipher type 'cd'

master: starting secondarynamenode, logging to /home/hadoop/soft/hadoop-2.6./logs/hadoop-root-secondarynamenode-master.out

Client: ssh: connect to host Client port : Connection refused

recommended: ssh: connect to host recommended port : Connection refused

VM: ssh: connect to host VM port : Connection refused

VM: ssh: connect to host VM port : Connection refused

stack: ssh: connect to host stack port : Connection refused

disabled: ssh: connect to host disabled port : Connection refused

guard.: ssh: connect to host guard. port : Connection refused

library: ssh: connect to host library port : Connection refused

stack: ssh: connect to host stack port : Connection refused

you: ssh: Could not resolve hostname you: Temporary failure in name resolution

HotSpot(TM): ssh: Could not resolve hostname HotSpot(TM): Temporary failure in name resolution

warning:: ssh: Could not resolve hostname warning:: Temporary failure in name resolution

to: ssh: Could not resolve hostname to: Temporary failure in name resolution

You: ssh: Could not resolve hostname You: Temporary failure in name resolution

'execstack: ssh: Could not resolve hostname 'execstack: Temporary failure in name resolution

<libfile>',: ssh: Could not resolve hostname <libfile>',: Temporary failure in name resolution

Java: ssh: Could not resolve hostname Java: Temporary failure in name resolution

link: ssh: Could not resolve hostname link: Temporary failure in name resolution

It's: ssh: Could not resolve hostname It's: Temporary failure in name resolution

noexecstack'.: ssh: Could not resolve hostname noexecstack'.: Temporary failure in name resolution

it: ssh: Could not resolve hostname it: Temporary failure in name resolution

'-z: ssh: Could not resolve hostname '-z: Temporary failure in name resolution

with: ssh: connect to host with port : Connection refused

loaded: ssh: connect to host loaded port : Connection refused

that: ssh: connect to host that port : Connection refused

have: ssh: connect to host have port : Connection refused

try: ssh: Could not resolve hostname try: Temporary failure in name resolution

which: ssh: connect to host which port : Connection refused

have: ssh: connect to host have port : Connection refused

fix: ssh: connect to host fix port : Connection refused

the: ssh: connect to host the port : Connection refused

guard: ssh: connect to host guard port : Connection refused

highly: ssh: connect to host highly port : Connection refused

library: ssh: connect to host library port : Connection refused

fix: ssh: connect to host fix port : Connection refused

now.: ssh: Could not resolve hostname now.: Temporary failure in name resolution

The: ssh: connect to host The port : Connection refused

the: ssh: connect to host the port : Connection refused

will: ssh: connect to host will port : Connection refused

with: ssh: connect to host with port : Connection refused

or: ssh: connect to host or port : Connection refused

might: ssh: connect to host might port : Connection refused

// :: WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable

[root@master hadoop]# jps

 DataNode

 Jps

 SecondaryNameNode

 NameNode

[root@master hadoop]#

上面是启动dfs的时候报的，下面是关闭dfs的时候报的：

[root@master hadoop]# stop-dfs.sh

// :: WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable

Stopping namenodes on [Java HotSpot(TM) Client VM warning: You have loaded library /home/hadoop/soft/hadoop-2.6./lib/native/libhadoop.so.1.0. which might have disabled stack guard. The VM will try to fix the stack guard now.

It's highly recommended that you fix the library with 'execstack -c <libfile>', or link it with '-z noexecstack'.

master]

sed: -e expression #, char : unknown option to `s'

-c: Unknown cipher type 'cd'

master: stopping namenode

loaded: ssh: connect to host loaded port : Connection refused

library: ssh: connect to host library port : Connection refused

recommended: ssh: connect to host recommended port : Connection refused

might: ssh: connect to host might port : Connection refused

HotSpot(TM): ssh: Could not resolve hostname HotSpot(TM): Temporary failure in name resolution

noexecstack'.: ssh: Could not resolve hostname noexecstack'.: Temporary failure in name resolution

it: ssh: Could not resolve hostname it: Temporary failure in name resolution

You: ssh: Could not resolve hostname You: Temporary failure in name resolution

<libfile>',: ssh: Could not resolve hostname <libfile>',: Temporary failure in name resolution

warning:: ssh: Could not resolve hostname warning:: Temporary failure in name resolution

link: ssh: Could not resolve hostname link: Temporary failure in name resolution

now.: ssh: Could not resolve hostname now.: Temporary failure in name resolution

you: ssh: Could not resolve hostname you: Temporary failure in name resolution

'-z: ssh: Could not resolve hostname '-z: Temporary failure in name resolution

It's: ssh: Could not resolve hostname It's: Temporary failure in name resolution

'execstack: ssh: Could not resolve hostname 'execstack: Temporary failure in name resolution

fix: ssh: connect to host fix port : Connection refused

the: ssh: connect to host the port : Connection refused

with: ssh: connect to host with port : Connection refused

to: ssh: Could not resolve hostname to: Temporary failure in name resolution

Java: ssh: Could not resolve hostname Java: Temporary failure in name resolution

with: ssh: connect to host with port : Connection refused

have: ssh: connect to host have port : Connection refused

library: ssh: connect to host library port : Connection refused

disabled: ssh: connect to host disabled port : Connection refused

stack: ssh: connect to host stack port : Connection refused

VM: ssh: connect to host VM port : Connection refused

The: ssh: connect to host The port : Connection refused

which: ssh: connect to host which port : Connection refused

Client: ssh: connect to host Client port : Connection refused

will: ssh: connect to host will port : Connection refused

try: ssh: connect to host try port : Connection refused

guard.: ssh: connect to host guard. port : Connection refused

stack: ssh: connect to host stack port : Connection refused

highly: ssh: connect to host highly port : Connection refused

have: ssh: connect to host have port : Connection refused

VM: ssh: connect to host VM port : Connection refused

the: ssh: connect to host the port : Connection refused

guard: ssh: connect to host guard port : Connection refused

that: ssh: connect to host that port : Connection refused

or: ssh: connect to host or port : Connection refused

fix: ssh: connect to host fix port : Connection refused

slaver2: stopping datanode

slaver1: stopping datanode

master: stopping datanode

Stopping secondary namenodes [Java HotSpot(TM) Client VM warning: You have loaded library /home/hadoop/soft/hadoop-2.6./lib/native/libhadoop.so.1.0. which might have disabled stack guard. The VM will try to fix the stack guard now.

It's highly recommended that you fix the library with 'execstack -c <libfile>', or link it with '-z noexecstack'.

master]

sed: -e expression #, char : unknown option to `s'

-c: Unknown cipher type 'cd'

master: stopping secondarynamenode

Client: ssh: Could not resolve hostname Client: Temporary failure in name resolution

You: ssh: Could not resolve hostname You: Temporary failure in name resolution

Java: ssh: Could not resolve hostname Java: Temporary failure in name resolution

have: ssh: Could not resolve hostname have: Temporary failure in name resolution

loaded: ssh: Could not resolve hostname loaded: Temporary failure in name resolution

library: ssh: Could not resolve hostname library: Temporary failure in name resolution

have: ssh: Could not resolve hostname have: Temporary failure in name resolution

disabled: ssh: Could not resolve hostname disabled: Temporary failure in name resolution

The: ssh: Could not resolve hostname The: Temporary failure in name resolution

highly: ssh: Could not resolve hostname highly: Temporary failure in name resolution

try: ssh: Could not resolve hostname try: Temporary failure in name resolution

warning:: ssh: Could not resolve hostname warning:: Temporary failure in name resolution

guard: ssh: Could not resolve hostname guard: Temporary failure in name resolution

which: ssh: Could not resolve hostname which: Temporary failure in name resolution

stack: ssh: Could not resolve hostname stack: Temporary failure in name resolution

recommended: ssh: Could not resolve hostname recommended: Temporary failure in name resolution

the: ssh: Could not resolve hostname the: Temporary failure in name resolution

will: ssh: Could not resolve hostname will: Temporary failure in name resolution

It's: ssh: Could not resolve hostname It's: Temporary failure in name resolution

stack: ssh: Could not resolve hostname stack: Temporary failure in name resolution

now.: ssh: Could not resolve hostname now.: Temporary failure in name resolution

library: ssh: Could not resolve hostname library: Temporary failure in name resolution

fix: ssh: Could not resolve hostname fix: Temporary failure in name resolution

that: ssh: Could not resolve hostname that: Temporary failure in name resolution

with: ssh: Could not resolve hostname with: Temporary failure in name resolution

to: ssh: Could not resolve hostname to: Temporary failure in name resolution

'-z: ssh: Could not resolve hostname '-z: Temporary failure in name resolution

<libfile>',: ssh: Could not resolve hostname <libfile>',: Temporary failure in name resolution

it: ssh: Could not resolve hostname it: Temporary failure in name resolution

VM: ssh: Could not resolve hostname VM: Temporary failure in name resolution

the: ssh: Could not resolve hostname the: Temporary failure in name resolution

'execstack: ssh: Could not resolve hostname 'execstack: Temporary failure in name resolution

or: ssh: Could not resolve hostname or: Temporary failure in name resolution

link: ssh: Could not resolve hostname link: Temporary failure in name resolution

you: ssh: Could not resolve hostname you: Temporary failure in name resolution

noexecstack'.: ssh: Could not resolve hostname noexecstack'.: Temporary failure in name resolution

HotSpot(TM): ssh: Could not resolve hostname HotSpot(TM): Temporary failure in name resolution

fix: ssh: Could not resolve hostname fix: Temporary failure in name resolution

VM: ssh: Could not resolve hostname VM: Temporary failure in name resolution

might: ssh: Could not resolve hostname might: Temporary failure in name resolution

with: ssh: Could not resolve hostname with: Temporary failure in name resolution

guard.: ssh: connect to host guard. port : Connection refused

// :: WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable

[root@master hadoop]#

待续.......

2：出错，解决不了，百度呗，这里贴出来，我准备百度参考的文章，不知道能不能成功呢，先记录一下，因为那是2015年，距今2年了。

http://blog.csdn.net/young_kim1/article/details/50324345

http://blog.csdn.net/young_kim1/article/details/50269501

此两篇是上下篇，希望可以帮到以后遇到这个问题的人。

3：为什么出现这个问题呢：

提示hadoop不能加载本地库。

以前官网会提供32位的安装包，但目前提供的下载包为64位的，在linux 32位系统下安装后会一直提示错误“WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform… using builtin-java classes where applicable ”，但官网又不提供32位系统下的安装包，所以我们只能自己编译打包源码。

首先看下自己的虚拟机是多少位的吧：

# uname -i

通过以上命令获取系统版本，

然后呢到

大家可以到cd /home/hadoop/soft/hadoop-2.6.4/lib/native下，查看文件libhadoop.so.1.0.0，里面会显示Hadoop的位数，官网下载好的显示是64位的，截图如下：

4：有耐心的可以根据上面的网址操作，已经写的很详细了，这里不作多叙述，直接将lib下面的native贴出来，如果你的linux是32位的，直接替换你的/lib/native即可。替换过后再查看，如下所示：

替换的32位的lib/native包：http://download.csdn.net/download/biexiansheng/10132053

启动和关闭的时候也不warn了：

停更......

2017-11-24 22:02:20

17/11/24 05:08:44 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable的更多相关文章

  1. 解决讨厌的警告 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable

    问题: 执行任何hadoop命令,都会提示如下WARN.虽然影响不大,但是每次运行一个命令都有这么个WARN,让人很不爽,作为一个精致的男人, 必须要干掉它. [root@master logs]# ...

  2. Hadoop _ 疑难杂症 解决1 - WARN util.NativeCodeLoader: Unable to load native-hadoop library for your plat

    最近博主在进行Hive测试 压缩解压缩的时候 遇到了这个问题, 该问题也常出现在日常 hdfs 指令中, 在启动服务 与 hdfs dfs 执行指令的时候 : 都会显示该提示,下面描述下该问题应该如何 ...

  3. hadoop报错WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable

    19/06/14 10:44:58 WARN common.Util: Path /opt/hadoopdata/hdfs/name should be specified as a URI in c ...

  4. Hadoop问题解决：WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable

    在配置好hadoop的环境之后,命令启动./start-all.sh发现经常出现这样的一个警告: WARN util.NativeCodeLoader: Unable to load native-h ...

  5. WARN util.NativeCodeLoader: Unable to load native-hadooplibrary for your platform… using builtin-java classes where applicable

    方法1glibc 官方要求的2.14版本以上 方法2:http://www.secdoctor.com/html/yyjs/31101.html 方法3: http://dl.bintray.com/ ...

  6. [hadoop] WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable

    hadoop 启动后,有警告信息: WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform ...

  7. Hadoop集群“WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable”解决办法

    Hadoop集群部署完成后,经常会提示 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platfo ...

  8. HADOOP:WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable终于解决了

    WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin- ...

  9. WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable Exception in thread "main" java.io.IOException: No FileSystem for sc F

    1.执行脚本程序报如下所示的错误: [hadoop@slaver1 script_hadoop]$ hadoop jar web_click_mr_hive.jar com.bie.hive.mr.C ...

随机推荐

  1. C++游戏开发需要阅读的书籍

    如果要自学游戏程序开发的话,可以看看下面的,呵呵. 游戏开发资料(PDF书都是中文版的,非英文,很多是本人自己扫描制作,从未网上发布过,所以独家啦):  1.Gamebryo 2.2游戏引擎(盛大.腾 ...

  2. 【Linux】Swap与Memory

    背景介绍 Memory指机器物理内存,读写速度低于CPU一个量级,但是高于磁盘不止一个量级.所以,程序和数据如果在内存的话,会有非常快的读写速度.但是,内存的造价是要高于磁盘的,且内存的断电丢失数据也 ...

  3. BZOJ 3620： 似乎在梦中见过的样子

    似乎在梦中见过的样子.... 一道水题调了这么久,还半天想不出来怎么 T 的...佩服自己(果然蒟蒻) 这题想想 KMP 但是半天没思路瞟了一眼题解发现暴力枚举起始点,然后 KMP 如图: O( n2 ...

  4. C# AutoResetEvent 使用整理

    AutoResetEvent 允许线程通过发信号互相通信.通常,此通信涉及线程需要独占访问的资源. 线程通过调用 AutoResetEvent 上的 WaitOne 来等待信号.如果 AutoRese ...

  5. css清除浏览器默认样式

    css清除浏览器默认样式(代替 *{}) 将代码放入 css 文件,使用 link 引入. /* v2.0 | 20110126 http://meyerweb.com/eric/tools/css/ ...

  6. 11)django-ORM(操作增删改查)

    ORM从增删改查等方面说明 一:创建数据 #创建数据两种方式1,推荐方式1 UserInfo.objects.create(username=") #方式1变种 user_dict={&qu ...

  7. 什么是orm思想？

    什么是orm思想? 1.hibernate使用orm思想对数据库进行crud操作 2.在web阶段学习javabean更正确的叫法是:实体类 3.orm: object   relational   ...

  8. Confluence 6 重构查找索引

    查找索引是自动维护的,但是你有时候可能会因为你在查找的时候或查看者邮件主题出现了异常,或者你的 Confluence 实例升级到了新的版本,你可能需要手动重构索引. 进行搜索索引重构: 在屏幕的右上角 ...

  9. Python查找最新测试报告到邮件功能

    #coding=utf-8 import smtplib from email.mime.text import MIMEText import unittest import HTMLTestRun ...

  10. python用unittest+HTMLTestRunner+csv的框架测试并生成测试报告

    直接贴代码: import csv  # 导入scv库,可以读取csv文件from selenium import webdriverimport unittestfrom time import s ...