spark shell启动警告 Unable to load native-hadoop library for your platform
2017-11-30 22:04
676 查看
Hadoop版本:2.7.3
Spark版本:2.1.2
原因:spark预先编译的hadoop版本为32位的,放在64位的机器上执行会报这个错误,解决办法
办法一:亲测有效
cd /usr/local/spark/conf
切换到spark的conf目录下
cp spark-env.sh.template spark-env.sh
将 spark-env.sh.template 复制为spark-env.sh
sudo gedit spark-env.sh
在spark-env.sh文件中加入LD_LIBRARY_PATH环境变量LD_LIBRARY_PATH=$HADOOP_HOME/lib/native
办法二、
在 ~/.bashrc 设置一下 export LD_LIBRARY_PATH=$HADOOP_HOME/lib/native
参考
http://blog.csdn.net/woshiren123ew/article/details/65447909
Spark版本:2.1.2
原因:spark预先编译的hadoop版本为32位的,放在64位的机器上执行会报这个错误,解决办法
办法一:亲测有效
cd /usr/local/spark/conf
切换到spark的conf目录下
cp spark-env.sh.template spark-env.sh
将 spark-env.sh.template 复制为spark-env.sh
sudo gedit spark-env.sh
在spark-env.sh文件中加入LD_LIBRARY_PATH环境变量LD_LIBRARY_PATH=$HADOOP_HOME/lib/native
办法二、
在 ~/.bashrc 设置一下 export LD_LIBRARY_PATH=$HADOOP_HOME/lib/native
参考
http://blog.csdn.net/woshiren123ew/article/details/65447909
相关文章推荐
- spark 启动时候报 Unable to load native-hadoop library for your platform 警告
- spark集群进入 bin 下面目录./spark-shell 出现Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
- spark执行的时候报Unable to load native-hadoop library for your platform警告
- 使用hadoop命令警告提示:Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
- hadoop-2.7.1启动Unable to load native-hadoop library for your platform问题解决
- hadoop2.x部署警告:Unable to load native-hadoop library for your platform
- hadoop-2.2.0警告 (Unable to loadnative-hadoop library for your platform... using ...)
- 启动Hadoop时,出现错误:Unable to load native-hadoop library for your platform
- Hadoop 2.7.2启动WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform...
- 解决 hadoop 命令警告 Unable to load native-hadoop library for your platform...
- 搭建基于hadoop 2.2.0的分布式集群启动时出现 "Unable to load native-hadoop library for your platform" 的解决方案
- 警告 “util.NativeCodeLoader: Unable to load native-hadoop library for your platform”
- hadoop “util.NativeCodeLoader: Unable to load native-hadoop library for your platform”
- 异常解决:util.NativeCodeLoader: Unable to load native-hadoop library for your platform
- Unable to load native-hadoop library for your platform解决
- WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform...
- WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform
- Hadoop WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using b
- 解决 Unable to load native-hadoop library for your platform
- Unable to load native-hadoop library for your platform... using builtin-Java classes where applicable