编译hadoop 2.4.1 源代码以及 libhadoop.so.1.0.0文件
2014-07-23 15:57
267 查看
由于编译到一半突然停电了,导致重新编译一直出错,
http://lucene.472066.n3.nabble.com/Unable-to-load-native-hadoop-library-for-your-platform-td4117072.html
You can build your own distribution that includes native libraries using the following steps:
for RedHat environments, you can probably use a similar yum line:
yum install gcc g++ make maven cmake zlib zlib-devel
There may be some other dependencies or slightly different package names depending on what you already have installed and what OS you are running. If so, some google-able errors will pop up during the rest of the process.
cd /tmp/protobuf
wget http:// protobuf.googlecode.com/files/protobuf-2.5.0.tar.gz
//在国内googlecode访问不了,所以需要预先把protobuf-2.5.0.tar.gz下载下来,然后解压在目标build机器里面。
tar -xvzf ./protobuf-2.5.0.tar.gz
cd protobuf-2.5.0
./configure --prefix=/usr
make
sudo make install
cd java
mvn install
mvn package
sudo ldconfig
cd /tmp
rm -rf protobuf
cd /tmp/hadoop-build
wget http:// apache.petsads.us/hadoop/common/hadoop-2.4.1/hadoop-2.4.1-src.tar.gz
tar -xvzf ./hadoop-2.4.1-src.tar.gz
cd hadoop-2.4.1-src
cd /tmp/hadoop-build/hadoop-2.4.1-src
mvn clean install -DskipTests
cd hadoop-mapreduce-project
mvn package -Pdist,-DskipTests=true -Dtar
cd /tmp/hadoop-build/hadoop-2.2.0-src
mvn package -Pdist,native -DskipTests=true -Dtar
rm -rf hadoop-build
如果中间编译的时候出现问题,可以把/root/.m2/文件夹下面缓存清楚重新编译问题就解决了。
libhadoop.so.1.0.0: ELF 64-bit LSB shared object, x86-64, version 1 (SYSV), dynamically linked, not stripped
结束。
http://lucene.472066.n3.nabble.com/Unable-to-load-native-hadoop-library-for-your-platform-td4117072.html
You can build your own distribution that includes native libraries using the following steps:
1) Install developer tools and dependencies:
1a) From repositories:
apt-get install gcc g++ make maven cmake zlib zlib1g-devfor RedHat environments, you can probably use a similar yum line:
yum install gcc g++ make maven cmake zlib zlib-devel
There may be some other dependencies or slightly different package names depending on what you already have installed and what OS you are running. If so, some google-able errors will pop up during the rest of the process.
1b) Protocol Buffers From Source:
mkdir /tmp/protobufcd /tmp/protobuf
wget http:// protobuf.googlecode.com/files/protobuf-2.5.0.tar.gz
//在国内googlecode访问不了,所以需要预先把protobuf-2.5.0.tar.gz下载下来,然后解压在目标build机器里面。
tar -xvzf ./protobuf-2.5.0.tar.gz
cd protobuf-2.5.0
./configure --prefix=/usr
make
sudo make install
cd java
mvn install
mvn package
sudo ldconfig
cd /tmp
rm -rf protobuf
2) download hadoop source:
mkdir /tmp/hadoop-buildcd /tmp/hadoop-build
wget http:// apache.petsads.us/hadoop/common/hadoop-2.4.1/hadoop-2.4.1-src.tar.gz
tar -xvzf ./hadoop-2.4.1-src.tar.gz
cd hadoop-2.4.1-src
3) Compile it:
export Platform=x64cd /tmp/hadoop-build/hadoop-2.4.1-src
mvn clean install -DskipTests
cd hadoop-mapreduce-project
mvn package -Pdist,-DskipTests=true -Dtar
cd /tmp/hadoop-build/hadoop-2.2.0-src
mvn package -Pdist,native -DskipTests=true -Dtar
4) Copy your natively compiled distribution somewhere to be saved:
cp /tmp/hadoop-build/hadoop-2.4.1-src/hadoop-dist/target/hadoop-2.4.1.tar.gz /my/distribution/share/hadoop-2.4.1.tar.gz5) Delete the build files (once you are satisfied that everything is working properly):
cd /tmprm -rf hadoop-build
如果中间编译的时候出现问题,可以把/root/.m2/文件夹下面缓存清楚重新编译问题就解决了。
6)验证libhadoop.so.1.0.0 文件的版本
在hadoop/lib/native下面输入: file libhadoop.so.1.0.0
libhadoop.so.1.0.0: ELF 64-bit LSB shared object, x86-64, version 1 (SYSV), dynamically linked, not stripped
结束。
相关文章推荐
- fuse挂载hadoop2.0.0文件系统hdfs到本地(关于libhdfs和fuse-dfs的编译)
- caffe记录:编译python时,属性文件里面要添加python相关的lib以及路径
- android NDK编译多个so文件以及mk文件详解
- Linux上编译hadoop-2.7.1的libhdfs.so和libhdfs.a
- android mk文件编译第三方jar、so以及AIDL
- NanoPi—M1(H3)———HAL程序编译、打包进安卓系统镜像以及so文件存放位置
- android下载编译以及文件系统提取总结
- Linux下编译搜索头文件以及库文件的路径
- linux共享库,以及/etc/ld.so.conf文件的应用
- 使你的工程脱离OpenCV安装环境及lib独立编译(源代码编译)
- 在高能BREW平台,编译生成LIB静态库以及使用
- 编译can not open strmbasd.lib文件问题
- Opencv2.0 lib和dll的编译获取过程 以及 vs2005,vs2008配置过程
- linux初学-内核编译以及文件系统2
- android sdk 编译--如何将源代码加入android.jar,以及make原理
- ffmpeg 编译 dll 和 lib 文件
- C#中如何使用头文件(xxxx.h),以及如何将头文件编译成动态链接库(DLL)
- flex 绑定properties文件做国际化,以及ant编译
- linux初学-内核编译以及文件系统1
- 怎样把.c文件编译成.so文件?