hadoop入门学习整理

• 技术性网站
• 1、http://dongxicheng.org/
• 2、http://www.iteblog.com/
• 3、http://www.cnblogs.com/shishanyuan/p/4147580.html

1、自动编译hadoop源码：http://abloz.com/2013/10/17/compile-hadoop-2-2-0.html  http://www.aboutyun.com/thread-8130-1-1.html

2、安装protocbuf

解压下载的zip包，cd到protobuf的目录下，执行以下指令：
./configure
make
make check
make install

./configure --prefix=/usr/local/protoc

查看版本：protoc --version

遇到问题：

1、protoc: error while loading shared libraries: libprotoc.so.8: cannot open shared

错误原因：
protobuf的默认安装路径是/usr/local/lib，而/usr/local/lib 不在Ubuntu体系默认的 LD_LIBRARY_PATH 里，所以就找不到该lib
解决方法：
1. 创建文件 /etc/ld.so.conf.d/libprotobuf.conf 包含内容：

1. /usr/local/lib

2. 输入命令
sudo ldconfig

2、 Failed to execute goal org.apache.maven.plugins:maven-antrun-plugin:1.6:run (make) on project hadoop-common: An Ant BuildException has occured: Execute failed: java.io.IOException: Cannot run program "cmake" (in directory "

sudo apt-get install cmake

3、Failed to execute goal org.apache.maven.plugins:maven-antrun-plugin:1.6:run (make) on project hadoop-common: An Ant BuildException has occured: exec returned: 1

4、

Unable to load native-hadoop library for your platform... using builtin-java classes where applicable