关于PHP读取HDFS的错误记录
2013-03-21 12:51
357 查看
昨日实现了用java对HDFS的操作(创建、删除、重命名目录,创建、删除、重命名文件),今天打算用php实现对HDFS的同样操作。
大体步骤如下:
在修改了/tmp/hadoop-1.0.4/src/contrib/thriftfs/scripts/start_thrift_server.sh文件中对TOP和CLASSPATH行后,甚至更换了thrift版本到0.2.0依然出现如下错误(运行上述21行的结果)。
从网上查找了一些方法(其中包括修改/tmp/hadoop-1.0.4/conf/log4j.properties文件,把log4j.appender.EventCounter=org.apache.hadoop.log.metrics.EventCounter替换成log4j.appender.EventCounter=org.apache.hadoop.log.metrics.jvm.EventCounter)试了试都不行。
既然别人的可以,自己的却不可以。那就要考虑软件环境问题了。与承载Hadoop的操作系统应该是关系不大。可能的就是Hadoop的版本和java SDK的版本了。本文出自 “通信,我的最爱” 博客,请务必保留此出处http://dgd2010.blog.51cto.com/1539422/1159468
大体步骤如下:
wget https://dist.apache.org/repos/dist/release/thrift/0.9.0/thrift-0.9.0.tar.gz tar zxvf thrift-0.9.0.tar.gz cd thrift-0.9.0 find / -name 'bootstrap.sh' yum install automake libtool flex bison pkgconfig gcc-c++ boost-devel libevent-devel zlib-devel python-devel ruby-devel /tmp/thrift-0.9.0/contrib/fb303/bootstrap.sh ./configure -prefix=/usr/local/thrift make //安装期间网络不可中断 make install cp -R ./lib/php/ /usr/local/thrift/lib/ cp -R /tmp/hadoop-1.0.4/src/contrib/thriftfs/gen-php/ /usr/local/thrift/lib/php/src/packages/hadoopfs/ cd ./lib/php/src/ext/thrift_protocol/ yum install php-devel /usr/bin/phpize ./configure make make test make install vim /etc/php.ini cd /tmp/hadoop-1.0.4/src/contrib/thriftfs/scripts/ /tmp/hadoop-1.0.4/src/contrib/thriftfs/scripts/start_thrift_server.sh
在修改了/tmp/hadoop-1.0.4/src/contrib/thriftfs/scripts/start_thrift_server.sh文件中对TOP和CLASSPATH行后,甚至更换了thrift版本到0.2.0依然出现如下错误(运行上述21行的结果)。
[root@srv211 hadoop-1.0.4]# /tmp/hadoop-1.0.4/src/contrib/thriftfs/scripts/start_thrift_server.sh 59256 log4j:ERROR Could not instantiate class [org.apache.hadoop.log.metrics.EventCounter]. java.lang.ClassNotFoundException: org.apache.hadoop.log.metrics.EventCounter at java.net.URLClassLoader$1.run(URLClassLoader.java:366) at java.net.URLClassLoader$1.run(URLClassLoader.java:355) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:354) at java.lang.ClassLoader.loadClass(ClassLoader.java:423) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308) at java.lang.ClassLoader.loadClass(ClassLoader.java:356) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:186) at org.apache.log4j.helpers.Loader.loadClass(Loader.java:179) at org.apache.log4j.helpers.OptionConverter.instantiateByClassName(OptionConverter.java:320) at org.apache.log4j.helpers.OptionConverter.instantiateByKey(OptionConverter.java:121) at org.apache.log4j.PropertyConfigurator.parseAppender(PropertyConfigurator.java:664) at org.apache.log4j.PropertyConfigurator.parseCategory(PropertyConfigurator.java:647) at org.apache.log4j.PropertyConfigurator.configureRootCategory(PropertyConfigurator.java:544) at org.apache.log4j.PropertyConfigurator.doConfigure(PropertyConfigurator.java:440) at org.apache.log4j.PropertyConfigurator.doConfigure(PropertyConfigurator.java:476) at org.apache.log4j.helpers.OptionConverter.selectAndConfigure(OptionConverter.java:471) at org.apache.log4j.LogManager.<clinit>(LogManager.java:125) at org.apache.log4j.Logger.getLogger(Logger.java:105) at org.apache.commons.logging.impl.Log4JLogger.getLogger(Log4JLogger.java:289) at org.apache.commons.logging.impl.Log4JLogger.<init>(Log4JLogger.java:109) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:525) at org.apache.commons.logging.impl.LogFactoryImpl.createLogFromClass(LogFactoryImpl.java:1116) at org.apache.commons.logging.impl.LogFactoryImpl.discoverLogImplementation(LogFactoryImpl.java:914) at org.apache.commons.logging.impl.LogFactoryImpl.newInstance(LogFactoryImpl.java:604) at org.apache.commons.logging.impl.LogFactoryImpl.getInstance(LogFactoryImpl.java:336) at org.apache.commons.logging.LogFactory.getLog(LogFactory.java:704) at org.apache.hadoop.thriftfs.HadoopThriftServer$HadoopThriftHandler.<clinit>(HadoopThriftServer.java:41) at org.apache.hadoop.thriftfs.HadoopThriftServer.<init>(HadoopThriftServer.java:592) at org.apache.hadoop.thriftfs.HadoopThriftServer.main(HadoopThriftServer.java:612) log4j:ERROR Could not instantiate appender named "EventCounter". Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/hadoop/conf/Configuration at org.apache.hadoop.thriftfs.HadoopThriftServer$HadoopThriftHandler.<init>(HadoopThriftServer.java:125) at org.apache.hadoop.thriftfs.HadoopThriftServer.<init>(HadoopThriftServer.java:592) at org.apache.hadoop.thriftfs.HadoopThriftServer.main(HadoopThriftServer.java:612) Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.conf.Configuration at java.net.URLClassLoader$1.run(URLClassLoader.java:366) at java.net.URLClassLoader$1.run(URLClassLoader.java:355) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:354) at java.lang.ClassLoader.loadClass(ClassLoader.java:423) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308) at java.lang.ClassLoader.loadClass(ClassLoader.java:356) ... 3 more [root@srv211 hadoop-1.0.4]#
从网上查找了一些方法(其中包括修改/tmp/hadoop-1.0.4/conf/log4j.properties文件,把log4j.appender.EventCounter=org.apache.hadoop.log.metrics.EventCounter替换成log4j.appender.EventCounter=org.apache.hadoop.log.metrics.jvm.EventCounter)试了试都不行。
既然别人的可以,自己的却不可以。那就要考虑软件环境问题了。与承载Hadoop的操作系统应该是关系不大。可能的就是Hadoop的版本和java SDK的版本了。本文出自 “通信,我的最爱” 博客,请务必保留此出处http://dgd2010.blog.51cto.com/1539422/1159468
相关文章推荐
- 关于 Apache 2.4 配置PHP时的错误记录
- 关于PHP错误日志不记录的问题
- 关于php多线程的记录
- 利用Flash AS2.0实现读取php xml数据和插入记录
- 记录PHP错误日志
- Andriod相机开发关于startPreview Failed的错误的特别记录(重要)
- 控制PHP的错误输出方式:直接输出至荧幕或将错误信息记录到错误日志文件内
- 关于mybatis tomcat 和jetty启动报 {dataSource-1} inited 错误的记录
- 学习记录:php显示错误信息
- 记录PHP错误日志 display_errors与log_errors的区别
- PHP记录和读取JSON格式日志文件
- 关于win10 php环境配置后运行php文件出现HTTP 错误 401.3 - Unauthorized的解决方法
- PHP 错误记录1
- 关于php中header()、setcookie()、session_start()函数错误的解决方法和解释
- php 错误记录以及查看方式
- 关于PHP打开之后找不到数据库问题的记录
- PHP关于Cookie的创建、抓包和记录
- 关于NGINX下开启PHP-FPM 输出PHP错误日志的设置(已解决)
- [错误记录]关于指针传递获得数据使用错误问题....
- 关于用php读取excl表格列超过Z后的解决方法