spring-data-hadoop 配置 hbase 问题汇总
2016-05-26 18:23
459 查看
版本信息:
1. hbase :1.2.1 (hbase版本对应hadoop版本详细可去官网查 : http://hbase.apache.org/book.html#basic.prerequisites)
2. spring-data-hadoop :2.2.1 (spring-data-hadoop对应hadoop详细可去查找spring官网查找对用版本的spring-data-hadoop的 reference 的Requirements,如:地址:http://docs.spring.io/spring-hadoop/docs/2.3.0.RELEASE/reference/html/requirements.html
异常信息:(以下异常解决所需jar版本是对应hbase 和 hadoop的,异常出现并不准确按照以下顺序,是后期整理的结果)
1. java.lang.ClassNotFoundException: org.apache.hadoop.conf.Configuration
2. java.lang.ClassNotFoundException: com.google.common.base.Preconditions
缺少guava-12.0.1.jar
3. java.lang.ClassNotFoundException: org.apache.hadoop.mapred.JobConf
缺少hadoop-mapreduce-client-core-2.5.1.jar
4. java.lang.ClassNotFoundException: com.google.protobuf.RpcChannel
5. java.lang.ClassNotFoundException: org.apache.commons.configuration.Configuration
6. java.lang.ClassNotFoundException: org.apache.hadoop.util.PlatformName
7. java.lang.ClassNotFoundException: org.apache.hadoop.hbase.protobuf.generated.MasterProtos$MasterService$BlockingInterface
8. java.lang.ClassNotFoundException: org.apache.zookeeper.KeeperException
9. java.lang.ClassNotFoundException: org.apache.htrace.Trace
10. java.lang.ClassNotFoundException: io.netty.channel.EventLoopGroup
11. java.lang.VerifyError: class org.apache.hadoop.hbase.protobuf.generated.ClientProtos$Result overrides final method getUnknownFields. ()Lcom/google/protobuf/UnknownFieldSet;
1. hbase :1.2.1 (hbase版本对应hadoop版本详细可去官网查 : http://hbase.apache.org/book.html#basic.prerequisites)
2. spring-data-hadoop :2.2.1 (spring-data-hadoop对应hadoop详细可去查找spring官网查找对用版本的spring-data-hadoop的 reference 的Requirements,如:地址:http://docs.spring.io/spring-hadoop/docs/2.3.0.RELEASE/reference/html/requirements.html
异常信息:(以下异常解决所需jar版本是对应hbase 和 hadoop的,异常出现并不准确按照以下顺序,是后期整理的结果)
1. java.lang.ClassNotFoundException: org.apache.hadoop.conf.Configuration
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.conf.Configuration at java.net.URLClassLoader$1.run(URLClassLoader.java:366) at java.net.URLClassLoader$1.run(URLClassLoader.java:355) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:354) at java.lang.ClassLoader.loadClass(ClassLoader.java:423) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308) at java.lang.ClassLoader.loadClass(ClassLoader.java:356) ... 18 more缺少hadoop-common-2.5.1.jar
2. java.lang.ClassNotFoundException: com.google.common.base.Preconditions
Caused by: java.lang.ClassNotFoundException: com.google.common.base.Preconditions at java.net.URLClassLoader$1.run(URLClassLoader.java:366) at java.net.URLClassLoader$1.run(URLClassLoader.java:355) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:354) at java.lang.ClassLoader.loadClass(ClassLoader.java:423) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308) at java.lang.ClassLoader.loadClass(ClassLoader.java:356) ... 24 more
缺少guava-12.0.1.jar
3. java.lang.ClassNotFoundException: org.apache.hadoop.mapred.JobConf
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.mapred.JobConf at java.net.URLClassLoader$1.run(URLClassLoader.java:366) at java.net.URLClassLoader$1.run(URLClassLoader.java:355) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:354) at java.lang.ClassLoader.loadClass(ClassLoader.java:423) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308) at java.lang.ClassLoader.loadClass(ClassLoader.java:356) ... 20 more
缺少hadoop-mapreduce-client-core-2.5.1.jar
4. java.lang.ClassNotFoundException: com.google.protobuf.RpcChannel
Caused by: java.lang.ClassNotFoundException: com.google.protobuf.RpcChannel at java.net.URLClassLoader$1.run(URLClassLoader.java:366) at java.net.URLClassLoader$1.run(URLClassLoader.java:355) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:354) at java.lang.ClassLoader.loadClass(ClassLoader.java:423) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308) at java.lang.ClassLoader.loadClass(ClassLoader.java:356) ... 23 more缺少protobuf-java-2.5.0.jar
5. java.lang.ClassNotFoundException: org.apache.commons.configuration.Configuration
Caused by: java.lang.ClassNotFoundException: org.apache.commons.configuration.Configuration at java.net.URLClassLoader$1.run(URLClassLoader.java:366) at java.net.URLClassLoader$1.run(URLClassLoader.java:355) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:354) at java.lang.ClassLoader.loadClass(ClassLoader.java:423) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308) at java.lang.ClassLoader.loadClass(ClassLoader.java:356) ... 22 more缺少commons-configuration-1.6.jar
6. java.lang.ClassNotFoundException: org.apache.hadoop.util.PlatformName
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.util.PlatformName at java.net.URLClassLoader$1.run(URLClassLoader.java:366) at java.net.URLClassLoader$1.run(URLClassLoader.java:355) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:354) at java.lang.ClassLoader.loadClass(ClassLoader.java:423) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308) at java.lang.ClassLoader.loadClass(ClassLoader.java:356) ... 20 more缺少hadoop-auth-2.5.1.jar
7. java.lang.ClassNotFoundException: org.apache.hadoop.hbase.protobuf.generated.MasterProtos$MasterService$BlockingInterface
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hbase.protobuf.generated.MasterProtos$MasterService$BlockingInterface at java.net.URLClassLoader$1.run(URLClassLoader.java:366) at java.net.URLClassLoader$1.run(URLClassLoader.java:355) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:354) at java.lang.ClassLoader.loadClass(ClassLoader.java:423) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308) at java.lang.ClassLoader.loadClass(ClassLoader.java:356) ... 31 more缺少hbase-protocol-1.2.1.jar
8. java.lang.ClassNotFoundException: org.apache.zookeeper.KeeperException
Caused by: java.lang.ClassNotFoundException: org.apache.zookeeper.KeeperException at java.net.URLClassLoader$1.run(URLClassLoader.java:366) at java.net.URLClassLoader$1.run(URLClassLoader.java:355) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:354) at java.lang.ClassLoader.loadClass(ClassLoader.java:423) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308) at java.lang.ClassLoader.loadClass(ClassLoader.java:356) ... 19 more缺少zookeeper-3.4.6.jar
9. java.lang.ClassNotFoundException: org.apache.htrace.Trace
Caused by: java.lang.ClassNotFoundException: org.apache.htrace.Trace at java.net.URLClassLoader$1.run(URLClassLoader.java:366) at java.net.URLClassLoader$1.run(URLClassLoader.java:355) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:354) at java.lang.ClassLoader.loadClass(ClassLoader.java:423) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308) at java.lang.ClassLoader.loadClass(ClassLoader.java:356) ... 27 more缺少htrace-core-3.1.0-incubating.jar
10. java.lang.ClassNotFoundException: io.netty.channel.EventLoopGroup
Caused by: java.lang.ClassNotFoundException: io.netty.channel.EventLoopGroup at java.net.URLClassLoader$1.run(URLClassLoader.java:366) at java.net.URLClassLoader$1.run(URLClassLoader.java:355) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:354) at java.lang.ClassLoader.loadClass(ClassLoader.java:423) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308) at java.lang.ClassLoader.loadClass(ClassLoader.java:356) ... 28 more缺少netty-all-4.0.23.Final.jar
11. java.lang.VerifyError: class org.apache.hadoop.hbase.protobuf.generated.ClientProtos$Result overrides final method getUnknownFields. ()Lcom/google/protobuf/UnknownFieldSet;
Caused by: java.lang.VerifyError: class org.apache.hadoop.hbase.protobuf.generated.ClientProtos$Result overrides final method getUnknownFields.()Lcom/google/protobuf/UnknownFieldSet; at java.lang.ClassLoader.defineClass1(Native Method) at java.lang.ClassLoader.defineClass(ClassLoader.java:791) at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142) at java.net.URLClassLoader.defineClass(URLClassLoader.java:449) at java.net.URLClassLoader.access$100(URLClassLoader.java:71) at java.net.URLClassLoader$1.run(URLClassLoader.java:361) at java.net.URLClassLoader$1.run(URLClassLoader.java:355) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:354) at java.lang.ClassLoader.loadClass(ClassLoader.java:423) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308) at java.lang.ClassLoader.loadClass(ClassLoader.java:356) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.<clinit>(ProtobufUtil.java:212) at org.apache.hadoop.hbase.ClusterId.parseFrom(ClusterId.java:64) at org.apache.hadoop.hbase.zookeeper.ZKClusterId.readClusterIdZNode(ZKClusterId.java:75) at org.apache.hadoop.hbase.client.ZooKeeperRegistry.getClusterId(ZooKeeperRegistry.java:105) at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.retrieveClusterId(ConnectionManager.java:905) at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.<init>(ConnectionManager.java:648) ... 21 more这个比较坑,实际上是版本冲突了。但是protobuf-java版本是对应的2.5且以引入,还是有这错误。找了一会发现,项目里已经引用了2.4的protobuf-java ,删除2.4的即可。
相关文章推荐
- Java基础---I/O流
- java中Atomic类之AtomicBoolean
- java中Atomic类之AtomicBoolean
- 走过路过不要错过~教你用java抓取网页中你想要的东东~~
- iOS客户端、java服务器的通信用RSA加密
- java50中经典算法
- 如何使用JAVA语言抓取某个网页中的邮箱地址
- Java之父、子实例的内存控制
- java单例模式
- HDU2083JAVA
- spring mvc3 + fastjson
- Android——Android Sutido:[2]导入eclipse项目篇
- liunx 系统下面安装jdk
- 实现spring+mybatis+uncode dal,应用自动切换连接数据库
- [Java]Stack栈和Heap堆的区别(终结篇)
- getServletContext()空指针异常的原因 和 Servlet的init方法
- java实现二叉树的构建以及3种遍历方法(转)
- NetBeans 使用远程Git库
- java && & 区别
- eclipse 代码提示均无效的问题解决方案