kafka结合spark 错误整理

1.

Error:scalac: bad symbolicreference.
A signature in
KafkaUtils.class
refers to
term serializerin
package kafka which isnot
available.It may be completely missing fromthe
current classpath, ortheversiononthe
classpath might be incompatible withtheversion
used when compiling KafkaUtils.class.

解决方法：

缺少包kafka_2.10-0.8.2.0-kafka-1.4.0.jar

2.java.lang.ClassNotFoundException: org.apache.spark.streaming.kafka.KafkaRDDPartition

解决：

spark-submit --class sparkstreaming.KafkaStreaming --master spark://bihdp01:7077 --executor-memory 1G --total-executor-cores 1 （未指定前两个） /data/peng/spark.jar