spark lzo
2017-08-29 17:24
232 查看
编辑spark-env.sh
export LD_LIBRARY_PATH=/usr/lib64:/usr/hdp/2.2.6.0-2800/hadoop/lib/native/Linux-amd64-64
export HADOOP_CONF_DIR=/etc/hadoop/conf
export YARN_CONF_DIR=/etc/hadoop/conf
export SPARK_CLASSPATH=${SPARK_CLASSPATH}:/usr/hdp/current/share/lzo/0.6.0/lib/hadoop-lzo-0.6.0.jar
export LD_LIBRARY_PATH=/usr/lib64:/usr/hdp/2.2.6.0-2800/hadoop/lib/native/Linux-amd64-64
export HADOOP_CONF_DIR=/etc/hadoop/conf
export YARN_CONF_DIR=/etc/hadoop/conf
export SPARK_CLASSPATH=${SPARK_CLASSPATH}:/usr/hdp/current/share/lzo/0.6.0/lib/hadoop-lzo-0.6.0.jar
相关文章推荐
- Spark RDD API详解(一) Map和Reduce
- 使用spark和spark mllib进行股票预测
- Spark随谈——开发指南(译)
- Spark,一种快速数据分析替代方案
- Redis 中spark参数executor-cores引起的异常解决办法
- Spark SQL数据加载和保存实例讲解
- java 中Spark中将对象序列化存储到hdfs
- eclipse 开发 spark Streaming wordCount
- Understanding Spark Caching
- ClassNotFoundException:scala.PreDef$
- Windows 下Spark 快速搭建Spark源码阅读环境
- hadoop安装lzo
- Spark中将对象序列化存储到hdfs
- spark filter testing
- 使用java代码提交Spark的hive sql任务,run as java application
- Spark机器学习(一) -- Machine Learning Library (MLlib)
- Spark机器学习(二) 局部向量 Local-- Data Types - MLlib
- Spark机器学习(三) Labeled point-- Data Types
- Spark初探
- Spark Streaming初探