flume 读取tcp写到hdfs
2016-02-27 11:06
399 查看
# Please paste flume.conf here. Example: # Sources, channels, and sinks are defined per # agent name, in this case 'tier1'. tier1.sources = source1 tier1.channels = channel1 tier1.sinks = sink1 # For each source, channel, and sink, set # standard properties. tier1.sources.source1.type = syslogtcp tier1.sources.source1.bind = 127.0.0.1 tier1.sources.source1.port = 9999 tier1.sources.source1.channels = channel1 tier1.channels.channel1.type = memory tier1.sinks.sink1.channel= channel1 tier1.sinks.sink1.type=hdfs tier1.sinks.sink1.hdfs.path=hdfs://ha0:8020/flume/events tier1.sinks.sink1.hdfs.fileType=DataStream tier1.sinks.sink1.hdfs.writeFormat=Text tier1.sinks.sink1.hdfs.rollInterval=0 tier1.sinks.sink1.hdfs.rollSize=1024 tier1.sinks.sink1.hdfs.rollCount=0 tier1.sinks.sink1.hdfs.idleTimeout=60 # Other properties are specific to each type of # source, channel, or sink. In this case, we # specify the capacity of the memory channel. tier1.channels.channel1.capacity = 100
测试:
nc 127.0.0.1 9999
nc -l 9999
相关文章推荐
- flume 读取tcp写到hdfs
- 计算机网络15--网络应用对传输服务的需求
- 关于TCP主动关闭连接中的wait_timeout
- linux 网络连接
- IOS开发网络加载图片缓存策略之──ASIDownloadCache缓存策略
- 使用ASIHTTPRequest和ASIDownloadCache实现本地缓存
- [DeepLearning]keras初体验之病斑分类
- Can not find the tag library descriptor for "http://java.sun.com/jsp/jstl/core"
- ASI网络请求在debug可用,发布项目后不能发送网络请求
- 一个双网卡导致的网络故障
- 网络性能测试
- http协议
- linux下安装apache(httpd-2.4.3版本)各种坑
- linux下安装apache(httpd-2.4.3版本)各种坑
- linux下安装apache(httpd-2.4.3版本)各种坑
- linux下安装apache(httpd-2.4.3版本)各种坑
- 计算机网络14--网络应用进程通信
- python 网络爬虫初级实现代码
- cell 网络数据缓存
- 自己综合的一个常用下载和上传工具类:HttpClientUtils(18)