Flume Interceptors官网剖析(博主推荐)
2017-04-25 15:40
621 查看
不多说,直接上干货!
![](https://images2015.cnblogs.com/blog/855959/201704/855959-20170425153636850-2019667776.png)
Flume Interceptors
Timestamp Interceptor
Host Interceptor
Static Interceptor
UUID Interceptor
Morphline Interceptor
Search and Replace Interceptor
Regex Filtering Interceptor
Regex Extractor Interceptor
Example 1:
Example 2:
![](https://images2015.cnblogs.com/blog/855959/201704/855959-20170425153702522-357452462.png)
![](https://images2015.cnblogs.com/blog/855959/201704/855959-20170425153726834-1238566293.png)
![](https://images2015.cnblogs.com/blog/855959/201704/855959-20170425153750553-1716764934.png)
![](https://images2015.cnblogs.com/blog/855959/201704/855959-20170425153812506-1283978981.png)
![](https://images2015.cnblogs.com/blog/855959/201704/855959-20170425153834881-137815231.png)
官网提供给我们的参考案例是
我们一般是
这里是我自己写的一个拦截器代码。
![](https://images2015.cnblogs.com/blog/855959/201704/855959-20170425153854756-495732186.png)
![](https://images2015.cnblogs.com/blog/855959/201704/855959-20170425153919272-2030767517.png)
![](https://images2015.cnblogs.com/blog/855959/201704/855959-20170425153942928-2094010805.png)
![](https://images2015.cnblogs.com/blog/855959/201704/855959-20170425154005053-687964335.png)
大家自己去看,罗列出来,是让大家,不要局限于博客本身,眼光要放宽和多看官网,一切来源于官网。
对于大数据无论是各种开源项目,看官网是学习的最好办法,再加上他人的中文博客。不要觉得英文恐惧,专业英语也就那样!变成高手和大牛,加油吧,zhouls!
Flume Sources官网剖析(博主推荐)
Flume Channels官网剖析(博主推荐)
Flume Channel Selectors官网剖析(博主推荐)
Flume Sinks官网剖析(博主推荐)
Flume Sink Processors官网剖析(博主推荐)
Event Serializers官网剖析(博主推荐)
一切来源于flume官网http://flume.apache.org/FlumeUserGuide.html
![](https://images2015.cnblogs.com/blog/855959/201704/855959-20170425153636850-2019667776.png)
Flume Interceptors
Timestamp Interceptor
Host Interceptor
Static Interceptor
UUID Interceptor
Morphline Interceptor
Search and Replace Interceptor
Regex Filtering Interceptor
Regex Extractor Interceptor
Example 1:
Example 2:
Timestamp Interceptor
![](https://images2015.cnblogs.com/blog/855959/201704/855959-20170425153702522-357452462.png)
Host Interceptor
![](https://images2015.cnblogs.com/blog/855959/201704/855959-20170425153726834-1238566293.png)
Static Interceptor
![](https://images2015.cnblogs.com/blog/855959/201704/855959-20170425153750553-1716764934.png)
UUID Interceptor
![](https://images2015.cnblogs.com/blog/855959/201704/855959-20170425153812506-1283978981.png)
Morphline Interceptor(常用)
![](https://images2015.cnblogs.com/blog/855959/201704/855959-20170425153834881-137815231.png)
官网提供给我们的参考案例是
a1.sources.avroSrc.interceptors = morphlineinterceptor a1.sources.avroSrc.interceptors.morphlineinterceptor.type = org.apache.flume.sink.solr.morphline.MorphlineInterceptor$Builder a1.sources.avroSrc.interceptors.morphlineinterceptor.morphlineFile = /etc/flume-ng/conf/morphline.conf a1.sources.avroSrc.interceptors.morphlineinterceptor.morphlineId = morphline1
我们一般是
a1.sources.r1.interceptors = i1 a1.sources.r1.interceptors.i1.type = com.zhouls.flume.interceptor.BehaviorIterceptor$BehaviorIterceptorBuilder
这里是我自己写的一个拦截器代码。
Search and Replace Interceptor
![](https://images2015.cnblogs.com/blog/855959/201704/855959-20170425153854756-495732186.png)
Regex Filtering Interceptor
![](https://images2015.cnblogs.com/blog/855959/201704/855959-20170425153919272-2030767517.png)
Regex Extractor Interceptor
![](https://images2015.cnblogs.com/blog/855959/201704/855959-20170425153942928-2094010805.png)
![](https://images2015.cnblogs.com/blog/855959/201704/855959-20170425154005053-687964335.png)
大家自己去看,罗列出来,是让大家,不要局限于博客本身,眼光要放宽和多看官网,一切来源于官网。
对于大数据无论是各种开源项目,看官网是学习的最好办法,再加上他人的中文博客。不要觉得英文恐惧,专业英语也就那样!变成高手和大牛,加油吧,zhouls!
相关文章推荐
- Flume Channel Selectors官网剖析(博主推荐)
- Flume Sink Processors官网剖析(博主推荐)
- Flume Source官网剖析(博主推荐)
- 1.1 Introduction中 Apache Kafka™ is a distributed streaming platform. What exactly does that mean?(官网剖析)(博主推荐)
- 1.2 Use Cases中 Commit Log官网剖析(博主推荐)
- 2. APIS官网剖析(博主推荐)
- 3.1 Broker Configs 官网剖析(博主推荐)
- 1.1 Introduction中 Topics and Logs官网剖析(博主推荐)
- 1.3 Quick Start中 Step 1: Download the code官网剖析(博主推荐)
- 2.1 Producer API官网剖析(博主推荐)
- Flume Sinks官网剖析(博主推荐)
- 1.1 Introduction中 Distribution官网剖析(博主推荐)
- 1.3 Quick Start中 Step 2: Start the server官网剖析(博主推荐)
- 2.2 Consumer API官网剖析(博主推荐)
- 1.1 Introduction中 Producers官网剖析(博主推荐)
- 1.3 Quick Start中 Step 3: Create a topic官网剖析(博主推荐)
- Event Serializers官网剖析(博主推荐)
- 1.1 Introduction中 Consumers官网剖析(博主推荐)
- 1.1 Introduction中 Guarantees官网剖析(博主推荐)
- 1.3 Quick Start中 Step 4: Send some messages官网剖析(博主推荐)