Flume -- Transfer one type of source to another type
Source within Flume is a kind of Server for outside client.
Sink within Flume is a kind of client for ourside server such as HDFS, MongoDB, Kafka.





| Component Interface | Type Alias | Implementation Class | 
|---|---|---|
| org.apache.flume.Channel | memory | org.apache.flume.channel.MemoryChannel | 
| org.apache.flume.Channel | jdbc | org.apache.flume.channel.jdbc.JdbcChannel | 
| org.apache.flume.Channel | file | org.apache.flume.channel.file.FileChannel | 
| org.apache.flume.Channel | – | org.apache.flume.channel.PseudoTxnMemoryChannel | 
| org.apache.flume.Channel | – | org.example.MyChannel | 
| org.apache.flume.Source | avro | org.apache.flume.source.AvroSource | 
| org.apache.flume.Source | netcat | org.apache.flume.source.NetcatSource | 
| org.apache.flume.Source | seq | org.apache.flume.source.SequenceGeneratorSource | 
| org.apache.flume.Source | exec | org.apache.flume.source.ExecSource | 
| org.apache.flume.Source | syslogtcp | org.apache.flume.source.SyslogTcpSource | 
| org.apache.flume.Source | multiport_syslogtcp | org.apache.flume.source.MultiportSyslogTCPSource | 
| org.apache.flume.Source | syslogudp | org.apache.flume.source.SyslogUDPSource | 
| org.apache.flume.Source | spooldir | org.apache.flume.source.SpoolDirectorySource | 
| org.apache.flume.Source | http | org.apache.flume.source.http.HTTPSource | 
| org.apache.flume.Source | thrift | org.apache.flume.source.ThriftSource | 
| org.apache.flume.Source | jms | org.apache.flume.source.jms.JMSSource | 
| org.apache.flume.Source | – | org.apache.flume.source.avroLegacy.AvroLegacySource | 
| org.apache.flume.Source | – | org.apache.flume.source.thriftLegacy.ThriftLegacySource | 
| org.apache.flume.Source | – | org.example.MySource | 
| org.apache.flume.Sink | null | org.apache.flume.sink.NullSink | 
| org.apache.flume.Sink | logger | org.apache.flume.sink.LoggerSink | 
| org.apache.flume.Sink | avro | org.apache.flume.sink.AvroSink | 
| org.apache.flume.Sink | hdfs | org.apache.flume.sink.hdfs.HDFSEventSink | 
| org.apache.flume.Sink | hbase | org.apache.flume.sink.hbase.HBaseSink | 
| org.apache.flume.Sink | asynchbase | org.apache.flume.sink.hbase.AsyncHBaseSink | 
| org.apache.flume.Sink | elasticsearch | org.apache.flume.sink.elasticsearch.ElasticSearchSink | 
| org.apache.flume.Sink | file_roll | org.apache.flume.sink.RollingFileSink | 
| org.apache.flume.Sink | irc | org.apache.flume.sink.irc.IRCSink | 
| org.apache.flume.Sink | thrift | org.apache.flume.sink.ThriftSink | 
| org.apache.flume.Sink | – | org.example.MySink | 
| org.apache.flume.ChannelSelector | replicating | org.apache.flume.channel.ReplicatingChannelSelector | 
| org.apache.flume.ChannelSelector | multiplexing | org.apache.flume.channel.MultiplexingChannelSelector | 
| org.apache.flume.ChannelSelector | – | org.example.MyChannelSelector | 
| org.apache.flume.SinkProcessor | default | org.apache.flume.sink.DefaultSinkProcessor | 
| org.apache.flume.SinkProcessor | failover | org.apache.flume.sink.FailoverSinkProcessor | 
| org.apache.flume.SinkProcessor | load_balance | org.apache.flume.sink.LoadBalancingSinkProcessor | 
| org.apache.flume.SinkProcessor | – | |
| org.apache.flume.interceptor.Interceptor | timestamp | org.apache.flume.interceptor.TimestampInterceptor$Builder | 
| org.apache.flume.interceptor.Interceptor | host | org.apache.flume.interceptor.HostInterceptor$Builder | 
| org.apache.flume.interceptor.Interceptor | static | org.apache.flume.interceptor.StaticInterceptor$Builder | 
| org.apache.flume.interceptor.Interceptor | regex_filter | org.apache.flume.interceptor.RegexFilteringInterceptor$Builder | 
| org.apache.flume.interceptor.Interceptor | regex_extractor | org.apache.flume.interceptor.RegexFilteringInterceptor$Builder | 
| org.apache.flume.channel.file.encryption.KeyProvider$Builder | jceksfile | org.apache.flume.channel.file.encryption.JCEFileKeyProvider | 
| org.apache.flume.channel.file.encryption.KeyProvider$Builder | – | org.example.MyKeyProvider | 
| org.apache.flume.channel.file.encryption.CipherProvider | aesctrnopadding | org.apache.flume.channel.file.encryption.AESCTRNoPaddingProvider | 
| org.apache.flume.channel.file.encryption.CipherProvider | – | org.example.MyCipherProvider | 
| org.apache.flume.serialization.EventSerializer$Builder | text | org.apache.flume.serialization.BodyTextEventSerializer$Builder | 
| org.apache.flume.serialization.EventSerializer$Builder | avro_event | org.apache.flume.serialization.FlumeEventAvroEventSerializer$Builder | 
| org.apache.flume.serialization.EventSerializer$Builder | – | org.example.MyEventSerializer$Builder | 
Flume -- Transfer one type of source to another type的更多相关文章
- Failed to register: Error: fabric-ca request register failed with errors [[{"code":0,"message":"No identity type provided. Please provide identity type"}]]解决方案
		
I try to run sample application as stated here : http://hyperledger-fabric.readthedocs.io/en/release ...
 - The conversion of a varchar data type to a datetime data type resulted in an out-of-range value
		
刚刚有在程序中,传递一个空值至MS SQL Server数据库,这个值的数据类型为DATETIME执行时,它却发生了如标题提示的异常:The conversion of a varchar data ...
 - 【spring boot】spring boot 前台GET请求,传递时间类型的字符串,后台无法解析,报错:Failed to convert from type [java.lang.String] to type [java.util.Date]
		
spring boot 前台GET请求,传递时间类型的字符串,后台无法解析,报错:Failed to convert from type [java.lang.String] to type [jav ...
 - 解决Type safety: The expression of type List needs
		
解决Type safety: The expression of type List needs unchecked conversion to conform to 在方法前加上这句话就可以了@Su ...
 - No converter found capable of converting from type [java.lang.String] to type [java.util.Map<java.lang.String, org.springframework.boot.logging.LogLevel>]
		
java.lang.IllegalStateException: Failed to load ApplicationContext at org.springframework.test.conte ...
 - 报错The "chunk" argument must be one of type string or Buffer. Received type object
		
报错内容: TypeError [ERR_INVALID_ARG_TYPE]: The "chunk" argument must be one of type string or ...
 - No converter found capable of converting from type [java.lang.String] to type [java.util.Map<java.lang.String, java.lang.String>]
		
java.lang.IllegalStateException: Failed to load ApplicationContext at org.springframework.test.conte ...
 - Jpa自定义查询报错(Failed to convert from type [java.lang.Object[]] to type)
		
Jpa自定义查询报错 问题背景 今天遇到一个奇怪的报错"Failed to convert from type [java.lang.Object[]] to type",这个报错 ...
 - 一种封装Retrofit的方法,可以自动解析Gson,回避Method return type must not include a type variable or wildcard: retrofit2.Call<T>的问题
		
封装目的:屏蔽底层实现,提供统一接口,并支持Gson自动转化 最初封装: //请求方法 interface RequestListener { interface PostListener { @PO ...
 
随机推荐
- day5:python学习之集合
			
0. 集合的作用及特点 集合具有去重和关系测试两大作用,它具有无序的特点. list1 = [1,2,3,4,5,7,6,8,6,4] list1 = set(list1) print(list1) ...
 - .crx 文件修改
			
.crx 文件类型:Chrome Extension 扩展名为.crx的文件是一个插件文件. 解压:使用7zip 修改: notepad++ 打包: Chrome 扩展项
 - Python开发:Windows下Python+Eclipse+Pydev开发环境配置
			
一.配置前的准备: 1.安装jdk: 下载地址: https://www.oracle.com/technetwork/java/javase/downloads/index.html 2.安装Ecl ...
 - golang (5) ---工程管理
			
1. go mod 添加本地package依赖 go mod 作为golang新的版本管理工具,减少了对GOPATH的依赖. 但是对本地文件的依赖的时候,提示 build server: cannot ...
 - Spring Boot Starter列表
			
转自:http://blog.sina.com.cn/s/blog_798f713f0102wiy5.html Spring Boot Starter 基本的一共有43种,具体如下: 1)spring ...
 - Java反射机制的浅显理解(这篇文章还没写好,留个草稿给自己看的)
			
目前只是有一个大概的理解,先把自己感觉容易立即的概念放这里,等以后结合实际工作理解深刻了再来补充. 一.什么是Java反射机制?(多种定义) 1. JAVA反射机制是在运行状态中,对于任意一个类,都能 ...
 - C 扩展库 - mysql API CRUD
			
CRUD table create table if not exists `student` ( `id` int auto_increment, `name` varchar(16) not nu ...
 - Compiler Principle
			
1.Einleitung 1.1 Der Überblick über Compiler 1.1.1 Lexikalische Analyse Die lexikalische Analyse zer ...
 - android_serialport_api代码分析
			
1. 导入Android studio android_serialport_api是一个开源的串口测试工具,代码应该是用eclipse工程(不确定,没用过eclipse,反正不是Android st ...
 - ubuntu上安装R的时候遇到的问题总结
			
首先感谢这两篇博客的指导,第一篇是关于报错的总结,第二篇是第一篇中没有提到的错误,也就是我在安装的时候出现的错误. 1.下载R包 (去官网选择一个离你最近的镜像网址,我的是清华提供的镜像下载速度比较快 ...