Flume内置channel,source,sink汇总

Posted God_Mode

tags:

篇首语:本文由小常识网(cha138.com)小编为大家整理,主要介绍了Flume内置channel,source,sink汇总相关的知识,希望对你有一定的参考价值。

由于经常会使用到Flume的一些channel,source,sink,于是为了方便将这些channel,source,sink汇总出来,也共大家访问。

Component Interface Type Alias Implementation Class
*.Channel memory *.channel.MemoryChannel
*.Channel jdbc *.channel.jdbc.JdbcChannel
*.Channel file *.channel.file.FileChannel
*.Channel *.channel.PseudoTxnMemoryChannel
*.Channel org.example.MyChannel
*.Source avro *.source.AvroSource
*.Source netcat *.source.NetcatSource
*.Source seq *.source.SequenceGeneratorSource
*.Source exec *.source.ExecSource
*.Source syslogtcp *.source.SyslogTcpSource
*.Source multiport_syslogtcp *.source.MultiportSyslogTCPSource
*.Source syslogudp *.source.SyslogUDPSource
*.Source spooldir *.source.SpoolDirectorySource
*.Source http *.source.http.HTTPSource
*.Source thrift *.source.ThriftSource
*.Source jms *.source.jms.JMSSource
*.Source *.source.avroLegacy.AvroLegacySource
*.Source *.source.thriftLegacy.ThriftLegacySource
*.Source org.example.MySource
*.Sink null *.sink.NullSink
*.Sink logger *.sink.LoggerSink
*.Sink avro *.sink.AvroSink
*.Sink hdfs *.sink.hdfs.HDFSEventSink
*.Sink hbase *.sink.hbase.HBaseSink
*.Sink asynchbase *.sink.hbase.AsyncHBaseSink
*.Sink elasticsearch *.sink.elasticsearch.ElasticSearchSink
*.Sink file_roll *.sink.RollingFileSink
*.Sink irc *.sink.irc.IRCSink
*.Sink thrift *.sink.ThriftSink
*.Sink org.example.MySink
*.ChannelSelector replicating *.channel.ReplicatingChannelSelector
*.ChannelSelector multiplexing *.channel.MultiplexingChannelSelector
*.ChannelSelector org.example.MyChannelSelector
*.SinkProcessor default *.sink.DefaultSinkProcessor
*.SinkProcessor failover *.sink.FailoverSinkProcessor
*.SinkProcessor load_balance *.sink.LoadBalancingSinkProcessor
*.SinkProcessor  
*.interceptor.Interceptor timestamp *.interceptor.TimestampInterceptor$Builder
*.interceptor.Interceptor host *.interceptor.HostInterceptor$Builder
*.interceptor.Interceptor static *.interceptor.StaticInterceptor$Builder
*.interceptor.Interceptor regex_filter *.interceptor.RegexFilteringInterceptor$Builder
*.interceptor.Interceptor regex_extractor *.interceptor.RegexFilteringInterceptor$Builder
*.channel.file.encryption.
KeyProvider$Builder
jceksfile *.channel.file.encryption.JCEFileKeyProvider
*.channel.file.encryption.
KeyProvider$Builder
org.example.MyKeyProvider
*.channel.file.encryption.CipherProvider aesctrnopadding *.channel.file.encryption.AESCTRNoPaddingProvider
*.channel.file.encryption.CipherProvider org.example.MyCipherProvider
*.serialization.EventSerializer$Builder text *.serialization.BodyTextEventSerializer$Builder
*.serialization.EventSerializer$Builder avro_event *.serialization.FlumeEventAvroEventSerializer$Builder
*.serialization.EventSerializer$Builder org.example.MyEventSerializer$Builder
由于表格太大了,所以这里将org.apache.flume.替换为*.,读者在阅读的时候,直接将*.理解成org.apache.flume.即可!

以上是关于Flume内置channel,source,sink汇总的主要内容,如果未能解决你的问题,请参考以下文章

flume从kafka读取数据到hdfs中的配置

Flume安装及配置

Flume 拦截器(interceptor)详解

flume从kafka中读取数据

Flume实用环境搭建:source(spooldir)+channel(file)+sink(hdfs)方式

flume对接kafka