Flume内置channel,source,sink汇总
Posted God_Mode
tags:
篇首语:本文由小常识网(cha138.com)小编为大家整理,主要介绍了Flume内置channel,source,sink汇总相关的知识,希望对你有一定的参考价值。
由于经常会使用到Flume的一些channel,source,sink,于是为了方便将这些channel,source,sink汇总出来,也共大家访问。
Component Interface | Type Alias | Implementation Class |
*.Channel | memory | *.channel.MemoryChannel |
*.Channel | jdbc | *.channel.jdbc.JdbcChannel |
*.Channel | file | *.channel.file.FileChannel |
*.Channel | – | *.channel.PseudoTxnMemoryChannel |
*.Channel | – | org.example.MyChannel |
*.Source | avro | *.source.AvroSource |
*.Source | netcat | *.source.NetcatSource |
*.Source | seq | *.source.SequenceGeneratorSource |
*.Source | exec | *.source.ExecSource |
*.Source | syslogtcp | *.source.SyslogTcpSource |
*.Source | multiport_syslogtcp | *.source.MultiportSyslogTCPSource |
*.Source | syslogudp | *.source.SyslogUDPSource |
*.Source | spooldir | *.source.SpoolDirectorySource |
*.Source | http | *.source.http.HTTPSource |
*.Source | thrift | *.source.ThriftSource |
*.Source | jms | *.source.jms.JMSSource |
*.Source | – | *.source.avroLegacy.AvroLegacySource |
*.Source | – | *.source.thriftLegacy.ThriftLegacySource |
*.Source | – | org.example.MySource |
*.Sink | null | *.sink.NullSink |
*.Sink | logger | *.sink.LoggerSink |
*.Sink | avro | *.sink.AvroSink |
*.Sink | hdfs | *.sink.hdfs.HDFSEventSink |
*.Sink | hbase | *.sink.hbase.HBaseSink |
*.Sink | asynchbase | *.sink.hbase.AsyncHBaseSink |
*.Sink | elasticsearch | *.sink.elasticsearch.ElasticSearchSink |
*.Sink | file_roll | *.sink.RollingFileSink |
*.Sink | irc | *.sink.irc.IRCSink |
*.Sink | thrift | *.sink.ThriftSink |
*.Sink | – | org.example.MySink |
*.ChannelSelector | replicating | *.channel.ReplicatingChannelSelector |
*.ChannelSelector | multiplexing | *.channel.MultiplexingChannelSelector |
*.ChannelSelector | – | org.example.MyChannelSelector |
*.SinkProcessor | default | *.sink.DefaultSinkProcessor |
*.SinkProcessor | failover | *.sink.FailoverSinkProcessor |
*.SinkProcessor | load_balance | *.sink.LoadBalancingSinkProcessor |
*.SinkProcessor | – | |
*.interceptor.Interceptor | timestamp | *.interceptor.TimestampInterceptor$Builder |
*.interceptor.Interceptor | host | *.interceptor.HostInterceptor$Builder |
*.interceptor.Interceptor | static | *.interceptor.StaticInterceptor$Builder |
*.interceptor.Interceptor | regex_filter | *.interceptor.RegexFilteringInterceptor$Builder |
*.interceptor.Interceptor | regex_extractor | *.interceptor.RegexFilteringInterceptor$Builder |
*.channel.file.encryption. KeyProvider$Builder |
jceksfile | *.channel.file.encryption.JCEFileKeyProvider |
*.channel.file.encryption. KeyProvider$Builder |
– | org.example.MyKeyProvider |
*.channel.file.encryption.CipherProvider | aesctrnopadding | *.channel.file.encryption.AESCTRNoPaddingProvider |
*.channel.file.encryption.CipherProvider | – | org.example.MyCipherProvider |
*.serialization.EventSerializer$Builder | text | *.serialization.BodyTextEventSerializer$Builder |
*.serialization.EventSerializer$Builder | avro_event | *.serialization.FlumeEventAvroEventSerializer$Builder |
*.serialization.EventSerializer$Builder | – | org.example.MyEventSerializer$Builder |
由于表格太大了,所以这里将org.apache.flume.替换为*.,读者在阅读的时候,直接将*.理解成org.apache.flume.即可!
以上是关于Flume内置channel,source,sink汇总的主要内容,如果未能解决你的问题,请参考以下文章