码迷,mamicode.com
首页 > Web开发 > 详细

Hadoop实战-Flume之Hdfs Sink(十)

时间:2017-05-17 00:49:15      阅读:214      评论:0      收藏:0      [点我收藏+]

标签:netcat   timestamp   cat   use   sel   log   oop   hadoop   sources   

a1.sources = r1
a1.sinks = k1
a1.channels = c1

# Describe/configure the source
a1.sources.r1.type = netcat
a1.sources.r1.bind = localhost
a1.sources.r1.port = 44444

# Describe the sink
#a1.sinks.k1.type = logger
a1.sinks.k1.type = hdfs
a1.sinks.k1.hdfs.path = /flume/events/%y-%m-%d/%H%M/%S
#官方缺少一个配置 a1.sinks.k1.hdfs.useLocalTimeStamp
= true a1.sinks.k1.hdfs.filePrefix = events- a1.sinks.k1.hdfs.round = true a1.sinks.k1.hdfs.roundValue = 10 a1.sinks.k1.hdfs.roundUnit = minute # Use a channel which buffers events in memory a1.channels.c1.type = memory a1.channels.c1.capacity = 1000 a1.channels.c1.transactionCapacity = 100 # Bind the source and sink to the channel a1.sources.r1.channels = c1 a1.sinks.k1.channel = c1

 

Hadoop实战-Flume之Hdfs Sink(十)

标签:netcat   timestamp   cat   use   sel   log   oop   hadoop   sources   

原文地址:http://www.cnblogs.com/qq27271609/p/6864121.html

(0)
(0)
   
举报
评论 一句话评论(0
登录后才能评论!
© 2014 mamicode.com 版权所有  联系我们:gaon5@hotmail.com
迷上了代码!