Flume启动时报错Caused by: java.lang.InterruptedException: Timed out before HDFS call was made. Your hdfs.callTimeout might be set too low or HDFS calls are taking too long.解决办法（图文详解）

　　前期博客

Flume自定义拦截器（Interceptors）或自带拦截器时的一些经验技巧总结（图文详解）

　　问题详情

-- ::, (agent-shutdown-hook) [INFO - org.apache.flume.instrumentation.MonitoredCounterGroup.stop(MonitoredCounterGroup.java:)] Shutdown Metric for type: SOURCE, name: fileSource. src.events.accepted ==
-- ::, (agent-shutdown-hook) [INFO - org.apache.flume.instrumentation.MonitoredCounterGroup.stop(MonitoredCounterGroup.java:)] Shutdown Metric for type: SOURCE, name: fileSource. src.events.received ==
-- ::, (agent-shutdown-hook) [INFO - org.apache.flume.instrumentation.MonitoredCounterGroup.stop(MonitoredCounterGroup.java:)] Shutdown Metric for type: SOURCE, name: fileSource. src.open-connection.count ==
-- ::, (SinkRunner-PollingRunner-DefaultSinkProcessor) [ERROR - org.apache.flume.sink.hdfs.HDFSEventSink.process(HDFSEventSink.java:)] process failed
java.lang.InterruptedException: Timed out before HDFS call was made. Your hdfs.callTimeout might be set too low or HDFS calls are taking too long.
    at org.apache.flume.sink.hdfs.BucketWriter.checkAndThrowInterruptedException(BucketWriter.java:)
    at org.apache.flume.sink.hdfs.BucketWriter.flush(BucketWriter.java:)
    at org.apache.flume.sink.hdfs.HDFSEventSink.process(HDFSEventSink.java:)
    at org.apache.flume.sink.DefaultSinkProcessor.process(DefaultSinkProcessor.java:)
    at org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:)
    at java.lang.Thread.run(Thread.java:)
-- ::, (SinkRunner-PollingRunner-DefaultSinkProcessor) [ERROR - org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:)] Unable to deliver event. Exception follows.
org.apache.flume.EventDeliveryException: java.lang.InterruptedException: Timed out before HDFS call was made. Your hdfs.callTimeout might be set too low or HDFS calls are taking too long.
    at org.apache.flume.sink.hdfs.HDFSEventSink.process(HDFSEventSink.java:)
    at org.apache.flume.sink.DefaultSinkProcessor.process(DefaultSinkProcessor.java:)
    at org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:)
    at java.lang.Thread.run(Thread.java:)
Caused by: java.lang.InterruptedException: Timed out before HDFS call was made. Your hdfs.callTimeout might be set too low or HDFS calls are taking too long.
    at org.apache.flume.sink.hdfs.BucketWriter.checkAndThrowInterruptedException(BucketWriter.java:)
    at org.apache.flume.sink.hdfs.BucketWriter.flush(BucketWriter.java:)
    at org.apache.flume.sink.hdfs.HDFSEventSink.process(HDFSEventSink.java:)
    ...  more

　　这句话，说的很明显。

　　你的hdfs.calltimeout可能设置得太低或HDFS需要花费太长的时间。

　　我的是

#---------hdfsSink 相关配置------------------
agent1.sinks.hdfsSink.type = hdfs
# 注意, 我们输出到下面一个子文件夹datax中
agent1.sinks.hdfsSink.hdfs.path = hdfs://master:9000/data/types/%Y%m%d/%{log_type}
agent1.sinks.hdfsSink.hdfs.writeFormat = Text
agent1.sinks.hdfsSink.hdfs.fileType = DataStream
agent1.sinks.hdfsSink.hdfs.callTimeout =
agent1.sinks.hdfsSink.hdfs.useLocalTimeStamp = true
 
#当文件大小为52428800字节时，将临时文件滚动成一个目标文件
agent1.sinks.hdfsSink.hdfs.rollSize =
#events数据达到该数量的时候，将临时文件滚动成目标文件
agent1.sinks.hdfsSink.hdfs.rollCount =
#每隔N s将临时文件滚动成一个目标文件
agent1.sinks.hdfsSink.hdfs.rollInterval = 
 
#配置前缀和后缀
agent1.sinks.hdfsSink.hdfs.filePrefix=run
                                                                       

　　这个大家，可以还改大些。

agent1.sinks.hdfsSink.hdfs.callTimeout = 

hdfs.sinks.fs.hdfs.rollInterval=21600
hdfs.sinks.fs.hdfs.rollSize=8589934592
为何这两个设置这么大。超时出现问题正常的设置小一点，根据情况自己调试下。
建议初始值：
hdfs.sinks.fs.hdfs.rollInterval=10
hdfs.sinks.fs.hdfs.rollSize=0
依次：
20
40
80
200
等值。