码迷,mamicode.com
首页 > 数据库 > 详细

logstash 数据插入mongodb,去掉附加信息,若删除@timestamp,插入数据会报错

时间:2017-09-24 15:24:44      阅读:408      评论:0      收藏:0      [点我收藏+]

标签:nlog   inpu   插入   jruby   min   position   field   rac   out   

input {
    file {
        path => [‘/gwlog/data/**/*.json‘]
        discover_interval => 1
		ignore_older => 5
        start_position => "beginning"
        close_older => 6
        max_open_files => 200000
        codec => json
    }
}
filter {
    mutate {
        remove_field => ["@version","host","path"]
    }
}
output {
     mongodb {
        codec => json
        collection => "tst_log"
        database => "runlog"
        uri => "mongodb://linge:lingepswd@52.80.33.136:8021/admin"       
     }
     stdout{
         codec => json
     }
}

 若删除@timestamp,插入数据会报错,感觉是插入时用到了@timestamp

2017-09-24T06:15:33,311][WARN ][logstash.outputs.mongodb ] Failed to send event to MongoDB {:event=>%{host} %{message}, :exception=>java.io.IOException: fails, :backtrace=>["org.logstash.Event.getTimestamp(Event.java:119)", "org.logstash.ext.JrubyEventExtLibrary$RubyEvent.ruby_timestamp(JrubyEventExtLibrary.java:290)", "org.logstash.ext.JrubyEventExtLibrary$RubyEvent$INVOKER$i$0$0$ruby_timestamp.call(JrubyEventExtLibrary$RubyEvent$INVOKER$i$0$0$ruby_timestamp.gen)", "org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:134)", "org.jruby.ast.CallNoArgNode.interpret(CallNoArgNode.java:60)", "org.jruby.ast.CallNoArgNode.interpret(CallNoArgNode.java:60)", "org.jruby.ast.AttrAssignTwoArgNode.interpret(AttrAssignTwoArgNode.java:36)", "org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)", "org.jruby.ast.IfNode.interpret(IfNode.java:116)", "org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)", "org.jruby.ast.BlockNode.interpret(BlockNode.java:71)", "org.jruby.ast.RescueNode.executeBody(RescueNode.java:221)", "org.jruby.ast.RescueNode.interpret(RescueNode.java:116)", "org.jruby.ast.BeginNode.interpret(BeginNode.java:83)", "org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)", "org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD(ASTInterpreter.java:74)", "org.jruby.internal.runtime.methods.InterpretedMethod.call(InterpretedMethod.java:182)", "org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:203)", "org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:326)", "org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:170)", "org.jruby.ast.FCallOneArgNode.interpret(FCallOneArgNode.java:36)", "org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)", "org.jruby.evaluator.ASTInterpreter.INTERPRET_BLOCK(ASTInterpreter.java:112)", "org.jruby.runtime.Interpreted19Block.evalBlockBody(Interpreted19Block.java:206)", "org.jruby.runtime.Interpreted19Block.yield(Int

logstash 数据插入mongodb,去掉附加信息,若删除@timestamp,插入数据会报错

标签:nlog   inpu   插入   jruby   min   position   field   rac   out   

原文地址:http://www.cnblogs.com/testzcy/p/7587223.html

(0)
(0)
   
举报
评论 一句话评论(0
登录后才能评论!
© 2014 mamicode.com 版权所有  联系我们:gaon5@hotmail.com
迷上了代码!