#logstash

sorry, thing came up i had to deal with

http://pastebin.com/ZvEKdSaf torrancew

Title: [JSON] "level" => "DEBUG", "message" => "Price for demand retr - Pastebin.com (at pastebin.com)

so umm

yeah

Hey guys, I have a question on using AWSConfig in PluginMixins

I'm using an input plugin that uses AWSConfig / PluginMixins, and I'd like to use AWS STS (temporary credentials). How should I provide the temp credentials for the plugin?

Should I write a script for getting the temp credentials from aws and then put it in aws_credentials_file yaml file?

torrancew: I was able to fix it by adding a mutate filter to convert "type" to "string"

The problem appeared to have been relating to the "type" field being set to either a numeric value, an array, or perhaps the log entry itsself already had a "type" field - whatever the case, applying the mutate filter and converting the field to a string seems to have resolved the problem

i'm worried we may now be dropping log messages, or going into ES in some unexpected way and appearing malformed, as it's a little unorthodox resolution .. but hey, if it works. :)

will post any other findings here that are relevant

using elasticsearch as input plugin, file as output plugin in logstash, logstash writes same data multiple times to file, can anyone tell what is causing this

hi, trying to write my first grok pattern. i've got a datetime entry in a log formatted as '21/Sep/2015/00/21/58'. my intent is to take that and create a timestamp that logstash can use. would it be correct to add a new pattern in extra_patterns called, let's say, 'mypattern' and in that file use: MY_DATETIME %{MONTHDAY}[/]%{MONTH}[/]%{YEAR}[/]%{HOUR}[/]%{MINUTE}[/]%{SECOND}

or would i need to use a full regex like: MY_DATETIME \d\d[/](?:Jan(?:uary)?|Feb(?:ruary)?|Mar(?:ch)?|Apr(?:il)?|May|Jun(?:e)?|Jul(?:y)?|Aug(?:ust)?|Sep(?:tember)?|Sept|Oct(?:ober)?|Nov(?:ember)?|Dec(?:ember)?)[/]\d\d\d\d[/]\d\d[/]\d\d[/]\d\d

mlanner: the former will work, though I'm not sure about "[/]"