#logstash

i made a test data source container for my logstash config

it has a sample of services that have filters in logstash

then pumps it at a test container that dumps the output to a "test-*" index pattern in elasticsearch

it's pretty rudimentary at the moment but it's the start of something a bit more continually integrated

it worked out being pretty useful, picked up two errors in my logstash config and one error in my sample data

how do i convert a field in a nested object array, convert => { "[rank_history][rank]" => "integer" } is not working. he object is rank_history: [{ date: date, rank: number}]

what's wrong with that?

lgtm!

org.elasticsearch.index.mapper.MapperParsingException: failed to parse [rank_history.rank]

Caused by: java.lang.NumberFormatException: For input string: "2.0"

how are you assigning the field?

before converting it?

json {

source => "message"

?

oh, ok, so it's coming into logstash as json?

ya its coming from dynamodb

everything there is strings

hrm..

so.. the index you currently have

will have a field mapping associated with it

what does the field mapping think that field is?

string

i think that might be the problem

the mapping is already created

and you're trying to put an invalid data type to the field mapping

well it expects a integer

i believe you can't change the field mapping, you might need to delete the index and start again

yep

logstash does

"rank_history": {

"type": "nested",

"properties": {

"date": {

"format": "dateOptionalTime",

"type": "date"

},

"rank": {

"type": "integer"

}

}

},

that is my mapping

hrm

look alright