#logstash

Is that what you meant?

oh my god, I've been trying to debug this stupid kafka issue, and I'm using the wrong version of kafka :(

BaM`: that sucks!

no errors in the LS logs though, so that's dumb

even at trace level

I'll say

just lots of TIME_WAITS on the queue servers

lovely

that's a great failure mode

*nods

kchan: how does logstash wind up getting the IAM credentials?

.aws/credentials

are you certain that it's picking them up?

How can you tell?

kchan: not that I now anything about kinesis, but where is .aws/credentials located?

it is located at the users home directory

which user?

centos

is that the user that logstash is running as?

yes

hm, ok then I'm out of ideas

kchan: how are you running logstash?

have you read the docs at https://github.com/logstash-plugins/logstash-in... ?

torrancew: 12:42 < kchan> ./bin/logstash -f /etc/logstash/conf.d/kinesis_pipe.conf --path.settings /etc/logstash/ --config.reload.automatic

yes. I am having trouble with the permissions aspect of it. I dont know which permissions I need to give this iam role access to

so you're currently the centos user?

yes

are you doing anything with named profiles in your ~/.aws files?

kchan: ^^^^

I'm heading to catch a bus & commute, will keep an eye on the channel as connectivity allows

Hi all! i need some help configuring my filters on logstash, they are ignoring me or i dont know how to correctly use them

can someone spare a little time to correct me please? :)