#logstash

what is the best performing logstash shipper?

I don't suppose anybody wants to help me figure out why events aren't getting in to ES? I've confirmed redis is getting them, log stash is picking them up because I can do an output file, but ES gets nada. I've copied the same config I had from a working install. :/

Aaand there it is. :/

tessier: what was it? :)

therealGent: there's really only one that I know of, logstash-forwarder. but it's not without a few bugs which I *know* whack and co are working on. it just needs some attention. I've been half tempted to write my own.

avleen, what kind of bugs?

question about the puppet module, after including the class logstash is logstash::configfile enough to build the config?

puppet is ignoring my logstash::configfile but I'm not sure why

hello stashers… i’m stuck with this in logstash-forwarder

tls: either ServerName or InsecureSkipVerify must be specified in the tls.Config

Would running multiple logstash receivers consuming from a message broker improve performance by taking advantage of things like multiple cores?

therealGent: taking advantage of multiple cpu cores is already possible.

whack, is that already default behavior?

therealGent: depends on the plugin, but most inputs and outputs default to using one thread or worker

some inputs support a 'threads' setting that you can use

hmm i wondre if amqp suppors that

therealGent: it's also worth investigating any bulk-fetching (or bulk writing) settings of whatever plugins you're using

therealGent: rabbitmq input supports that

why is that every single google link is for old logstash docs? Agh. It drives me insane.

And it appears as though amqp got replaced by rabbitmq?

therealGent: because google makes it difficult to declare which is the best version to use

therealGent: yes

That's unfortunate. It would have been great to keep compatibility with different message brokers.

therealGent: partly because 2-3 years ago, rabbitmq separated itself from the AMQP standards body, and the library we were using (bunny) is maintianed by the rabbitmq community

Ah.