#logstash

BaM`: actually I believe there is a bug while using persisted queue; https://github.com/elastic/logstash/issues/7243

Title: enabling persisted queue stops ES output from accumulating events into batches · Issue #7243 · elastic/logstash · GitHub (at github.com)

Hi, i get the following error how to overcome this issue " Error: Your application used more memory than the safety cap of 1024M. Specify -J-Xmx####m to increase it (#### = cap size in MB).Specify -w for full OutOfMemoryError stack trace"

Hi, i get the following error how to overcome this issue " Error: Your application used more memory than the safety cap of 1024M. Specify -J-Xmx####m to increase it (#### = cap size in MB).Specify -w for full OutOfMemoryError stack trace"

hai all, How to enable read huge number of files. i get file permission denied error

gokul: have you tried increasing the heap size as the error message indicates?

default is 512 i changed to 1GB

but actual issue is still persist

well, seesm that 1GB is still not sufficient for what you're doing

1024M = 1GB

yes, so how can i handle huge number of files

huge amount of memory?

or bit by bit.

yeas it consumes more memory

any workaround to process these many files

either more memory or process less files.