Buffering

Parsed messages are asynchronously pushed to the final data store.

If that data store happens to be temporarily slower than the incoming data stream, Flowgger can keep pending messages in a memory buffer, until they can eventually be flushed.

By default, up to 10,000,000 items can be kept in memory.

This can be adjusted with the queuesize parameter in Flowgger's configuration file:

[input]
queuesize = 500000

If the buffer ever gets full, new messages will not be discarded: clients simply won't be able to push new messages until the queue drains.