Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Background Aggregations #3

Open
arunoda opened this issue Feb 16, 2013 · 0 comments
Open

Background Aggregations #3

arunoda opened this issue Feb 16, 2013 · 0 comments

Comments

@arunoda
Copy link
Owner

arunoda commented Feb 16, 2013

Currently all metrics received are stored. When processing all of them wiill be counted. This is great for five_secs time resolution.

But if we drawing hourly or daily aggregation, this whole set of metrics slow down the aggregation.

Solution

We can use background aggregation for this. For example.

If we are looking for hourly metrics. We can run a background operation which runs per 1/2 hours and aggregate all the metrics for that our and persist it.

Then we aggregating hourly metrics it simply for this newly stored metrics. It speed up the aggregation in a noticeable manner.

For that we have aggregate for all 4 resolution(sum, avg, max, min) in the background

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant