Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Emit malloc metrics #1214

Closed
wants to merge 4 commits into from
Closed

Emit malloc metrics #1214

wants to merge 4 commits into from

Conversation

vladem
Copy link
Contributor

@vladem vladem commented Jan 9, 2025

This PR adds malloc metrics, which should help us to reason about memory wasted because of fragmentation.

Also it tunes malloc to disable dynamic MMAP_THRESHOLD, which may be the reason for fragmentation. In local tests this leads to memory being released straight away to the OS (RSS consumption is lower, strace reports munmap being called after each part received from S3GetObjectResponse.

Does this change impact existing behavior?

TBD

Does this change need a changelog entry?

TBD


By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license and I agree to the terms of the Developer Certificate of Origin (DCO).

@vladem vladem requested a deployment to PR integration tests January 9, 2025 14:13 — with GitHub Actions Waiting
@vladem vladem requested a deployment to PR integration tests January 9, 2025 14:13 — with GitHub Actions Waiting
@vladem vladem requested a deployment to PR integration tests January 9, 2025 14:13 — with GitHub Actions Waiting
@vladem vladem requested a deployment to PR integration tests January 9, 2025 14:13 — with GitHub Actions Waiting
@vladem vladem requested a deployment to PR integration tests January 9, 2025 14:13 — with GitHub Actions Waiting
@vladem vladem requested a deployment to PR integration tests January 9, 2025 14:13 — with GitHub Actions Waiting
@vladem vladem requested a deployment to PR integration tests January 9, 2025 14:13 — with GitHub Actions Waiting
@vladem vladem added the performance PRs to run benchmarks on label Jan 9, 2025
Signed-off-by: Vlad Volodkin <[email protected]>
Signed-off-by: Vlad Volodkin <[email protected]>
@vladem vladem temporarily deployed to PR integration tests January 9, 2025 14:22 — with GitHub Actions Inactive
@vladem vladem temporarily deployed to PR integration tests January 9, 2025 14:22 — with GitHub Actions Inactive
@vladem vladem temporarily deployed to PR integration tests January 9, 2025 14:22 — with GitHub Actions Inactive
@vladem vladem temporarily deployed to PR integration tests January 9, 2025 14:22 — with GitHub Actions Inactive
@vladem vladem temporarily deployed to PR integration tests January 9, 2025 14:22 — with GitHub Actions Inactive
@vladem vladem temporarily deployed to PR integration tests January 9, 2025 14:22 — with GitHub Actions Inactive
@vladem vladem temporarily deployed to PR integration tests January 9, 2025 14:22 — with GitHub Actions Inactive
Vlad Volodkin added 2 commits January 9, 2025 15:00
Signed-off-by: Vlad Volodkin <[email protected]>
Signed-off-by: Vlad Volodkin <[email protected]>
@vladem vladem requested a deployment to PR integration tests January 9, 2025 18:52 — with GitHub Actions Waiting
@vladem vladem requested a deployment to PR integration tests January 9, 2025 18:52 — with GitHub Actions Waiting
@vladem vladem requested a deployment to PR integration tests January 9, 2025 18:52 — with GitHub Actions Waiting
@vladem vladem requested a deployment to PR integration tests January 9, 2025 18:52 — with GitHub Actions Waiting
@vladem vladem deployed to PR benchmarks January 9, 2025 18:52 — with GitHub Actions Active
@vladem vladem requested a deployment to PR integration tests January 9, 2025 18:52 — with GitHub Actions Waiting
@vladem vladem requested a deployment to PR integration tests January 9, 2025 18:52 — with GitHub Actions Waiting
@vladem vladem requested a deployment to PR integration tests January 9, 2025 18:52 — with GitHub Actions Waiting
@vladem vladem closed this Jan 10, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
performance PRs to run benchmarks on
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant