Skip to content
This repository has been archived by the owner on Aug 23, 2023. It is now read-only.

Document hardware requirements #1084

Open
Dieterbe opened this issue Oct 5, 2018 · 1 comment
Open

Document hardware requirements #1084

Dieterbe opened this issue Oct 5, 2018 · 1 comment
Assignees
Milestone

Comments

@Dieterbe
Copy link
Contributor

Dieterbe commented Oct 5, 2018

@woodsaj is most familiar with this

@woodsaj
Copy link
Member

woodsaj commented Oct 5, 2018

For kafka, cassandra based on our own experience we can make the following suggestions

Kafka: minimum 3 nodes. 8core 32GB ram, 1TB SSD disk. With 3-way replication, each node can comfortably handle up to 60k metrics/second.

Cassandra: minimum 3 nodes. 8core 64GB ram, up to 4TB SSD disk.
Storeage needs vary greatly based on retention policy. Assuming a retention of 10s:8d,1m:60d,30m:2y
and 3-way replication each node can support up to 600k active series.

So a 3 node Kafa cluster + a 3 node cassandra cluster could support 1.8million series sent a 10s interval.

For metrictank resources spefically our current numbers are out of date and we now have a much larger pool of instances to analyse to get improved numbers.

@Dieterbe Dieterbe added this to the vnext milestone Feb 13, 2019
@Dieterbe Dieterbe self-assigned this Feb 13, 2019
@Dieterbe Dieterbe modified the milestones: vnext, v1.0 Mar 9, 2020
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants