Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Deprecate munin in March 2024 #501

Closed
pnorman opened this issue Jan 15, 2021 · 15 comments · Fixed by openstreetmap/chef#650
Closed

Deprecate munin in March 2024 #501

pnorman opened this issue Jan 15, 2021 · 15 comments · Fixed by openstreetmap/chef#650
Labels
decommission service:prometheus Metric collection, storage, and display

Comments

@pnorman
Copy link
Collaborator

pnorman commented Jan 15, 2021

The OWG intends to deprecate our use of munin, being satisifed that prometheus offers all the functionality we need

To do this we need to get 6 months to a year of data in prometheus so we always have enough historical data to predict future demand.

@pnorman pnorman added the service:prometheus Metric collection, storage, and display label Jan 15, 2021
@matkoniecz
Copy link

@tomhughes
Copy link
Member

Maybe you could leave it to us to decide when the migration is sufficiently advanced that things need changing?

@matkoniecz
Copy link

Things on OSM Wiki typically are deeply outdated, but feel free to revert my changes on pages that are actually maintained by someone with more specific sysadmin knowledge.

@tomhughes
Copy link
Member

I don't really know why the automated edits page even has that - it's hard to believe anybody actually does that and it's not really reasonable to expect people to interpret the graphs to identify a quiet time. I suspect that language goes back years and somebody tried to be "helpful" by adding the link to munin...

@matkoniecz
Copy link

It also seemed to be suspicious to me, but I decided that I am not knowledgeable enough to meddle with that.

Now, given independent confirmation I posted to [email protected] to get feedback from DWG (they are subscribed to this list, so it gives them chance to protest if it still make sense).

@SomeoneElseOSM
Copy link

I posted to [email protected] to get feedback from DWG

I suspect that Tom's comment above describes exactly what happened.

@Zverik
Copy link

Zverik commented Jan 25, 2021

To repeat a question from #360, since Munin is being deprecated, will we have a replacement public dashboard? It was sometimes useful monitoring load on tile servers and API.

@tomhughes
Copy link
Member

It's been public for some time

@iandees
Copy link

iandees commented Jan 25, 2021

will we have a replacement public dashboard?

@Zverik, use https://prometheus.openstreetmap.org/

@pnorman
Copy link
Collaborator Author

pnorman commented Nov 18, 2022

The main use for munin right now is getting historical data for capacity planning.

See also #484

@Firefishy
Copy link
Member

Test removing munin from chef reduced total kitchen test runtime from ~7 hours to ~6 hours.
https://github.com/openstreetmap/chef/actions/runs/3623104415/usage

@grischard
Copy link
Collaborator

grischard commented Dec 15, 2022

We'll wait until we have at least one year of data in promotheus before retiring munin, so that we can still do some capacity planning without pulling hair. This should happen around September 2023.

@Firefishy
Copy link
Member

Data goes back as far as March 2023. New one year date is March 2024.

@grischard grischard changed the title Deprecate munin Deprecate munin in Marc 2024 Feb 2, 2024
@grischard grischard changed the title Deprecate munin in Marc 2024 Deprecate munin in March 2024 Feb 3, 2024
Firefishy added a commit to Firefishy/chef that referenced this issue Mar 12, 2024
Firefishy added a commit to Firefishy/chef that referenced this issue Mar 12, 2024
Fixed: openstreetmap/operations#501
Signed-off-by: Grant Slater <[email protected]>
Firefishy added a commit to Firefishy/chef that referenced this issue Mar 12, 2024
Fixed: openstreetmap/operations#501
Signed-off-by: Grant Slater <[email protected]>
Firefishy added a commit to Firefishy/chef that referenced this issue Mar 12, 2024
Fixed: openstreetmap/operations#501
Signed-off-by: Grant Slater <[email protected]>
Firefishy added a commit to Firefishy/chef that referenced this issue Mar 12, 2024
Fixed: openstreetmap/operations#501
Signed-off-by: Grant Slater <[email protected]>
Firefishy added a commit to Firefishy/chef that referenced this issue Mar 12, 2024
Fixed: openstreetmap/operations#501
Signed-off-by: Grant Slater <[email protected]>
Firefishy added a commit to Firefishy/chef that referenced this issue Mar 12, 2024
Fixed: openstreetmap/operations#501
Signed-off-by: Grant Slater <[email protected]>
Firefishy added a commit to openstreetmap/chef that referenced this issue Mar 13, 2024
Fixed: openstreetmap/operations#501
Signed-off-by: Grant Slater <[email protected]>
@Firefishy
Copy link
Member

Munin has now been removed. I will shortly add a basic munin → prometheus web redirect.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
decommission service:prometheus Metric collection, storage, and display
Projects
None yet
Development

Successfully merging a pull request may close this issue.

8 participants