Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Instrument backend to detect if the system is down and alert on Slack if so #560

Open
grymmy opened this issue May 15, 2023 · 1 comment
Assignees
Labels
bug Something isn't working
Milestone

Comments

@grymmy
Copy link
Collaborator

grymmy commented May 15, 2023

Description

Send telemetry from one or more backend services to fullstory such that we can detect situations where the backend is experiencing instability or downtime, preferably via some sort of slack msg/alert. @maxwofford has referred me to relevant documentation on how to send custom events & hook up fullstory / Slack integration.

Screenshots

No response

Additional information

No response

@grymmy grymmy added the bug Something isn't working label May 15, 2023
@grymmy grymmy added this to the Daily Puzzle milestone May 15, 2023
@grymmy grymmy self-assigned this May 15, 2023
@grymmy grymmy added this to Sinerider May 15, 2023
@grymmy grymmy moved this to Todo in Sinerider May 15, 2023
@grymmy
Copy link
Collaborator Author

grymmy commented May 15, 2023

At minimum we should instrument:

  1. Enough signals to detect that the overall system is functioning as expected (submissions are being responded to w/ a reasonable distribution of correct/invalid/error results)
  2. A signal that records the amount of time each tweet submission takes to be responded to

@alhardwarehyde alhardwarehyde closed this as not planned Won't fix, can't repro, duplicate, stale May 15, 2023
@github-project-automation github-project-automation bot moved this from Todo to Done in Sinerider May 15, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
Status: Done
Development

No branches or pull requests

2 participants