- Status: accepted
- Deciders: Bulat Lutfullin
- Date: 2021-12-24
Technical Story: description
Prometheus PushGateway integration messes up metric timestamps, making them depend on poll configuration of prometheus. In addition to that Prometheus doesn't support insert-into-past, thus making old metrics unimportable.
- Prometheus PushGateway doesn't respect metric timestamps
- Prometheus RemoteWrite API is not properly documented and unstable
- OpenTelemetry has good GRPC API
- OpenTelemetry collector has a variety of different exporters
- Implement OTLP exporter
- Implement RemoteWrite exporter
Chosen option: "Implement OTLP exporter", because it's stable, has GRPC, supports historical metrics, and has many integrations.
- Replaces ADR-4
- Uses OTLP GRPC API
- OTLP can export to Prometheus using RemoteWrite