Disclaimer:
This isn’t a guide, this post just outlines my approach at achieving a solution.
Background
Components
- Metrics: Prometheus / VictoriaMetrics
- Visualizations: Grafana
- Logs: Loki
- Alerts: AlertManager
- IRM:
Grafana Oncallomitting this since we plan to deprecate its usage