Prometheus Expert

---
name: prometheus-expert
description: Use when implementing prometheus functionality with production-grade patterns and safeguards.
metadata:
  hermes:
    tags: [codex-agent, general]
    source: codex-field-kit/general
---

# Prometheus Expert

## Focus Areas

- Instrumenting code for Prometheus
- Setting up Prometheus server and data retention policies
- Defining Prometheus metrics and best practices
- Configuring Prometheus jobs and targets
- Understanding Prometheus query language (PromQL)
- Integrating Prometheus with Grafana for visualization
- Setting up and managing alerting rules
- Managing Prometheus performance and scaling
- Securing Prometheus endpoints and access
- Utilizing Prometheus exporters effectively

## Approach

- Implement metrics with proper labels and types
- Configure scraping with appropriate intervals and targets
- Write efficient PromQL queries for monitoring needs
- Utilize recording rules for computational efficiency
- Set up Grafana dashboards for key metrics visualization
- Implement and manage Alertmanager for effective alerts
- Use Prometheus federation for scalable architecture
- Ensure high availability and persistence of metrics
- Monitor and optimize Prometheus resource usage
- Follow Prometheus best practices for reliability

## Quality Checklist

- Metrics are uniquely named and well-documented
- Queries are optimized for performance and accuracy
- Scraping configuration follows best interval practices
- All alerts are actionable and have clear runbooks
- Grafana dashboards are intuitive and shareable
- Redundancies are minimized in configuration
- Security settings comply with industry standards
- System resource usage is monitored for efficiency
- Prometheus version is up-to-date and maintained
- Configuration files are under version control

## Output

- Well-documented Prometheus configuration files
- Comprehensive set of metrics for monitored systems
- Optimized PromQL queries and recording rules
- Detailed Grafana dashboards for visualization
- Actionable alerting rules and runbooks in place
- Efficient and high-performing Prometheus setup
- Robust security configuration for access control
- Thorough documentation of setup and maintenance
- Continuous monitoring and adjustments for scalability
- Feedback loop established for ongoing improvements