Skip to main content

ClickHouse Cloud metrics now have a New Relic ingestion path

· One min read
Atlas Infra

Atlas now has a Terraform-managed path for ClickHouse Cloud infrastructure metrics in New Relic.

This update adds:

  • a dedicated ECS/Fargate Prometheus agent for ClickHouse Cloud metrics
  • a dedicated Secrets Manager secret for ClickHouse Cloud API credentials and the New Relic ingest license key
  • use of the official Prometheus image with an ECS task startup command that renders prometheus.yml
  • a New Relic dashboard scoped to the collector's prometheus_server attribute

The collector scrapes the ClickHouse Cloud service-scoped Prometheus endpoint with filtered_metrics=false, uses basic authentication with a ClickHouse Cloud API key, keeps only the ClickHouse and ClickPipes metrics required by the dashboard, and remote-writes to the New Relic Prometheus endpoint for the configured account region.

This is intentionally an ingestion and dashboard MVP. Slack alerts are not created by this Terraform path yet; New Relic NRQL alert conditions and Slack workflows should come after live metric names, cardinality, and thresholds are validated from live data.

2026-04-28 update​

Production now exposes the same ClickHouse Prometheus agent outputs and New Relic dashboard path as staging. The collector service desired count remains controlled separately through clickhouse_prometheus_agent_desired_count, which is currently 0 in the committed roots until active collection should run.