[Grafana]: Subgraph Health: Too many indexing errors

Incident Report for The Graph

Resolved

This incident has been resolved.

Posted Mar 24, 2025 - 11:09 UTC

Update

[Comment from Opsgenie]Leonardo Schwarzstein acknowledged alert: "[Grafana]: Subgraph Health: Too many indexing errors"

Posted Mar 19, 2025 - 15:27 UTC

Investigating

[FIRING:1] Subgraph Health: Too many indexing errors Production (partial_outage indexers high P2-High true Network Engineering)
https://thegraph.grafana.net/alerting/list

**Firing**

Value: [no value]
Labels:
- alertname = Subgraph Health: Too many indexing errors
- cmp_Hosted Service - Subgraph Health = partial_outage
- component = indexers
- grafana_folder = Production
- level = high
- priority = P2-High
- statuspage = true
- team = Network Engineering
Annotations:
- Error = [sse.dataQueryError] failed to execute query [A]: invalid character '
- grafana_state_reason = Error
- statuspage = Subgraph Health: Too many indexing errors
Source: https://thegraph.grafana.net/alerting/grafana/GGM_62G4k/view?orgId=1
Silence: https://thegraph.grafana.net/alerting/silence/new?alertmanager=grafana&matcher=__alert_rule_uid__%3DGGM_62G4k&matcher=cmp_Hosted+Service+-+Subgraph+Health%3Dpartial_outage&matcher=component%3Dindexers&matcher=level%3Dhigh&matcher=priority%3DP2-High&matcher=statuspage%3Dtrue&matcher=team%3DNetwork+Engineering&orgId=1
Dashboard: https://thegraph.grafana.net/d/7rcuDImZk?orgId=1
Panel: https://thegraph.grafana.net/d/7rcuDImZk?orgId=1&viewPanel=69

Posted Mar 19, 2025 - 14:21 UTC