[Grafana]: Arbitrum-One: Block ingestor lagging behind

Incident Report for The Graph

Resolved

This incident has been resolved.

Posted Oct 10, 2025 - 19:56 UTC

Update

[Comment from Opsgenie]Ruslan Rotaru acknowledged alert: "[Grafana]: Arbitrum-One: Block ingestor lagging behind"

Posted Oct 10, 2025 - 19:37 UTC

Investigating

[FIRING:1] Arbitrum-One: Block ingestor lagging behind Production (partial_outage indexers P2-High true Infrastructure)
https://thegraph.grafana.net/alerting/list

**Firing**

Value: [no value]
Labels:
- alertname = Arbitrum-One: Block ingestor lagging behind
- cmp = partial_outage
- component = indexers
- grafana_folder = Production
- priority = P2-High
- statuspage = true
- team = Infrastructure
Annotations:
- Error = [sse.dataQueryError] failed to execute query [A]: Post "https://victoria-metrics.thegraph.com/select/105542/prometheus/api/v1/query": dial tcp 172.64.147.225:443: i/o timeout
- description = Triggered when the block ingestor is lagging
- grafana_state_reason = Error
- statuspage = Arbitrum-One: Block ingestor lagging behind
Source: https://thegraph.grafana.net/alerting/grafana/ddjeivf9xwmpsf/view?orgId=1
Silence: https://thegraph.grafana.net/alerting/silence/new?alertmanager=grafana&matcher=__alert_rule_uid__%3Dddjeivf9xwmpsf&matcher=cmp%3Dpartial_outage&matcher=component%3Dindexers&matcher=priority%3DP2-High&matcher=statuspage%3Dtrue&matcher=team%3DInfrastructure&orgId=1
Dashboard: https://thegraph.grafana.net/d/7rcuDImZk?from=1760121380000&orgId=1&to=1760125015269
Panel: https://thegraph.grafana.net/d/7rcuDImZk?from=1760121380000&orgId=1&to=1760125015269&viewPanel=83

Posted Oct 10, 2025 - 19:36 UTC