The Graph
Moonbeam: Block ingestor lagging behind
Update - We are continuing to investigate this issue.
Oct 26, 13:01 UTC
Update - [Comment from Opsgenie]martynas acknowledged alert: "Moonbeam: Block ingestor lagging behind"
Oct 20, 17:30 UTC
Investigating - We are investigating the issue
Oct 20, 17:18 UTC
Too many failed gateway requests
Update - [Comment from Opsgenie]Martynas Prokopas acknowledged alert: "Too many failed gateway requests"
Oct 23, 15:29 UTC
Investigating - We are currently investigating this issue.
Oct 23, 15:07 UTC
Arbitrum One subgraphs with ethereum calls failing due to time-out
Update - Arbitrum released a new node version which seems to have fixed this problems. We are further monitoring the situation. If you feel you are affected by timeouts feel free to reach out in our Discord.
Oct 23, 13:41 UTC
Monitoring - A new node version was released by the Arbitrum team which should improve the situation.
Sep 23, 22:22 UTC
Identified - We are continuing to see slow responses on eth_calls, leading to intermittent failure of subgraphs which rely on that feature
Sep 19, 22:00 UTC
Monitoring - We increased capacity on the Arbitrum endpoints and it seems like this has fixed the issue. We are monitoring the system. Please reach out in Discord if you still have troubles.
Sep 18, 00:48 UTC
Update - We are continuing to investigate this issue
Sep 16, 21:42 UTC
Investigating - This is an intermittent failure. We are investigating.
Sep 16, 13:32 UTC
Subgraphs with errors do not switch their status to failed
Monitoring - The fix has been merged. It is in production. One note...if people want to query failed subgraphs, they'll have to add a subgraphError: allow to their queries as described here: https://github.com/graphprotocol/graph-node/issues/2885#issuecomment-947841678. Newly deployed subgraphs are working as intended. Previously failed subgraphs still might be affected and we are monitoring.
Oct 21, 17:28 UTC
Update - We are continuing to investigate this issue.
Oct 18, 07:43 UTC
Update - After troubleshooting, this appears to be a side effect of the PoI for a failed subgraph’s PR. We are working on the fix.
Oct 15, 18:00 UTC
Investigating - We are seeing notices for a small amount of subgraphs that return "message": "indexing_error." Affected subgraph otherwise index normally, as opposed to failing. These subgraphs are marked "health": "unhealthy" in our internal health-query.
Oct 15, 16:00 UTC
A percentage of eth_calls on BSC timed out
Investigating - We are currently investigating this issue.
Oct 19, 15:43 UTC
Intermittent Unreliable Logs
Investigating - We are seeing intermittent lack of reliability with logs. We are investigating to understand the issue, troubleshoot, and provide a solution.
Oct 19, 10:52 UTC
JSON RPC calls to Polygon timing out
Monitoring - A fix has been implemented and we are monitoring the results.
Sep 24, 23:35 UTC
Investigating - We are seeing timeouts on JSON RPC calls to the Polygon endpoints. This could result in slower indexing speed and ultimately in subgraphs failure. Please reach out in thegraph.com/discord #hosted-service if you experience problems with Polygon/Matic indexing.
Sep 24, 22:27 UTC
Problems with indexing subgraphs on Binance Smart Chain (BSC) on blocks before 7796111
Monitoring - A fix has been implemented and we are monitoring the results.
Sep 9, 15:22 UTC
Update - We are continuing to work on a fix for this issue.
Sep 9, 01:26 UTC
Identified - We have problems indexing blocks before 7796111. Work around: If the contract that you try to index is deployed after block 7796111 or you just start to index events after this block, it should work.
Jul 1, 13:51 UTC

About This Site

Status, incident and maintenance information for The Graph.
Use the RSS feed together with https://zapier.com/apps/rss to have updates sent straight to Slack or Discord.

Uptime over the past 90 days. View historical uptime.
Network - Gateway ? Degraded Performance
90 days ago
99.99 % uptime
Today
Network - Explorer ? Operational
90 days ago
100.0 % uptime
Today
Network - Subgraph Studio ? Operational
90 days ago
99.98 % uptime
Today
Network - Network Subgraph ? Operational
90 days ago
99.99 % uptime
Today
Hosted Service - Queries ? Operational
90 days ago
99.96 % uptime
Today
Hosted Service - Subgraph Health Operational
90 days ago
100.0 % uptime
Today
Hosted Service - Indexing Partial Outage
90 days ago
98.88 % uptime
Today
Mainnet Operational
90 days ago
99.98 % uptime
Today
Kovan Operational
90 days ago
100.0 % uptime
Today
Rinkeby Operational
90 days ago
100.0 % uptime
Today
Ropsten Operational
90 days ago
100.0 % uptime
Today
Goerli Operational
90 days ago
100.0 % uptime
Today
POA Core Operational
90 days ago
99.98 % uptime
Today
POA Sokol Operational
90 days ago
99.97 % uptime
Today
xDai Operational
90 days ago
100.0 % uptime
Today
Polygon (Matic) Operational
90 days ago
99.66 % uptime
Today
Mumbai Operational
90 days ago
99.19 % uptime
Today
Fantom Operational
90 days ago
98.04 % uptime
Today
BSC Operational
90 days ago
89.37 % uptime
Today
BSC Chapel Operational
90 days ago
96.61 % uptime
Today
Clover Operational
90 days ago
100.0 % uptime
Today
Avalanche Operational
90 days ago
100.0 % uptime
Today
Avalanche Fuji Operational
90 days ago
100.0 % uptime
Today
Celo Operational
90 days ago
100.0 % uptime
Today
Celo Alfajores Operational
90 days ago
100.0 % uptime
Today
Fuse Operational
90 days ago
100.0 % uptime
Today
Moonbeam Partial Outage
90 days ago
97.72 % uptime
Today
Arbitrum One Operational
90 days ago
93.96 % uptime
Today
Arbitrum Testnet (on Rinkeby) Operational
90 days ago
98.68 % uptime
Today
Optimism Operational
90 days ago
100.0 % uptime
Today
Optimism Testnet (on Kovan) Operational
90 days ago
99.99 % uptime
Today
Hosted Service - Miscellaneous Operational
90 days ago
99.99 % uptime
Today
Deployments ? Operational
90 days ago
99.99 % uptime
Today
IPFS Operational
90 days ago
99.99 % uptime
Today
Subgraph Logs ? Operational
90 days ago
99.99 % uptime
Today
Explorer ? Operational
90 days ago
99.99 % uptime
Today
thegraph.com ? Operational
90 days ago
99.99 % uptime
Today
Operational
Degraded Performance
Partial Outage
Major Outage
Maintenance
Major outage
Partial outage
No downtime recorded on this day.
No data exists for this day.
had a major outage.
had a partial outage.

No incidents or maintenance related to this downtime.

System Metrics Month Week Day
Network: Gateway (Response Time)
Fetching
Network Subgraph (Test Query)
Fetching
Network: Explorer (Response Time)
Fetching
Past Incidents
Oct 27, 2021

No incidents reported today.

Oct 26, 2021

Unresolved incident: Moonbeam: Block ingestor lagging behind.

Oct 25, 2021
Arbitrum One: Block ingestor lagging behind
Resolved - This incident has been resolved.
Oct 25, 17:03 UTC
Update - [Comment from Opsgenie]martynas acknowledged alert: "Arbitrum One: Block ingestor lagging behind"
Oct 25, 16:49 UTC
Investigating - We are currently investigating this issue.
Oct 25, 16:38 UTC
Hosted Service - Queries: too many failed requests
Resolved - This incident has been resolved.
Oct 25, 10:23 UTC
Investigating - We are currently investigating this issue.
Oct 25, 10:14 UTC
thegraph.com: Web Server HTTPS has failed an uptime check
Resolved - This incident has been resolved.
Oct 25, 09:54 UTC
Investigating - CRITICAL - Socket timeout after 40 seconds
Oct 25, 09:19 UTC
Studio API: Query Proxy has failed an uptime check
Resolved - This incident has been resolved.
Oct 25, 09:54 UTC
Investigating - HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 40001 milliseconds with 0 bytes received
Oct 25, 09:20 UTC
thegraph.com: Web Server HTTP has failed an uptime check
Resolved - This incident has been resolved.
Oct 25, 09:54 UTC
Investigating - CRITICAL - Socket timeout after 40 seconds
Oct 25, 09:19 UTC
Hosted Service - Queries: too many failed requests
Resolved - This incident has been resolved.
Oct 25, 09:53 UTC
Update - [Comment from Opsgenie]Martynas Prokopas acknowledged alert: "Hosted Service - Queries: too many failed requests"
Oct 25, 09:49 UTC
Investigating - We are currently investigating this issue.
Oct 25, 09:36 UTC
Studio API: Deployment Router has failed an uptime check
Resolved - This incident has been resolved.
Oct 25, 09:53 UTC
Investigating - HTTP CRITICAL: HTTP/1.1 521 - 655 bytes in 0.092 second response time

time=0.091562s;;;0.000000;40.000000 size=655B;;;0
Oct 25, 09:18 UTC
API: Subgraph Logs has failed an uptime check
Resolved - This incident has been resolved.
Oct 25, 09:52 UTC
Investigating - CRITICAL - STEP 1: Check timed out after 30s.

time=30.000348
Oct 25, 09:21 UTC
API: Deploy has failed an uptime check
Resolved - This incident has been resolved.
Oct 25, 09:50 UTC
Investigating - CRITICAL - STEP 2: Expected status code 200 but server returned 521.

time=16.607988
Oct 25, 09:22 UTC
Network: Subgraph Studio has failed an uptime check
Resolved - This incident has been resolved.
Oct 25, 09:50 UTC
Investigating - HTTP CRITICAL: HTTP/1.1 521 - 655 bytes in 0.112 second response time

time=0.112232s;;;0.000000;40.000000 size=655B;;;0
Oct 25, 09:18 UTC
Studio API: GraphQL has failed an uptime check
Resolved - This incident has been resolved.
Oct 25, 09:50 UTC
Investigating - HTTP CRITICAL: HTTP/1.1 521 - 655 bytes in 1.545 second response time

time=1.544970s;;;0.000000;40.000000 size=655B;;;0
Oct 25, 09:18 UTC
thegraph.com: Explorer has failed an uptime check
Resolved - This incident has been resolved.
Oct 25, 09:50 UTC
Investigating - HTTP CRITICAL: HTTP/1.1 521 - 1369 bytes in 0.115 second response time

time=0.115108s;;;0.000000 size=1369B;;;0
Oct 25, 09:18 UTC
API: Query Nodes has failed an uptime check
Resolved - This incident has been resolved.
Oct 25, 09:49 UTC
Investigating - HTTP CRITICAL: HTTP/1.1 521 - 1369 bytes in 0.269 second response time

time=0.269251s;;;0.000000 size=1369B;;;0
Oct 25, 09:17 UTC
API: IPFS has failed an uptime check
Resolved - This incident has been resolved.
Oct 25, 09:48 UTC
Investigating - HTTP CRITICAL: HTTP/1.1 521 - 1369 bytes in 0.097 second response time

time=0.096534s;;;0.000000 size=1369B;;;0
Oct 25, 09:17 UTC
API: Explorer OAuth has failed an uptime check
Resolved - This incident has been resolved.
Oct 25, 09:48 UTC
Investigating - HTTP CRITICAL: HTTP/1.1 521 - 1369 bytes in 0.330 second response time

time=0.329999s;;;0.000000 size=1369B;;;0
Oct 25, 09:17 UTC
API: Explorer Query has failed an uptime check
Resolved - This incident has been resolved.
Oct 25, 09:48 UTC
Investigating - HTTP CRITICAL: HTTP/1.1 521 - string data:{featuredSubgraphs... not found on https://api.thegraph.com:443/explorer/graphql?query=%7BfeaturedSubgraphs%7Bid%7D%7D - 6858 bytes in 0.464 second response time

time=0.464018s;;;0.000000 size=6858B;;;0
Oct 25, 09:18 UTC
Oct 24, 2021

No incidents reported.

Oct 23, 2021
Network: Network Subgraph has failed an uptime check
Resolved - This incident has been resolved.
Oct 23, 19:35 UTC
Investigating - CRITICAL - STEP 3: Expected response body to not contain text \errors\: but it was found at offset 1.

time=1.580737
Oct 23, 19:32 UTC
Too many failed gateway requests
Resolved - This incident has been resolved.
Oct 23, 15:01 UTC
Investigating - We are currently investigating this issue.
Oct 23, 14:58 UTC
POA Sokol: Block ingestor lagging behind
Resolved - This incident has been resolved.
Oct 23, 14:57 UTC
Investigating - We are currently investigating this issue.
Oct 23, 13:29 UTC
Too many failed gateway requests
Resolved - This incident has been resolved.
Oct 23, 14:00 UTC
Investigating - We are currently investigating this issue.
Oct 23, 13:29 UTC
Too many failed gateway requests
Resolved - This incident has been resolved.
Oct 23, 13:19 UTC
Investigating - We are currently investigating this issue.
Oct 23, 12:54 UTC
Too many failed gateway requests
Resolved - This incident has been resolved.
Oct 23, 11:57 UTC
Investigating - We are currently investigating this issue.
Oct 23, 08:52 UTC
Too many failed gateway requests
Resolved - This incident has been resolved.
Oct 23, 07:39 UTC
Investigating - We are currently investigating this issue.
Oct 23, 07:21 UTC
Too many failed gateway requests
Resolved - This incident has been resolved.
Oct 23, 06:16 UTC
Investigating - We are currently investigating this issue.
Oct 23, 06:04 UTC
Oct 22, 2021
Too many failed gateway requests
Resolved - This incident has been resolved.
Oct 22, 18:48 UTC
Update - [Comment from Opsgenie]Martynas Prokopas acknowledged alert: "Too many failed gateway requests"
Oct 22, 18:46 UTC
Investigating - We are currently investigating this issue.
Oct 22, 18:35 UTC
Too many failed gateway requests
Resolved - This incident has been resolved.
Oct 22, 18:25 UTC
Investigating - We are currently investigating this issue.
Oct 22, 18:23 UTC
Too many failed gateway requests
Resolved - This incident has been resolved.
Oct 22, 17:54 UTC
Update - [Comment from Opsgenie]Martynas Prokopas acknowledged alert: "Too many failed gateway requests"
Oct 22, 17:46 UTC
Investigating - We are currently investigating this issue.
Oct 22, 17:46 UTC
Oct 21, 2021

Unresolved incident: Subgraphs with errors do not switch their status to failed.

Oct 20, 2021
No new blocks on POA core
Resolved - This incident has been resolved.
Oct 20, 17:44 UTC
Monitoring - We were able to fix the problem. Should be working now. If you still have problems with POA-core, please reach out in Discord.
Oct 8, 08:54 UTC
Investigating - We see a problem with no new blocks on POA core. We are investigating.
Oct 8, 08:38 UTC
Mumbai: Block ingestor lagging behind
Resolved - This incident has been resolved.
Oct 20, 07:13 UTC
Investigating - We are investigating the issue
Oct 20, 06:30 UTC
Oct 19, 2021
test
Resolved - This incident has been resolved.
Oct 19, 18:37 UTC
Investigating - We are currently investigating this issue.
Oct 19, 18:37 UTC
test
Resolved - This incident has been resolved.
Oct 19, 18:37 UTC
Investigating - We are currently investigating this issue.
Oct 19, 18:37 UTC
test
Resolved - This incident has been resolved.
Oct 19, 18:36 UTC
Investigating - We are currently investigating this issue.
Oct 19, 18:36 UTC
test
Resolved - This incident has been resolved.
Oct 19, 18:34 UTC
Investigating - We are currently investigating this issue.
Oct 19, 18:33 UTC
[Grafana]: TEST SYNCING alert
Resolved - This incident has been resolved.
Oct 19, 18:32 UTC
Update - [Comment from Opsgenie]Martynas Prokopas acknowledged alert: "[Grafana]: TEST SYNCING alert"
Oct 19, 18:32 UTC
Investigating - TEST SYNCING alert - https://thegraph.grafana.net/d/C4H7rtd7k/test?tab=alert&viewPanel=2&orgId=1

Triggered metrics:

mainnet: 25.815
Oct 19, 18:30 UTC
test
Resolved - This incident has been resolved.
Oct 19, 18:27 UTC
Investigating - We are currently investigating this issue.
Oct 19, 18:27 UTC
test2
Resolved - This incident has been resolved.
Oct 19, 18:26 UTC
Investigating - We are currently investigating this issue.
Oct 19, 18:26 UTC
Optimism Kovan regenesis, hence chain is not functioning on The Hosted service
Resolved - The Optimism-kovan regenesis (database clean up and other miscellaneous items) has been completed successfully. The chain is back online and functioning properly
Oct 19, 13:12 UTC
Investigating - We are currently investigating this issue.
Oct 18, 14:18 UTC
Elevated API Errors
Resolved - This incident has been resolved.
Oct 19, 02:01 UTC
Investigating - We're experiencing an elevated level of API errors and are currently looking into the issue.
Oct 19, 01:58 UTC
Oct 18, 2021
Subgraph indexing interrupted (Ethereum Mainnet)
Resolved - This incident has been resolved.
Oct 18, 07:37 UTC
Investigating - Our block ingestor is lagging behind for the Ethereum Mainnet network. Subgraphs will continue serving queries from the latest block.
Oct 18, 06:38 UTC
Subgraph indexing interrupted (Arbitrum One network)
Resolved - This incident has been resolved.
Oct 18, 07:37 UTC
Investigating - Our block ingestor is lagging behind for the Arbitrum One network. Subgraphs will continue serving queries from the latest block.
Oct 18, 06:47 UTC
Oct 17, 2021

No incidents reported.

Oct 16, 2021

No incidents reported.

Oct 15, 2021
Elevated API Errors
Resolved - This incident has been resolved.
Oct 15, 02:50 UTC
Investigating - We're experiencing an elevated level of API errors and are currently looking into the issue.
Oct 15, 02:49 UTC
Oct 14, 2021

No incidents reported.

Oct 13, 2021

No incidents reported.

← Incident History Powered by Atlassian Statuspage