Aug 7, 17:59 UTC
Resolved - This incident has been resolved.
Aug 7, 17:59 UTC
Update - The issue has been resolved.
Aug 7, 16:00 UTC
Update - The system has recovered. We will continue observing for two more hours and send one more update then.
Aug 7, 13:55 UTC
Update - The rollback was completed and the system is expected to recover within the next 2 hours. The next update will be in 2 hours around 16:00 UTC.
Aug 7, 12:42 UTC
Update - Partial loss of Forge app metrics happening intermittently.
Timeline
2024-08-07 10:15 UTC: impact start
2024-08-07 11:20 UTC: impact end
2024-08-07 12:25 UTC: impact start
We are in the process of rolling back a probable cause of the issue. We will keep monitoring for around 4 hours to ensure the system behaves as expected.
We will provide another update at around 2024-08-07 14:00 UTC.
Aug 7, 11:39 UTC
Investigating - We have identified a problem with Forge metrics where some metrics are lost. Metric loss started happening at around 10:15 UTC time and lasted for around one hour.
We are investigating the root cause and will provide another update by 12:30 UTC