Healthchecks.io Stare - Istoric incidente

Welcome to the Healthchecks.io status page. If there are interruptions to service, we will post a report here, and on our Mastodon account.

Incidente din trecut

Iun, 2024

Mai, 2024

Apr, 2024

Iun, 2024
1. Delayed ping body processingNotification SenderDashboard
  A început: 18 Iun, 20:46 UTC
  Durată: 8 ore, 14 minute
  Our object storage provider is currently performing maintenance (scheduled on June 18th, 2024, from 18:00 UTC to 03:00 UTC). Some percentage of object storage API calls are currently failing, which causes the following problems for Healthchecks.io:
  
  * There's a delay in ping body uploads to object storage. When you view details of a recent ping you may see a "The request body data is not yet available, please check back later." message. The request bodies are not lost, and will be available eventually.
  * Our notification sender process can crash (and silently drop the notification it was about to send) when it hits an unexpected error from object storage. We're currently working on handling these errors.
  Identificat: 18 Iun, 21:11 UTC
  We have deployed a fix for the notification sender process crashing when it hits an unexpected error from object storage.
  Rezolvat: 19 Iun, 05:00 UTC
  Our object storage provider has completed the maintenance. Ping body processing is now back to working normally with no delays.
Mai, 2024
1. Database connectivity isssueNotification SenderPing APIDashboard
  A început: 3 Mai, 13:24 UTC
  Durată: 1 oră, 4 minute
  We're investigating an issue with our database.
  Investigarea: 3 Mai, 13:39 UTC
  We have failed over to a standby database instance.
  Se verifică: 3 Mai, 13:46 UTC
  The systems are back up and working through a backlog of outgoing notifications (caused by pings missed during the downtime).
  Rezolvat: 3 Mai, 14:29 UTC
  All systems are operational again. We are currently setting up a new standby database server, to replace the standby that was promoted to primary.
  
  The root cause of the outage was hardware failure: a broken power supply of one of the neighboring servers triggered a fuse in the database server's rack.
Apr, 2024
1. Network issuesPing APIDashboard
  A început: 29 Apr, 11:09 UTC
  Durată: 48 de minute
  We are currently experiencing intermittent network connectivity issues, caused by a networking infrastructure fault in our hosting provider's network.
  
  Status updates about the underlying issue: https://status.hetzner.com/incident/d3972134-e340-4082-b0ef-6ede4009c5a9
  Rezolvat: 29 Apr, 11:57 UTC
  The issue is resolved.
2. Network fault affecting one of our load balancer'sPing APIDashboard
  A început: 26 Apr, 12:55 UTC
  Durată: 31 de minute
  There's a network fault in our hosting provider's network, affecting one of our load balancers. The load balancer's DNS records were automatically removed.
  
  The network fault: https://status.hetzner.com/incident/35ca1da9-49fb-4899-8ba6-86425f57431e
  Rezolvat: 26 Apr, 13:26 UTC
  The issue is resolved.
3. Increased ping latency from clients in Hetzner networkPing APIDashboard
  A început: 17 Apr, 19:45 UTC
  Durată: 9 ore, 20 de minute
  We are currently seeing ping request latencies in the multi-second range from clients hosted in Hetzner network.
  
  Hetzner is currently performing backbone maintenance, which is the likely cause of the latency.
  Rezolvat: 18 Apr, 05:06 UTC
  The issue is resolved.