Healthchecks.io Tila

Welcome to the Healthchecks.io status page. If there are interruptions to service, we will post a report here, and on our Mastodon account. 

Aiemmat tapaukset

Tou, 2024
  
  
Huh, 2024
     
Maa, 2024
    
  1. Tou, 2024

    1. Database connectivity isssueNotification SenderPing APIDashboard
      Aloittanut:
      Kesto:
      We're investigating an issue with our database.

      Tutkitaan:

      We have failed over to a standby database instance.

      Tarkistetaan:

      The systems are back up and working through a backlog of outgoing notifications (caused by pings missed during the downtime).

      Ratkaistu:

      All systems are operational again. We are currently setting up a new standby database server, to replace the standby that was promoted to primary.

      The root cause of the outage was hardware failure: a broken power supply of one of the neighboring servers triggered a fuse in the database server's rack.
  2. Huh, 2024

    1. Network issuesPing APIDashboard
      Aloittanut:
      Kesto:
      We are currently experiencing intermittent network connectivity issues, caused by a networking infrastructure fault in our hosting provider's network. 

      Status updates about the underlying issue: https://status.hetzner.com/incident/d3972134-e340-4082-b0ef-6ede4009c5a9

      Ratkaistu:

      The issue is resolved.
    2. Aloittanut:
      Kesto:
      There's a network fault in our hosting provider's network, affecting one of our load balancers. The load balancer's DNS records were automatically removed.

      The network fault: https://status.hetzner.com/incident/35ca1da9-49fb-4899-8ba6-86425f57431e

      Ratkaistu:

      The issue is resolved.
    3. Aloittanut:
      Kesto:
      We are currently seeing ping request latencies in the multi-second range from clients hosted in Hetzner network.

      Hetzner is currently performing backbone maintenance, which is the likely cause of the latency.

      Ratkaistu:

      The issue is resolved.
  3. Maa, 2024

    1. Webhook delivery failuresNotification Sender
      Aloittanut:
      Kesto:
      Healthchecks.io was not delivering webhook notifications for about 10 minutes starting from 07:45 UTC. The issue was caused by a bad deploy, and has now been fixed.

      Ratkaistu:

      The issue is resolved.