All incidents — April 21, 2025 to April 19, 2026
INC-2026-014
SMTP Mail Gateway — Intermittent Delivery Delays
Apr 14, 2026
·
Partial Outage ·
1 service affected
+
2026-04-14 11:20 UTC
Investigating
Investigating reports of delayed email delivery via SMTP. Impact appears limited to a subset of customers on the US-IMM outbound relay.
2026-04-14 11:48 UTC
Identified
Root cause found — a routing loop on one edge node after a config push at 11:05 UTC is causing messages to queue instead of deliver. Failover engaged and traffic shifting to secondary relays.
2026-04-14 12:15 UTC
Monitoring
Fix deployed. Queue is draining. Monitoring delivery rates and will update once fully cleared.
2026-04-14 13:02 UTC
Resolved
All queued messages delivered. SMTP gateway fully operational. Total customer impact approximately 1 hour 42 minutes. Post-incident report to be published within 48 hours.
INC-2026-011
VPS Provisioning API — Elevated 5xx Error Rate
Mar 28, 2026
·
Partial Outage ·
1 service affected
+
2026-03-28 08:05 UTC
Investigating
Spike in 5xx responses on the VPS Provisioning API. New VM deployments may fail or time out. Existing VMs are not affected.
2026-03-28 08:30 UTC
Identified
Database connection pool exhaustion on the provisioning cluster. A batch migration job run at 07:50 held connections open longer than expected. Scaling connection limits and clearing idle pool entries now.
2026-03-28 08:57 UTC
Resolved
API error rate back to baseline. No VM data was lost. Failed deploys can be safely retried.
MNT-2026-009
Scheduled — NVMe Storage Upgrade, PH-Node Cluster
Feb 22, 2026
·
Maintenance ·
2 services affected
+
2026-02-22 02:00 UTC
In Progress
Maintenance window open. Live migration of VMs to upgraded NVMe Gen 4 arrays. Each VM will see a brief I/O pause of under 30 seconds during its window.
2026-02-22 04:47 UTC
Completed
All VMs migrated. Storage read/write performance up approximately 40%. Finished ahead of schedule.
INC-2026-005
DNS Infrastructure — BGP Route Leak Causing Resolution Failures
Feb 8, 2026
·
Major Outage ·
1 service affected
+
2026-02-08 09:15 UTC
Investigating
Reports of widespread DNS resolution failures across multiple regions. Engineering team paged.
2026-02-08 09:28 UTC
Identified
BGP route leak from an upstream peer is misdirecting traffic away from our authoritative nameservers. Peering session with affected upstream suspended.
2026-02-08 09:51 UTC
Monitoring
BGP session restored with corrected prefix filters. DNS resolution recovering globally. Monitoring propagation across all regions.
2026-02-08 10:22 UTC
Resolved
Full DNS resolution restored. Total impact roughly 67 minutes. Post-incident review scheduled for Feb 10.
INC-2026-002
Client Portal — Login Failures
Jan 17, 2026
·
Partial Outage ·
2 services affected
+
2026-01-17 16:00 UTC
Investigating
Multiple customers unable to log in. OAuth callback requests timing out.
2026-01-17 16:22 UTC
Identified
Expired TLS certificate on one of three auth nodes causing OAuth handshakes to fail for roughly a third of logins. Rolling new certificates to all nodes now.
2026-01-17 16:48 UTC
Resolved
Certificates renewed across all auth nodes. Login success rate back to 100%. No session data lost.
MNT-2025-024
Scheduled — Annual DDoS Scrubbing Centre Hardware Upgrade
Dec 28, 2025
·
Maintenance ·
1 service affected
+
2025-12-28 01:00 UTC
In Progress
Upgrade of Tier-2 DDoS scrubbing hardware underway. All traffic pre-shifted to Tier-1 centres. No customer impact expected.
2025-12-28 04:12 UTC
Completed
Hardware upgrade complete. New scrubbing capacity is 3 Tbps. All traffic rerouted back through upgraded hardware.
INC-2025-022
cPanel File Manager — Upload Errors on NL-SRV Cluster
Dec 11, 2025
·
Degraded ·
2 services affected
+
2025-12-11 13:30 UTC
Investigating
Customers on NL-SRV reporting 413 errors uploading files via File Manager.
2025-12-11 14:06 UTC
Identified
Config patch at 13:10 set Nginx client_max_body_size to 1MB incorrectly. Hotfix being deployed now.
2025-12-11 14:31 UTC
Resolved
Nginx config corrected across the cluster. Uploads working normally. Partial uploads can be retried.
INC-2025-020
Backup Servers — Sync Jobs Running Behind Schedule
Nov 23, 2025
·
Degraded ·
1 service affected
+
2025-11-23 04:00 UTC
Investigating
Backup sync jobs running 3-5 hours behind scheduled windows. Investigating storage throughput.
2025-11-23 06:35 UTC
Identified
Degraded RAID controller on backup-node-07 throttling disk I/O. Two drives showing pre-failure SMART errors. Node being isolated and workload redistributed.
2025-11-23 10:02 UTC
Resolved
Replacement drives installed, RAID rebuilt. All backup queues fully drained. No customer data lost.
INC-2025-018
Billing System — Payment Processing Failures
Nov 5, 2025
·
Partial Outage ·
1 service affected
+
2025-11-05 18:10 UTC
Investigating
Payment failures at checkout. Processor integration returning errors. No charges applied to affected customers.
2025-11-05 18:36 UTC
Identified
Scheduled API key rotation with Stripe was not updated in our secrets manager. Deploying correct keys now.
2025-11-05 18:52 UTC
Resolved
Payment processing restored. All failed transactions can be safely retried. No duplicates or incorrect charges.
MNT-2025-016
Scheduled — Kernel Security Updates, Shared Hosting Fleet
Oct 19, 2025
·
Maintenance ·
2 services affected
+
2025-10-19 03:00 UTC
In Progress
Rolling kernel updates across all shared hosting nodes. Sites will have under 90 seconds downtime during their node's restart. Updates are staggered to reduce overall impact.
2025-10-19 06:02 UTC
Completed
All nodes updated. CVE-2025-3721 and three related vulnerabilities patched.
INC-2025-015
CDN Edge Nodes — Degraded Performance, Asia-Pacific
Sep 30, 2025
·
Degraded ·
1 service affected
+
2025-09-30 07:45 UTC
Investigating
Elevated miss rates and latency above 250ms on SG and ID edge nodes. Traffic routing to secondary PoPs.
2025-09-30 08:22 UTC
Identified
Peering link failure with primary regional ISP in Singapore. Traffic rerouting via HK PoP.
2025-09-30 09:47 UTC
Resolved
Peering link restored. SG and ID nodes back online, cache warming.
INC-2025-013
RDP Gateway — Unexpected Session Disconnects
Sep 14, 2025
·
Partial Outage ·
1 service affected
+
2025-09-14 11:00 UTC
Investigating
Customers reporting RDP session drops every 10-15 minutes. Investigating gateway layer.
2025-09-14 11:42 UTC
Identified
Load balancer health check timeout set too aggressively in a recent config change, terminating healthy backend connections. Correcting now.
2025-09-14 12:11 UTC
Resolved
LB config corrected. Session stability confirmed over 30-minute observation. No data lost.
INC-2025-011
DNS — New Domain Propagation Delays
Aug 20, 2025
·
Degraded ·
1 service affected
+
2025-08-20 15:30 UTC
Investigating
New domains taking 3-6 hours to propagate vs expected sub-1-hour SLA.
2025-08-20 16:17 UTC
Identified
High provisioning volume from a promotional campaign backed up the zone transfer queue. Scaling nameserver workers.
2025-08-20 17:04 UTC
Resolved
Queue fully drained. Propagation back within SLA. Worker scaling made permanent.
INC-2025-009
SMTP Gateway — Outbound IP Blacklisting, US Region
Aug 1, 2025
·
Partial Outage ·
1 service affected
+
2025-08-01 06:00 UTC
Investigating
Outbound emails from US-IMM bouncing with 550 rejections at major providers. Treating as high priority.
2025-08-01 07:32 UTC
Identified
Compromised customer account sent bulk spam through our US relay, getting the IP range listed on Spamhaus XBL. Account suspended, delisting request submitted.
2025-08-01 08:45 UTC
Monitoring
Traffic shifted to clean IP range while delisting completes. Delivery rates recovering.
2025-08-01 10:05 UTC
Resolved
IP range delisted. All routing restored. Abuse detection improvements being implemented.
INC-2025-007
CloudPulse API — 503 Errors After DB Failover
Jul 9, 2025
·
Major Outage ·
1 service affected
+
2025-07-09 19:00 UTC
Investigating
API returning 503 errors on a subset of endpoints. On-call engineers paged.
2025-07-09 19:13 UTC
Identified
Primary DB failed over successfully but one of eight app nodes has a stale cached IP and cannot reconnect. That node handles ~12.5% of requests. Restarting it now.
2025-07-09 19:31 UTC
Monitoring
Node restarted and reconnected to new primary. Error rate dropping. Monitoring for 15 minutes.
2025-07-09 19:47 UTC
Resolved
All endpoints healthy. Impact was 47 minutes for ~12.5% of API traffic. DNS-based service discovery to be implemented to prevent this.
MNT-2025-006
Scheduled — IPv6 Rollout, LT Datacenter
Jun 15, 2025
·
Maintenance ·
3 services affected
+
2025-06-15 00:00 UTC
In Progress
Enabling dual-stack IPv6 across LT-BNK hosted services. IPv4 continuity guaranteed. No customer downtime expected.
2025-06-15 02:31 UTC
Completed
IPv6 live on LT datacenter. All services reachable on both stacks. Finished ahead of schedule.
INC-2025-005
Shared Hosting — PHP 500 Errors, NL-SRV Cluster
May 28, 2025
·
Partial Outage ·
1 service affected
+
2025-05-28 12:00 UTC
Investigating
Spike in PHP 500 errors on NL-SRV. Other clusters unaffected.
2025-05-28 12:27 UTC
Identified
Runaway cron job on a customer account consuming all PHP-FPM workers on the shared node. Account isolated and process killed.
2025-05-28 12:52 UTC
Resolved
PHP-FPM pools recovered. All sites responding normally. Per-account CPU limits being added.
INC-2025-003
WAF — False Positives Blocking Legitimate Traffic
May 10, 2025
·
Degraded ·
1 service affected
+
2025-05-10 09:00 UTC
Investigating
Customers reporting 403 errors for normal traffic. WAF rule update suspected.
2025-05-10 09:42 UTC
Identified
Rule update deployed at 08:45 contains overly broad regex matching common CMS query strings. Rule disabled.
2025-05-10 10:01 UTC
Resolved
Rule corrected and redeployed. Legitimate traffic passing through normally. CMS-specific testing added to review process.
INC-2025-002
Authentication Service — JWT Validation Failures
Apr 28, 2025
·
Partial Outage ·
2 services affected
+
2025-04-28 14:00 UTC
Investigating
Customers redirected back to login after authenticating. Dashboard access unavailable for affected users.
2025-04-28 14:19 UTC
Identified
Clock skew of ~4 minutes on one auth node rejecting freshly issued JWTs as expired. NTP daemon restarted, clock syncing.
2025-04-28 14:37 UTC
Resolved
Auth service fully operational. Adding clock skew monitoring to alerting stack.
INC-2025-001
Platform Launch — DNS Propagation Delays
Apr 21, 2025
·
Degraded ·
1 service affected
+
2025-04-21 10:00 UTC
Investigating
Some newly onboarded customers experiencing DNS resolution failures following platform launch. Monitoring propagation globally.
2025-04-21 11:00 UTC
Identified
NS records not yet propagated to all Tier-1 global resolvers. Taking longer than expected due to elevated query load at launch.
2025-04-21 14:10 UTC
Resolved
DNS fully propagated globally. All services operational. Thank you for your patience during launch.