Issue Summary
On Monday 29th May we experienced a failed deployment of a TLS certificate which impacted a number of CNAMEs. Impacted customers would have seen requests to Cloudflare using i8.amplience.net and any custom CNAME configured on the certificate fail during the incident
Root Causes
We carried out a standard change (pre-authorized and low-risk) which failed before being deployed onto one of our CDN providers, Cloudflare. The certificate was re-issued and reapplied to all relevant CNAMES on our infrastructure to restore service.
Corrective Actions
Internally, we have discussed this at length to ensure the integrity of service.
We have added in additional approval steps to our processes
Further monitoring is to be implemented to monitor every certificate.
We have also reviewed our processes to ensure a more efficient recovery of service.
If you would like to discuss this further, please contact your customer success manager (csteam@amplience.com)