Service degradation in uploading new image and derived image creation

Incident Report for Cloudinary

Resolved

Service back to normal
Posted Aug 10, 2015 - 06:58 EDT

Update

AWS S3 performance seems back to normal, error rates are down to normal. We are still monitoring.
Posted Aug 10, 2015 - 06:38 EDT

Update

We are moving parts of our infrastructure to a different AWS region, starting with the image transformation service, that has now returned to work with degraded performance.
Posted Aug 10, 2015 - 05:24 EDT

Update

from AWS: "1:08 AM PDT We believe we have identified the root cause of the elevated error rates and latencies for requests to the US-STANDARD Region and are working to resolve the issue."
Posted Aug 10, 2015 - 04:17 EDT

Monitoring

S3 in us-east-1 is confirmed to having issues. AWS Support confirm no ETA for resolution there. We are working on failing over to storage in a different region, there's not ETA for this yet.
Posted Aug 10, 2015 - 04:12 EDT

Identified

Apparent issues with underlying AWS infrastructure (S3)
Posted Aug 10, 2015 - 03:23 EDT