Resolved -
We have identified and now successfully reprocessed all moderation requests that had failed previously due to this issue.
Jul 10, 14:51 EDT
Monitoring -
We have resolved the underlying issue that caused the failures. All moderations using this add-on are being processed correctly as of 17:52 UTC. The time period the errors were observed is between 12:00 and 17:52 UTC. We are now identifying all failed requests so that we can reprocess them.
Jul 10, 14:10 EDT
Identified -
We have identified the cause of the errors and are working towards a resolution.
Jul 10, 13:48 EDT
Investigating -
We are currently investigating an issue with moderation requests using the MetaDefender Anti-Malware Protection add-on. The elevated errors began at 12:00 UTC on 10th July -. Notification responses are not being sent for those moderation requests which have failed.
Jul 10, 11:33 EDT
Resolved -
We have completed processing the backlog
Jul 7, 20:58 EDT
Monitoring -
As a result of a software update deployed to the system to improve stability, at 7/7/2020 17:15 UTC, we observed a spike in errors while processing transformations that were submitted for background processing (a.k.a. "eager async" transformations). All other processes were executing normally.
Cloudinary teams identified the issue and rolled back the software update at 21:30 UTC. Our team also initiated a reprocessing of the resources submitted for eager asynchronous that failed during these 4 hours.
If you are using Cloudinary webhooks/notification URLs, you have received an error notification when the job initially failed. Once your job is re-processed, you will get another notification of the success.