Image restoring in progress
28/04/2011
We found several locations with replicated image files are are matching them to the originals. It is going to take time and we don’t know how many will eventually match.
AWS support haven’t given their final word whether we lost the data or not yet, so there is hope too.
It may be a good idea to re-upload images you need urgently, but it’s better to wait for the rest.
We’ll update you in a few hours on the progress.
April 29th, 2011 at 5:56 pm
We are recovering files from 3 different locations:
* S3 back up
* large caching disk on a surviving server
* remnants of the lost drive
So far it is looking promising, but we won’t know how much useful data we have for another 12 hours. It is a slow process.
April 30th, 2011 at 10:54 am
Looks like we got most of it restored, haven’t made them available yet while the backup is in progress. Give it few more hours.
April 30th, 2011 at 6:36 pm
Almost all printer images were restored. Only a handful are missing.
We are restoring user images now.
April 30th, 2011 at 7:45 pm
As of now there are about 500,000 user images left to process. They are replicated slowly not to affect the site. We will probably stop the system between Sun/Mon at the least load time to speed up the process.
All images should be back in place before Monday.
Well, except those we don’t have any more. It’s a small number. Probably hundreds.
May 1st, 2011 at 7:21 am
It will be another 10 hours before all restored user images appear in their image libraries.