Image restoring in progress


We found several locations with replicated image files are are matching them to the originals. It is going to take time and we don’t know how many will eventually match.

AWS support haven’t given their final word whether we lost the data or not yet, so there is hope too.

It may be a good idea to re-upload images you need urgently, but it’s better to wait for the rest.

We’ll update you in a few hours on the progress.

5 Responses to “Image restoring in progress”

  1. admin Says:

    We are recovering files from 3 different locations:
    * S3 back up
    * large caching disk on a surviving server
    * remnants of the lost drive

    So far it is looking promising, but we won’t know how much useful data we have for another 12 hours. It is a slow process.

  2. admin Says:

    Looks like we got most of it restored, haven’t made them available yet while the backup is in progress. Give it few more hours.

  3. admin Says:

    Almost all printer images were restored. Only a handful are missing.

    We are restoring user images now.

  4. admin Says:

    As of now there are about 500,000 user images left to process. They are replicated slowly not to affect the site. We will probably stop the system between Sun/Mon at the least load time to speed up the process.

    All images should be back in place before Monday.
    Well, except those we don’t have any more. It’s a small number. Probably hundreds.

  5. admin Says:

    It will be another 10 hours before all restored user images appear in their image libraries.

Leave a Reply