Uploaded image for project: 'SIdora'
  1. SIdora
  2. SID-749

As a sysadmin, I want the objectStore sync to run faster

XMLWordPrintable

    • Icon: Story Story
    • Resolution: Fixed
    • Icon: Major Major
    • 0.5.1
    • None
    • None
    • None
    • SIdora Sprint 40, SIdora Sprint 41
    • 2

      As a sysadmin, I want the objectStore sync to run faster. Because of the Fedora architecture its very sensitive to the speed in which the objectStore can be accessed. We keep those files on SSD. Then we rsync them to Isilon schedules by cron. As the store has grown the current implementation is far too slow leaving the system vulnerable.

      The implementation can be improved using a parallel rsync and determining the incremental files to sync using date-time and size instead of checksum (which is more reliable). Also deletions are not properly handled by the current script.

      Test Procedure:

      1. Install the new script and set up the cron job
      2. Check for operation and times in /var/log/cron
      3. Check the output of /var/log/sync-sata_lv-to-isilon
      4. In Splunk, check for time trend for two weeks

            DavisDa Davis, Daniel
            DavisDa Davis, Daniel
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Created:
              Updated:
              Resolved: