Uploaded image for project: 'Infinispan'
  1. Infinispan
  2. ISPN-493

Harden rehash leave process

    XMLWordPrintable

Details

    • Task
    • Resolution: Done
    • Critical
    • 4.2.1.CR2, 4.2.1.FINAL
    • 4.0.0.Final, 4.1.0.BETA2
    • None
    • None
    • High

    Description

      We need to make sure that leave rehash process properly handles massive and rapid node failure.

      Massive failures:
      JGroups detects multiple node failures and pushes up to Infinispan views that are more "volatile" than we currently assumed (only one member at the time can leave). For example, if we have view V1=

      {A,B,C,D,E}

      and massive failure causes

      {C,D,E}

      to fail, JGroups failure detection and GMS are going to install a view V2=

      {A,B}

      to surviving members. LeaveTask does not handle this scenario.

      Rapid node failure:
      We need to revisit how LeaveTasks are queued up and executed/canceled during rapid node failures. Do we always cancel currently running leave tasks? At what stage are we allowed to cancel it and at what stage of a leave tasks is it better to wait for a completion of a task.

      Attachments

        Issue Links

          is blocked by

          Bug - A problem that impairs or prevents the functions of the product. ISPN-902 Data consistency across rehashing

          • Blocker - To be worked above all other priorities. This term is chosen when the severity of the issue is very high, has no workaround, or the effort for the change is comparatively low. Issues that may be very publicly visible and could generate significant media attention may also drive a higher priority.
          • Resolved
          is related to

          Bug - A problem that impairs or prevents the functions of the product. ISPN-902 Data consistency across rehashing

          • Blocker - To be worked above all other priorities. This term is chosen when the severity of the issue is very high, has no workaround, or the effort for the change is comparatively low. Issues that may be very publicly visible and could generate significant media attention may also drive a higher priority.
          • Resolved

          Bug - A problem that impairs or prevents the functions of the product. ISPN-914 RehashTask should not block on invalidating migrated entries

          • Critical - To be worked on immediately following BLOCKER issues.
          • Closed

          Activity

            People

              manik_jira Manik Surtani (Inactive)
              vblagoje Vladimir Blagojevic (Inactive)
              Votes:
              1 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: