Uploaded image for project: 'Infinispan'
  1. Infinispan
  2. ISPN-5533

M/R DeltaAwareList can add duplicate values because of topology changes

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Obsolete
    • Icon: Major Major
    • 9.0.0.Final
    • 7.2.2.Final, 8.0.0.Alpha1
    • Clustered Executor, Core
    • None

      By default, the intermediate cache is non-transactional, so a topology change will cause write commands to be retried. Because a PutKeyValueCommand(K, DeltaAwareList) command is not idempotent, a retried command will append extra intermediate values to the list.

      The M/R framework tries to guard against this by waiting for all the nodes to initialize the intermediate cache before starting the reduce phase, but it cannot guard against nodes joining or leaving during the reduce phase.

              Unassigned Unassigned
              dberinde@redhat.com Dan Berindei (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Created:
                Updated:
                Resolved: