Uploaded image for project: 'Infinispan'
  1. Infinispan
  2. ISPN-5533

M/R DeltaAwareList can add duplicate values because of topology changes

This issue belongs to an archived project. You can view it, but you can't modify it. Learn more

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Obsolete
    • Icon: Major Major
    • 9.0.0.Final
    • 7.2.2.Final, 8.0.0.Alpha1
    • Clustered Executor, Core
    • None

      By default, the intermediate cache is non-transactional, so a topology change will cause write commands to be retried. Because a PutKeyValueCommand(K, DeltaAwareList) command is not idempotent, a retried command will append extra intermediate values to the list.

      The M/R framework tries to guard against this by waiting for all the nodes to initialize the intermediate cache before starting the reduce phase, but it cannot guard against nodes joining or leaving during the reduce phase.

              Unassigned Unassigned
              dberinde@redhat.com Dan Berindei (Inactive)
              Archiver:
              rhn-support-adongare Amol Dongare

                Created:
                Updated:
                Resolved:
                Archived: