Uploaded image for project: 'Infinispan'
  1. Infinispan
  2. ISPN-15376

SoftIndexFileStore Batch Index Updates

    XMLWordPrintable

Details

    • Enhancement
    • Resolution: Unresolved
    • Major
    • 15.0.3.Final
    • None
    • Loaders and Stores
    • None

    Description

      Today when the SIFS writes a value it does the following

      1. Write to the append only log
      2. Update TemporaryTable for index to allow return
      3. Update index file, sequentially
      4. Remove from TemporaryTable

      To reduce performance costs 2-4 are separated into "Segments" to allow for parallel updates to the index and their respective files.

      Instead we should be able to change #3 to do a batch update and not do them sequentially. Instead of submitting an UpdateIndex request for every operation, we could instead send a generic event to the Indexer to wake up. When this happens the Indexer would read the contents of the TemproraryTable and persist all updates to the index in one go. Then the index is written to disk once for a single batch, instead of once per write. This should improve scalability considerably for indexing.

      Attachments

        Activity

          People

            wburns@redhat.com Will Burns
            wburns@redhat.com Will Burns
            Votes:
            1 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated: