Uploaded image for project: 'Managed Service - Streams'
  1. Managed Service - Streams
  2. MGDSTRM-9992

Allow kroxy instances to elect a leader proxy.

XMLWordPrintable

    • Icon: Epic Epic
    • Resolution: Won't Do
    • Icon: Major Major
    • None
    • None
    • kroxylicious
    • None
    • Proxy Leaders
    • False
    • False
    • Yes
    • To Do
    • MGDSRVS-373 - Kafka Proxy
    • Undefined

      To support some uses cases, kroxy needs to be elect a leader proxy. An example use-case is partition limit validation, where in order to properly enforce a count in a thread safe fashion, we need to route all 'create topic' requests through a single proxy instance which can then maintain a count in partition count in a thread safe manner.

      The idea is to use jgroups to have all the kroxies elect a leader. We also considered leaning on Kafka itself for leader election, but these APIs are currently undergoing changes (KIP link) so we thought it wise to use an alternative mechanism until APIs are settled again.

              Unassigned Unassigned
              keithbwall Keith Wall
              Kafka Integrations
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Created:
                Updated:
                Resolved: