Uploaded image for project: 'Managed Service - Streams'
  1. Managed Service - Streams
  2. MGDSTRM-9992

Allow kroxy instances to elect a leader proxy.

XMLWordPrintable

    • Icon: Epic Epic
    • Resolution: Won't Do
    • Icon: Major Major
    • None
    • None
    • kroxylicious
    • None
    • Proxy Leaders
    • False
    • False
    • Yes
    • To Do
    • MGDSRVS-373 - Kafka Proxy
    • Undefined

      To support some uses cases, kroxy needs to be elect a leader proxy. An example use-case is partition limit validation, where in order to properly enforce a count in a thread safe fashion, we need to route all 'create topic' requests through a single proxy instance which can then maintain a count in partition count in a thread safe manner.

      The idea is to use jgroups to have all the kroxies elect a leader. We also considered leaning on Kafka itself for leader election, but these APIs are currently undergoing changes (KIP link) so we thought it wise to use an alternative mechanism until APIs are settled again.

            Unassigned Unassigned
            keithbwall Keith Wall
            Kafka Integrations
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Created:
              Updated:
              Resolved: