Uploaded image for project: 'AMQ Streams'
  1. AMQ Streams
  2. ENTMQST-5810

[QE] - [topic operator] - bulk-ingestion/batch use case performance tests

XMLWordPrintable

    • Icon: Task Task
    • Resolution: Done
    • Icon: Undefined Undefined
    • 2.8.0.GA
    • None
    • None
    • None

      Design a performance test case to simulate a bulk ingestion/batch use case, as might be required by a user like Alice.

      • Alice's scenario involves the need to rapidly create hundreds of topics, perform data ingestion in parallel across all these topics, subsequently consume from them in parallel, and finally delete all the topics. This use case is particularly focused on minimizing the latency associated with the bulk creation and deletion of topics. In such scenarios, Kafka's performance and its ability to handle batching operations efficiently become crucial factors.
      • The test should leverage Kafka's batching capabilities for both the creation and deletion of topics to aid in this process. By using a larger batch size and a longer linger time, the test aims to optimize the throughput and minimize the operational latency.
      • This test scenario is to help users understand the performance characteristics of Kafka when dealing with high volumes of topics and assist in configuring their systems for optimal performance during bulk operations.

            morsak Maros Orsak
            morsak Maros Orsak
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Created:
              Updated:
              Resolved: