-
Story
-
Resolution: Obsolete
-
Minor
-
None
-
None
-
False
-
None
-
False
Currently, the Topic Operator cannot easily be scaled out (by default the Kafka Streams state store uses topics with single partitions).
We should investigate the steps needed to either make the TO easy to scale out (this would involve creating some system to shard the KafkaTopic CRs between TO instances). Or make the TO "multi-threaded", by running several internal worker threads (with separate state stores) to handle concurrent topic changes.