Which option is better for consuming from multiple topics and writing to multiple topics.

Which option is better among below

1.One stream consuming from multiple topics and writing to multiple topics.

  1. Creating multiple streams (each with different app.id) for consuming from the different topic and writing to a different topic.
Tagged:

Comments

  • We recommend to go with option 2 because using option 2 we can also achieve fault tolerant, i.e if one your application instance went down the stream partition handled by that instance will be distributed to the other running instances. If you want to use the parallelism then you should use the same app.id for all the stream processing instances.

Sign In or Register to comment.