How can we process the messages in order using Streams API?
We need maintain sequence for messages. We have decided to send all messages from a particular source to a partition, so that sequence of messages will be maintained that means one source will push the messages to a single parttion not multiple parttions and also a partion can have messases from multiple sources and we will be able to identify each source with their key.
Now, we need to consume those messages and do some processing. We do multiple independent operations on the messages what we have consumed like storing them in the database, forwarding them . In this scenario which one we should use Kafka Streams API or Consumer API?
our limitation is we can not have single topic from single resource as this will increase the number of topics .even we can group messages by key to identify the source, for using Streams, we want to order the messages for a key.
Our base requirement is to commit those messages into a database in order and forward those messages in order.
So how can we process the messages in order using Streams API?