Recommended configuration for a production server.
I am new to Kafka and I have setup a basic single node cluster using Ambari.
I want to know what is the recommended configuration for a production server.
if I will have 6 topics and each getting traffic in the range of 500,000 to 50,000,000 in a day.
what about setting up a 3-4 node kafka cluster using EC2 r5.xlarge instances.
I know zookeeper needs odd number of nodes and zookeeper is installed on all kafka nodes, then how do we run Kafka with even number of nodes. If this is true it will limit Kafka to odd number of nodes as well.
Is it really needed to install Zookeeper on all Kafka nodes. Can I install Zookeeper on separate nodes and Kafka brokers on separate nodes, how ?
What if i want to run multiple Kafka clusters. Is it possible to manage multiple Kafka clusters through single Zookeeper cluster, how if possible ?