Will the queue shared by all the rabbitmq pod?

[janiu-001]

Dear expert,

In my k8s env, we have:

1. MQTT plugin, the default exchange is amq.topic
2. New Exchange test-exchange bind amq.topic
3. New queue test-queue bind test-exchange

We found that the queue are bind to rabbit@my-rabbitmq-0.my-rabbitmq-headless.default.svc.cluster.local. According to my understanding, the message could reach all the 3 pods, but now we only have one queue on a specific pod, will all the pods put the messages to this queue?

Very appreciated for your response!

Thanks,
Jason

[janiu-001]

My purpose is to load balance the message node with multiple rabbbitmq pod

[janiu-001]

I tried with [rabbitmq_sharding], i have three node

The following code could not work, how could i consume all the partition on different node

[Zerpet]

You can publish to an exchange from any node in the cluster. In the same way, you can consume from a queue from any node in the cluster. If your queue leader is in, let's say, node-1, and your consumer is connected to node-2 or node-3, the message will be forwarded internally and delivered to the consumer, in the appropriate node. This, and other topics, are covered in the clustering guide in our docs.

If you want to use queue sharding, you must have one consumer per shard. If a single consumer were to consume from all the shards, it won't be distributing the load at all :-) I'd recommend that you read the readme in the queue shard plugin.

I don't know excatly what you are trying to achieve, but if data safety and availability are important to your use case, I'd recommend using Quorum Queues, instead of classic queues. Quorum queues have 3 replicas by default, they persist every message to disk, and they are tolerant to node failures.

[janiu-001]

my purpose is to improve the consume speed, it is not perfect to have one consumer per shard. is there any other solution?
If we have only one queue, it is limitation even we add the consumer