Catalyst will start limiting the concurrent jobs and we need a logic to handle those rate limits and retrying on different instances.