Omicron dev for simulating multiple racks (Just a Bunch of Racks / JBOR)

[internet-diglett]

With customers managing large deployments of individual racks, it is useful to have a fast way to spin up multiple concurrent control planes with the related networking daemons for configuration validation. This also gives us an opportunity to address some of the issues noted in omicron#8999.

TODO

• enable mgd to be aware of what switch it is managing maghemite#569
• enable lldp to be aware of what switch it is managing lldp#41
• Update omicron-dev or similar tool to enable deploying multiple copies of the control plane services
• Add ability to ingest topology-quest models to drive shape / initial configuration of "JBOR" deployment
• Add tooling to deploy a fleet of "customer router" instances (maybe additional copies of mgd or frr to increase configuration testing fidelity

---

omicron-dev run-all --count 2

omicron-dev: setting up all services for rack 0...
log file: /tmp/omicron-dev-omicron-dev.22928.0.log
note: configured to log to "/tmp/omicron-dev-omicron-dev.22928.0.log"
DB URL: postgresql://root@[::1]:63179/omicron?sslmode=disable
DB address: [::1]:63179
log file: /tmp/omicron-dev-omicron-dev.22928.2.log
note: configured to log to "/tmp/omicron-dev-omicron-dev.22928.2.log"
log file: /tmp/omicron-dev-omicron-dev.22928.3.log
note: configured to log to "/tmp/omicron-dev-omicron-dev.22928.3.log"
omicron-dev: Adding disks to first sled agent
omicron-dev: services are running.
omicron-dev: nexus external API:     0.0.0.0:50783
omicron-dev: nexus internal API:     [::1]:62137
omicron-dev: nexus lockstep API:     [::1]:59039
omicron-dev: cockroachdb pid:        22932
omicron-dev: cockroachdb URL:        postgresql://root@[::1]:63179/omicron?sslmode=disable
omicron-dev: cockroachdb directory:  /tmp/.tmpNPsteW
omicron-dev: clickhouse native addr: [::1]:61077
omicron-dev: clickhouse http addr:   [::1]:35373
omicron-dev: internal DNS HTTP:      http://[::1]:40747
omicron-dev: internal DNS:           [::1]:61788
omicron-dev: external DNS name:      oxide-dev.test
omicron-dev: external DNS HTTP:      http://[::1]:56781
omicron-dev: external DNS:           [::1]:49265
omicron-dev:   e.g. `dig @::1 -p 49265 test-suite-silo.sys.oxide-dev.test`
omicron-dev: management gateway:     http://[::1]:45150 (switch0)
omicron-dev: management gateway:     http://[::1]:57447 (switch1)
omicron-dev: dendrite:               http://[::1]:55248 (switch0)
omicron-dev: dendrite:               http://[::1]:51576 (switch1)
omicron-dev: maghemite:              http://[::1]:63014 (switch1)
omicron-dev: maghemite:              http://[::1]:58518 (switch0)
omicron-dev: silo name:              test-suite-silo
omicron-dev: privileged user name:   test-privileged
omicron-dev: privileged password:    oxide

omicron-dev: setting up all services for rack 1...
log file: /tmp/omicron-dev-omicron-dev.22928.4.log
note: configured to log to "/tmp/omicron-dev-omicron-dev.22928.4.log"
DB URL: postgresql://root@[::1]:40139/omicron?sslmode=disable
DB address: [::1]:40139
log file: /tmp/omicron-dev-omicron-dev.22928.6.log
note: configured to log to "/tmp/omicron-dev-omicron-dev.22928.6.log"
log file: /tmp/omicron-dev-omicron-dev.22928.7.log
note: configured to log to "/tmp/omicron-dev-omicron-dev.22928.7.log"
omicron-dev: Adding disks to first sled agent
omicron-dev: services are running.
omicron-dev: nexus external API:     0.0.0.0:40270
omicron-dev: nexus internal API:     [::1]:60035
omicron-dev: nexus lockstep API:     [::1]:65510
omicron-dev: cockroachdb pid:        22953
omicron-dev: cockroachdb URL:        postgresql://root@[::1]:40139/omicron?sslmode=disable
omicron-dev: cockroachdb directory:  /tmp/.tmp3TytEo
omicron-dev: clickhouse native addr: [::1]:54822
omicron-dev: clickhouse http addr:   [::1]:43792
omicron-dev: internal DNS HTTP:      http://[::1]:48914
omicron-dev: internal DNS:           [::1]:52955
omicron-dev: external DNS name:      oxide-dev.test
omicron-dev: external DNS HTTP:      http://[::1]:38079
omicron-dev: external DNS:           [::1]:50079
omicron-dev:   e.g. `dig @::1 -p 50079 test-suite-silo.sys.oxide-dev.test`
omicron-dev: management gateway:     http://[::1]:36905 (switch0)
omicron-dev: management gateway:     http://[::1]:53044 (switch1)
omicron-dev: dendrite:               http://[::1]:44065 (switch0)
omicron-dev: dendrite:               http://[::1]:35877 (switch1)
omicron-dev: maghemite:              http://[::1]:55234 (switch0)
omicron-dev: maghemite:              http://[::1]:57158 (switch1)
omicron-dev: silo name:              test-suite-silo
omicron-dev: privileged user name:   test-privileged
omicron-dev: privileged password:    oxide

---

Related: #8999

[ahl]

Is this part of some plan for regional clusters we've figured out?

[internet-diglett]

Is this part of some plan for regional clusters we've figured out?

Apologies for the confusion, this is primarily for allowing us to validate deployment configurations for multiple individual racks. I've updated the description accordingly.