BCDR testing

[xgerman]

BCDR = Business Continuity and Disaster Recovery

We need to set up a scenario where we write to a primary.
A script will introduce a failkure in the primary
Orchestrate a failover
and measure how long it took.

We need this for

• local HA where we fail over to the secondary (should happen automaticlaly with CNPG but we need to verify/measure)
• regional ouatge - where our script instigates the site swap and repoints DNS?!

These tests need to be documented and run before each release.
Any issues discovered should be filed.