Mongodb ssl configuration changes lost #126
Description
I am facing an issue, where mongo configuration was lost, but couldn't trace it. Below is a log from mongo.
2023-03-16T09:26:49.866+0000 I NETWORK [conn926] received client metadata from 127.0.0.1:50714 conn926: { driver: { name: "nodejs", version: "4.12.1" }, os: { type: "Linux", name: "linux", architecture: "x64", version: "4.4.0-1128-aws" }, platform: "Node.js v16.16.0, LE (unified)
|Node.js v16.16.0, LE (unified)" }
2023-03-16T09:26:49.900+0000 I NETWORK [listener] connection accepted from 127.0.0.1:50716 #927 (15 connections now open)
2023-03-16T09:26:49.900+0000 I NETWORK [listener] connection accepted from 127.0.0.1:50718 #928 (16 connections now open)
2023-03-16T09:26:49.907+0000 I NETWORK [conn927] received client metadata from 127.0.0.1:50716 conn927: { driver: { name: "nodejs", version: "4.12.1" }, os: { type: "Linux", name: "linux", architecture: "x64", version: "4.4.0-1128-aws" }, platform: "Node.js v16.16.0, LE (unified)
|Node.js v16.16.0, LE (unified)" }
2023-03-16T09:26:49.908+0000 I NETWORK [conn928] received client metadata from 127.0.0.1:50718 conn928: { driver: { name: "nodejs", version: "4.12.1" }, os: { type: "Linux", name: "linux", architecture: "x64", version: "4.4.0-1128-aws" }, platform: "Node.js v16.16.0, LE (unified)
|Node.js v16.16.0, LE (unified)" }
2023-03-16T09:28:08.277+0000 I NETWORK [listener] connection accepted from 127.0.0.1:50888 #929 (17 connections now open)
2023-03-16T09:28:08.277+0000 I NETWORK [listener] connection accepted from 127.0.0.1:50890 #930 (18 connections now open)
2023-03-16T09:28:08.283+0000 I NETWORK [conn929] received client metadata from 127.0.0.1:50888 conn929: { driver: { name: "nodejs", version: "4.12.1" }, os: { type: "Linux", name: "linux", architecture: "x64", version: "4.4.0-1128-aws" }, platform: "Node.js v16.16.0, LE (unified)
|Node.js v16.16.0, LE (unified)" }
2023-03-16T09:28:08.284+0000 I NETWORK [conn930] received client metadata from 127.0.0.1:50890 conn930: { driver: { name: "nodejs", version: "4.12.1" }, os: { type: "Linux", name: "linux", architecture: "x64", version: "4.4.0-1128-aws" }, platform: "Node.js v16.16.0, LE (unified)
|Node.js v16.16.0, LE (unified)" }
2023-03-16T09:34:36.844+0000 I NETWORK [listener] connection accepted from 127.0.0.1:51900 #931 (19 connections now open)
2023-03-16T09:34:36.844+0000 I NETWORK [listener] connection accepted from 127.0.0.1:51902 #932 (20 connections now open)
2023-03-16T09:34:36.854+0000 I NETWORK [conn931] received client metadata from 127.0.0.1:51900 conn931: { driver: { name: "nodejs", version: "4.12.1" }, os: { type: "Linux", name: "linux", architecture: "x64", version: "4.4.0-1128-aws" }, platform: "Node.js v16.16.0, LE (unified)
|Node.js v16.16.0, LE (unified)" }
2023-03-16T09:34:36.855+0000 I NETWORK [conn932] received client metadata from 127.0.0.1:51902 conn932: { driver: { name: "nodejs", version: "4.12.1" }, os: { type: "Linux", name: "linux", architecture: "x64", version: "4.4.0-1128-aws" }, platform: "Node.js v16.16.0, LE (unified)
|Node.js v16.16.0, LE (unified)" }
2023-03-20T14:23:59.086+0000 I NETWORK [conn932] end connection 127.0.0.1:51902 (18 connections now open)
2023-03-20T14:23:59.086+0000 I NETWORK [conn921] end connection 127.0.0.1:50320 (17 connections now open)
2023-03-20T14:23:59.087+0000 I NETWORK [conn930] end connection 127.0.0.1:50890 (16 connections now open)
2023-03-20T14:23:59.087+0000 I NETWORK [conn920] end connection 127.0.0.1:50318 (15 connections now open)
2023-03-20T14:23:59.087+0000 I NETWORK [conn929] end connection 127.0.0.1:50888 (14 connections now open)
2023-03-20T14:23:59.087+0000 I NETWORK [conn926] end connection 127.0.0.1:50714 (13 connections now open)
2023-03-20T14:23:59.087+0000 I NETWORK [conn927] end connection 127.0.0.1:50716 (11 connections now open)
2023-03-20T14:23:59.087+0000 I NETWORK [conn925] end connection 127.0.0.1:50712 (10 connections now open)
2023-03-20T14:23:59.087+0000 I NETWORK [conn913] end connection 127.0.0.1:50250 (9 connections now open)
2023-03-20T14:23:59.088+0000 I NETWORK [conn924] end connection 127.0.0.1:50694 (8 connections now open)
2023-03-20T14:23:59.088+0000 I NETWORK [conn916] end connection 127.0.0.1:50262 (7 connections now open)
2023-03-20T14:23:59.088+0000 I NETWORK [conn923] end connection 127.0.0.1:50692 (6 connections now open)
2023-03-20T14:23:59.088+0000 I NETWORK [conn915] end connection 127.0.0.1:50256 (5 connections now open)
2023-03-20T14:23:59.088+0000 I NETWORK [conn919] end connection 127.0.0.1:50280 (4 connections now open)
2023-03-20T14:23:59.088+0000 I NETWORK [conn918] end connection 127.0.0.1:50278 (3 connections now open)
2023-03-20T14:23:59.088+0000 I NETWORK [conn922] end connection 127.0.0.1:50324 (2 connections now open)
2023-03-20T14:23:59.088+0000 I NETWORK [conn917] end connection 127.0.0.1:50264 (1 connection now open)
2023-03-20T14:23:59.089+0000 I NETWORK [conn914] end connection 127.0.0.1:50254 (0 connections now open)
2023-03-20T14:23:59.087+0000 I NETWORK [conn928] end connection 127.0.0.1:50718 (12 connections now open)
2023-03-20T14:23:59.086+0000 I NETWORK [conn931] end connection 127.0.0.1:51900 (19 connections now open)
2023-03-20T14:37:16.737+0000 I NETWORK [listener] connection accepted from 127.0.0.1:46904 #933 (1 connection now open)
2023-03-20T14:37:16.745+0000 I NETWORK [conn933] Error receiving request from client: SSLHandshakeFailed: SSL handshake received but server is started without SSL support. Ending connection from 127.0.0.1:46904 (connection id: 933)
2023-03-20T14:37:16.745+0000 I NETWORK [conn933] end connection 127.0.0.1:46904 (0 connections now open)
2023-03-20T14:37:17.253+0000 I NETWORK [listener] connection accepted from 127.0.0.1:46908 #934 (1 connection now open)
2023-03-20T14:37:17.254+0000 I NETWORK [conn934] Error receiving request from client: SSLHandshakeFailed: SSL handshake received but server is started without SSL support. Ending connection from 127.0.0.1:46908 (connection id: 934)
2023-03-20T14:37:17.254+0000 I NETWORK [conn934] end connection 127.0.0.1:46908 (0 connections now open)
2023-03-20T14:37:17.758+0000 I NETWORK [listener] connection accepted from 127.0.0.1:46910 #935 (1 connection now open)
2023-03-20T14:37:17.758+0000 I NETWORK [conn935] Error receiving request from client: SSLHandshakeFailed: SSL handshake received but server is started without SSL support. Ending connection from 127.0.0.1:46910 (connection id: 935)
2023-03-20T14:37:17.758+0000 I NETWORK [conn935] end connection 127.0.0.1:46910 (0 connections now open)
2023-03-20T14:37:18.263+0000 I NETWORK [listener] connection accepted from 127.0.0.1:46912 #936 (1 connection now open)
2023-03-20T14:37:18.263+0000 I NETWORK [conn936] Error receiving request from client: SSLHandshakeFailed: SSL handshake received but server is started without SSL support. Ending connection from 127.0.0.1:46912 (connection id: 936)
2023-03-20T14:37:18.263+0000 I NETWORK [conn936] end connection 127.0.0.1:46912 (0 connections now open)
2023-03-20T14:37:18.768+0000 I NETWORK [listener] connection accepted from 127.0.0.1:46914 #937 (1 connection now open)
2023-03-20T14:37:18.768+0000 I NETWORK [conn937] Error receiving request from client: SSLHandshakeFailed: SSL handshake received but server is started without SSL support. Ending connection from 127.0.0.1:46914 (connection id: 937)
2023-03-20T14:37:18.768+0000 I NETWORK [conn937] end connection 127.0.0.1:46914 (0 connections now open)
2023-03-20T14:37:19.272+0000 I NETWORK [listener] connection accepted from 127.0.0.1:46916 #938 (1 connection now open)
2023-03-20T14:37:19.272+0000 I NETWORK [conn938] Error receiving request from client: SSLHandshakeFailed: SSL handshake received but server is started without SSL support. Ending connection from 127.0.0.1:46916 (connection id: 938)
2023-03-20T14:37:19.272+0000 I NETWORK [conn938] end connection 127.0.0.1:46916 (0 connections now open)
2023-03-20T14:37:19.776+0000 I NETWORK [listener] connection accepted from 127.0.0.1:46918 #939 (1 connection now open)
2023-03-20T14:37:19.776+0000 I NETWORK [conn939] Error receiving request from client: SSLHandshakeFailed: SSL handshake received but server is started without SSL support. Ending connection from 127.0.0.1:46918 (connection id: 939)
2023-03-20T14:37:19.776+0000 I NETWORK [conn939] end connection 127.0.0.1:46918 (0 connections now open)
2023-03-20T14:37:20.280+0000 I NETWORK [listener] connection accepted from 127.0.0.1:46920 #940 (1 connection now open)
2023-03-20T14:37:20.280+0000 I NETWORK [conn940] Error receiving request from client: SSLHandshakeFailed: SSL handshake received but server is started without SSL support. Ending connection from 127.0.0.1:46920 (connection id: 940)
2023-03-20T14:37:20.280+0000 I NETWORK [conn940] end connection 127.0.0.1:46920 (0 connections now open)
2023-03-20T14:37:20.784+0000 I NETWORK [listener] connection accepted from 127.0.0.1:46922 #941 (1 connection now open)
2023-03-20T14:37:20.784+0000 I NETWORK [conn941] Error receiving request from client: SSLHandshakeFailed: SSL handshake received but server is started without SSL support. Ending connection from 127.0.0.1:46922 (connection id: 941)
2023-03-20T14:37:20.784+0000 I NETWORK [conn941] end connection 127.0.0.1:46922 (0 connections now open)
2023-03-20T14:37:21.288+0000 I NETWORK [listener] connection accepted from 127.0.0.1:46924 #942 (1 connection now open)
2023-03-20T14:37:21.288+0000 I NETWORK [conn942] Error receiving request from client: SSLHandshakeFailed: SSL handshake received but server is started without SSL support. Ending connection from 127.0.0.1:46924 (connection id: 942)
2023-03-20T14:37:21.288+0000 I NETWORK [conn942] end connection 127.0.0.1:46924 (0 connections now open)
2023-03-20T14:37:21.792+0000 I NETWORK [listener] connection accepted from 127.0.0.1:46926 #943 (1 connection now open)
2023-03-20T14:37:21.792+0000 I NETWORK [conn943] Error receiving request from client: SSLHandshakeFailed: SSL handshake received but server is started without SSL support. Ending connection from 127.0.0.1:46926 (connection id: 943)
2023-03-20T14:37:21.792+0000 I NETWORK [conn943] end connection 127.0.0.1:46926 (0 connections now open)
2023-03-20T14:37:22.297+0000 I NETWORK [listener] connection accepted from 127.0.0.1:46928 #944 (1 connection now open)
SSL was working fine and all of a sudden it stopped working. Mongodb version:
db version v4.2.3
git version: 6874650b362138df74be53d366bbefc321ea32d4
OpenSSL version: OpenSSL 1.0.2g 1 Mar 2016
allocator: tcmalloc
modules: none
build environment:
distmod: ubuntu1604
distarch: x86_64
target_arch: x86_64
What would be the best way to track and figure out what caused configuration changes?