Collaborative Launch 1757606400 (Thursday Sept 11, 2025 16:00 UTC)

[jurraca]

Next proposed collaborative launch date is 1757606400 (Thu Sep 11 2025 16:00:00 GMT). You can run the following command to set kartograf to wait and run at that time:

./run map -w=1757606400 -irr -rv -s

The latest kartograf release is 0.4.12 "al-Idrisi". It features changes that reduce the amount of data written to the output folder out by defaulting the debug flag to False. The input data folder can also be removed by setting the --wd/--wipe_data_dir flag (previously called --cleanup). Please make sure to use this version and definitely use the -s option like in the command above.

The requirements are Python 3.11 and rpki-client 9.5. We recommend you use Nix and run nix develop to enter an environment with all the required dependencies included. Otherwise, see the setup instructions for your platform in the README.

If people would rather we push it to a different date, please let us know below.

@jurraca @0xB10C @dunxen @Sjors @luisschwab @Emzy @jonatack @freerko @sr-gi

[fjahr]

I got 387d80bf0bc97ad5b9f131d2164c5060584ad878456c0d661a43431ba089b5f3.

logs

$ ./run map -w=1757606400 -irr -rv -s

--- Start Kartograf ---

Kartograf version: 0.4.12
Using rpki-client version 9.5 (recommended).
Coordinated launch mode: Waiting until 1757606400 (2025-09-11 18:00:00 CEST) to launch mapping process.
Countdown: 0 second(s)
Starting...
The epoch for this run is: 1757606400 (2025-09-11 16:00:00 UTC, local: 2025-09-11 18:00:00 CEST)

--- Fetching RPKI ---

Downloaded TAL for AFRINIC to /Users/X/projects/python/kartograf/data/1757606400/rpki/tals/afrinic.tal, file hash: 2838ef30ea27ce5705abf5f5adb131d8c35b1f50858338a2f3c84bb207c2fa35
Downloaded TAL for APNIC to /Users/X/projects/python/kartograf/data/1757606400/rpki/tals/apnic.tal, file hash: 472e551f7c551c2e999e582b7c9437d3bee4900fe53afff62aeb28d4940ade94
Downloaded TAL for ARIN to /Users/X/projects/python/kartograf/data/1757606400/rpki/tals/arin.tal, file hash: 1f8bdb03bcc30a3b8e11fd9a87102fba250c22137a3c8baa9c81b139cb412639
Downloaded TAL for LACNIC to /Users/X/projects/python/kartograf/data/1757606400/rpki/tals/lacnic.tal, file hash: d44bb9394ab009c8b53e5efebf2a1c9450bab61a27efe00de5a3e4587a3a2f6a
Downloaded TAL for RIPE to /Users/X/projects/python/kartograf/data/1757606400/rpki/tals/ripe.tal, file hash: 59ca27ef93f23682749fcefe7c6d70fbc723343549ff9e4d3996acaff79817fb
Downloading RPKI Data, this may take a while.
Using only stable RPKI repositories.
Downloaded RPKI Data, hash sum: ce648883a586e4b6ab1842d6278b90875154a3bdf9089843cf0c5bd3f3d8efde
...finished in 0:05:22.523307

--- Fetching IRR ---

Downloading afrinic.db.gz
Downloaded afrinic.db.gz, file hash: 80c67e8a092d784a5a884081268e4b335b2b0f826d941c9d78ead43b6b7fff31
Downloading apnic.db.route.gz
Downloaded apnic.db.route.gz, file hash: 3432127ad2073f79f4dd5375eb1e4af9855cd761d417178e33bfff0bf55ff9f7
Downloading apnic.db.route6.gz
Downloaded apnic.db.route6.gz, file hash: f4dc0fac71fef794dfae726121b5dfabec3a44deb961a11236e75b954f2db8c6
Downloading arin.db.gz
Downloaded arin.db.gz, file hash: 1cdc86af7855fb692deebccfeda841ef920068d3046ef84671e563bc7430094a
Downloading lacnic.db.gz
Downloaded lacnic.db.gz, file hash: 85fb54881e10c8dc2a8f000a77a357b3dac9fb7d224337a41a07c510222b3533
Downloading ripe.db.route.gz
Downloaded ripe.db.route.gz, file hash: 3da41dc65c002ae75e647581e49fbd6729a3d05131e10a19c738aa49b11d8b69
Downloading ripe.db.route6.gz
Downloaded ripe.db.route6.gz, file hash: 6d002ed9305b14a5f6c2d33e55568bf7e6f4f24375a7b86c034cce8a8a6c9138
...finished in 0:01:08.729629

--- Fetching Routeviews pfx2as ---

Downloading from https://publicdata.caida.org/datasets/routing/routeviews-prefix2as/2025/09/routeviews-rv2-20250909-0400.pfx2as.gz
Downloaded /Users/X/projects/python/kartograf/data/1757606400/collectors/routeviews_pfx2asn_ip4.txt.gz, file hash: 2f0b475fa6a44dd325833a25cc82e3fe3a56793875a68bacf202a32dcd1d5e4c
Downloading from https://publicdata.caida.org/datasets/routing/routeviews6-prefix2as/2025/09/routeviews-rv6-20250910-1200.pfx2as.gz
Downloaded /Users/X/projects/python/kartograf/data/1757606400/collectors/routeviews_pfx2asn_ip6.txt.gz, file hash: dfb95bc53bcc9400f1ec55ff32daab500fc71165bc6aa6a73d6d8eeacfbb9481
...finished in 0:00:06.229127

--- Validating RPKI ---

Validating RPKI ROAs
319660 raw RKPI ROA files found.
100%|██████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 1279/1279 [00:22<00:00, 55.79it/s]
319660 RKPI ROAs validated and saved to /Users/X/projects/python/kartograf/out/1757606400/rpki/rpki_raw.json, file hash: 15328d6765d0c6b985d0a093cead8e53f9e9af7368146a0871921a5a59390f39
...finished in 0:00:41.253257

--- Parsing RPKI ---

Parsing 319660 ROAs
Result entries written: 646588
Duplicates found: 91007
Invalids found: 2050
Incompletes: 0
Non-ROA files: 0
...finished in 0:00:13.962896

--- Parsing IRR ---

Extracting afrinic.db.gz
Extracting apnic.db.route.gz
Extracting apnic.db.route6.gz
Extracting arin.db.gz
Extracting lacnic.db.gz
Extracting ripe.db.route.gz
Extracting ripe.db.route6.gz
Parsing /Users/X/projects/python/kartograf/out/1757606400/irr/lacnic.db
Found in this file: 15596
Parsing /Users/X/projects/python/kartograf/out/1757606400/irr/ripe.db.route
Found in this file: 397476
Parsing /Users/X/projects/python/kartograf/out/1757606400/irr/apnic.db.route6
Found in this file: 532806
Parsing /Users/X/projects/python/kartograf/out/1757606400/irr/apnic.db.route
Found in this file: 592353
Parsing /Users/X/projects/python/kartograf/out/1757606400/irr/arin.db
Found in this file: 112719
Parsing /Users/X/projects/python/kartograf/out/1757606400/irr/afrinic.db
Found in this file: 117814
Parsing /Users/X/projects/python/kartograf/out/1757606400/irr/ripe.db.route6
Found in this file: 153830
Found valid, unique entries: 1922594
...finished in 0:00:49.189335

--- Merging RPKI and IRR data ---

Parse base file to dictionary
Parse extra file to Pandas DataFrame
Merging extra prefixes that were not included in the base file.
Finished merging extra prefixes.
Finished filtering! Originally 1922594 entries filtered down to 430837
Merging base file with filtered extra file
...finished in 0:03:28.189669

--- Parsing Routeviews pfx2as ---

Unzipping /Users/X/projects/python/kartograf/data/1757606400/collectors/routeviews_pfx2asn_ip4.txt.gz
Formatting /Users/X/projects/python/kartograf/out/1757606400/collectors/routeviews_pfx2asn_ip4.txt
Unzipping /Users/X/projects/python/kartograf/data/1757606400/collectors/routeviews_pfx2asn_ip6.txt.gz
Formatting /Users/X/projects/python/kartograf/out/1757606400/collectors/routeviews_pfx2asn_ip6.txt
Cleaning /Users/X/projects/python/kartograf/out/1757606400/collectors/pfx2asn.txt
Entries after cleanup: 1286356
...finished in 0:00:19.048906

--- Merging Routeviews and base data ---

Parse base file to dictionary
Parse extra file to Pandas DataFrame
Merging extra prefixes that were not included in the base file.
Finished merging extra prefixes.
Finished filtering! Originally 1286356 entries filtered down to 329343
Merging base file with filtered extra file
...finished in 0:03:05.836754

--- Sorting results ---

...finished in 0:00:07.388672

--- Finishing Kartograf ---

The SHA-256 hash of the result file is: 387d80bf0bc97ad5b9f131d2164c5060584ad878456c0d661a43431ba089b5f3
Total runtime: 0:15:23.183745

[brunoerg]

I got 387d80bf0bc97ad5b9f131d2164c5060584ad878456c0d661a43431ba089b5f3.

Logs

--- Start Kartograf ---

Kartograf version: 0.4.12
Using rpki-client version 9.5 (recommended).
Coordinated launch mode: Waiting until 1757606400 (2025-09-11 13:00:00 -03) to launch mapping process.
Countdown: 0 second(s)
Starting...
The epoch for this run is: 1757606400 (2025-09-11 16:00:00 UTC, local: 2025-09-11 13:00:00 -03)

--- Fetching RPKI ---

Downloaded TAL for AFRINIC to /Users/brunogarcia/projects/kartograf/data/1757606400/rpki/tals/afrinic.tal, file hash: 2838ef30ea27ce5705abf5f5adb131d8c35b1f50858338a2f3c84bb207c2fa35
Downloaded TAL for APNIC to /Users/brunogarcia/projects/kartograf/data/1757606400/rpki/tals/apnic.tal, file hash: 472e551f7c551c2e999e582b7c9437d3bee4900fe53afff62aeb28d4940ade94
Downloaded TAL for ARIN to /Users/brunogarcia/projects/kartograf/data/1757606400/rpki/tals/arin.tal, file hash: 1f8bdb03bcc30a3b8e11fd9a87102fba250c22137a3c8baa9c81b139cb412639
Downloaded TAL for LACNIC to /Users/brunogarcia/projects/kartograf/data/1757606400/rpki/tals/lacnic.tal, file hash: d44bb9394ab009c8b53e5efebf2a1c9450bab61a27efe00de5a3e4587a3a2f6a
Downloaded TAL for RIPE to /Users/brunogarcia/projects/kartograf/data/1757606400/rpki/tals/ripe.tal, file hash: 59ca27ef93f23682749fcefe7c6d70fbc723343549ff9e4d3996acaff79817fb
Downloading RPKI Data, this may take a while.
Using only stable RPKI repositories.
Downloaded RPKI Data, hash sum: c4303d9dd4a277c8e836c41f2c2477c2bce84030f430e0b82dc81e5cdbdca6ad
...finished in 0:05:47.401988

--- Fetching IRR ---

Downloading afrinic.db.gz
Downloaded afrinic.db.gz, file hash: 80c67e8a092d784a5a884081268e4b335b2b0f826d941c9d78ead43b6b7fff31
Downloading apnic.db.route.gz
Downloaded apnic.db.route.gz, file hash: 3432127ad2073f79f4dd5375eb1e4af9855cd761d417178e33bfff0bf55ff9f7
Downloading apnic.db.route6.gz
Downloaded apnic.db.route6.gz, file hash: f4dc0fac71fef794dfae726121b5dfabec3a44deb961a11236e75b954f2db8c6
Downloading arin.db.gz
Downloaded arin.db.gz, file hash: 1cdc86af7855fb692deebccfeda841ef920068d3046ef84671e563bc7430094a
Downloading lacnic.db.gz
Downloaded lacnic.db.gz, file hash: 85fb54881e10c8dc2a8f000a77a357b3dac9fb7d224337a41a07c510222b3533
Downloading ripe.db.route.gz
Downloaded ripe.db.route.gz, file hash: 3da41dc65c002ae75e647581e49fbd6729a3d05131e10a19c738aa49b11d8b69
Downloading ripe.db.route6.gz
Downloaded ripe.db.route6.gz, file hash: 6d002ed9305b14a5f6c2d33e55568bf7e6f4f24375a7b86c034cce8a8a6c9138
...finished in 0:00:33.945193

--- Fetching Routeviews pfx2as ---

Downloading from https://publicdata.caida.org/datasets/routing/routeviews-prefix2as/2025/09/routeviews-rv2-20250909-0400.pfx2as.gz
Downloaded /Users/brunogarcia/projects/kartograf/data/1757606400/collectors/routeviews_pfx2asn_ip4.txt.gz, file hash: 2f0b475fa6a44dd325833a25cc82e3fe3a56793875a68bacf202a32dcd1d5e4c
Downloading from https://publicdata.caida.org/datasets/routing/routeviews6-prefix2as/2025/09/routeviews-rv6-20250910-1200.pfx2as.gz
Downloaded /Users/brunogarcia/projects/kartograf/data/1757606400/collectors/routeviews_pfx2asn_ip6.txt.gz, file hash: dfb95bc53bcc9400f1ec55ff32daab500fc71165bc6aa6a73d6d8eeacfbb9481
...finished in 0:00:07.027457

--- Validating RPKI ---

Validating RPKI ROAs
319660 raw RKPI ROA files found.
100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 1279/1279 [00:52<00:00, 24.52it/s]
319660 RKPI ROAs validated and saved to /Users/brunogarcia/projects/kartograf/out/1757606400/rpki/rpki_raw.json, file hash: 63cb6eb4cd0bb88371fe75ad9108526ea9e3f88311b8de00829b0171506abc9d
...finished in 0:01:18.469762

--- Parsing RPKI ---

Parsing 319660 ROAs
Result entries written: 646588
Duplicates found: 91007
Invalids found: 2050
Incompletes: 0
Non-ROA files: 0
...finished in 0:00:23.968617

--- Parsing IRR ---

Extracting afrinic.db.gz
Extracting apnic.db.route.gz
Extracting apnic.db.route6.gz
Extracting arin.db.gz
Extracting lacnic.db.gz
Extracting ripe.db.route.gz
Extracting ripe.db.route6.gz
Parsing /Users/brunogarcia/projects/kartograf/out/1757606400/irr/lacnic.db
Found in this file: 15596
Parsing /Users/brunogarcia/projects/kartograf/out/1757606400/irr/ripe.db.route
Found in this file: 397476
Parsing /Users/brunogarcia/projects/kartograf/out/1757606400/irr/apnic.db.route6
Found in this file: 532806
Parsing /Users/brunogarcia/projects/kartograf/out/1757606400/irr/apnic.db.route
Found in this file: 592353
Parsing /Users/brunogarcia/projects/kartograf/out/1757606400/irr/arin.db
Found in this file: 112719
Parsing /Users/brunogarcia/projects/kartograf/out/1757606400/irr/afrinic.db
Found in this file: 117814
Parsing /Users/brunogarcia/projects/kartograf/out/1757606400/irr/ripe.db.route6
Found in this file: 153830
Found valid, unique entries: 1922594
...finished in 0:01:16.026823

--- Merging RPKI and IRR data ---

Parse base file to dictionary
Parse extra file to Pandas DataFrame
Merging extra prefixes that were not included in the base file.
Finished merging extra prefixes.
Finished filtering! Originally 1922594 entries filtered down to 430837
Merging base file with filtered extra file
...finished in 0:05:29.096023

--- Parsing Routeviews pfx2as ---

Unzipping /Users/brunogarcia/projects/kartograf/data/1757606400/collectors/routeviews_pfx2asn_ip4.txt.gz
Formatting /Users/brunogarcia/projects/kartograf/out/1757606400/collectors/routeviews_pfx2asn_ip4.txt
Unzipping /Users/brunogarcia/projects/kartograf/data/1757606400/collectors/routeviews_pfx2asn_ip6.txt.gz
Formatting /Users/brunogarcia/projects/kartograf/out/1757606400/collectors/routeviews_pfx2asn_ip6.txt
Cleaning /Users/brunogarcia/projects/kartograf/out/1757606400/collectors/pfx2asn.txt
Entries after cleanup: 1286356
...finished in 0:00:29.008053

--- Merging Routeviews and base data ---

Parse base file to dictionary
Parse extra file to Pandas DataFrame
Merging extra prefixes that were not included in the base file.
Finished merging extra prefixes.
Finished filtering! Originally 1286356 entries filtered down to 329343
Merging base file with filtered extra file
...finished in 0:04:54.590713

--- Sorting results ---

...finished in 0:00:11.689881

--- Finishing Kartograf ---

The SHA-256 hash of the result file is: 387d80bf0bc97ad5b9f131d2164c5060584ad878456c0d661a43431ba089b5f3
Total runtime: 0:20:32.378482

[0xB10C]

The SHA-256 hash of the result file is: 387d80bf0bc97ad5b9f131d2164c5060584ad878456c0d661a43431ba089b5f3
Total runtime: 0:29:15.420937

[Emzy]

I got 83df4d8c93e22deed800ab7c6cdc598cff8cf5e1b6e7e378932141011a7573d0

Logs

$ ./run map -w=1757606400 -irr -rv -s

--- Start Kartograf ---

Kartograf version: 0.4.12
Using rpki-client version 9.5 (recommended).
Coordinated launch mode: Waiting until 1757606400 (2025-09-11 18:00:00 CEST) to launch mapping process.
Countdown: 0 second(s)
Starting...
The epoch for this run is: 1757606400 (2025-09-11 16:00:00 UTC, local: 2025-09-11 18:00:00 CEST)

--- Fetching RPKI ---

Downloaded TAL for AFRINIC to /home/emzy/kartograf/data/1757606400/rpki/tals/afrinic.tal, file hash: 2838ef30ea27ce5705abf5f5adb131d8c35b1f50858338a2f3
c84bb207c2fa35
Downloaded TAL for APNIC to /home/emzy/kartograf/data/1757606400/rpki/tals/apnic.tal, file hash: 472e551f7c551c2e999e582b7c9437d3bee4900fe53afff62aeb28
d4940ade94
Downloaded TAL for ARIN to /home/emzy/kartograf/data/1757606400/rpki/tals/arin.tal, file hash: 1f8bdb03bcc30a3b8e11fd9a87102fba250c22137a3c8baa9c81b139
cb412639
Downloaded TAL for LACNIC to /home/emzy/kartograf/data/1757606400/rpki/tals/lacnic.tal, file hash: d44bb9394ab009c8b53e5efebf2a1c9450bab61a27efe00de5a3
e4587a3a2f6a
Downloaded TAL for RIPE to /home/emzy/kartograf/data/1757606400/rpki/tals/ripe.tal, file hash: 59ca27ef93f23682749fcefe7c6d70fbc723343549ff9e4d3996acaf
f79817fb
Downloading RPKI Data, this may take a while.
Using only stable RPKI repositories.
Downloaded RPKI Data, hash sum: 6d219b9e64b3c679b3f3a5306c5f33a3896d62dbc27c86c593c772143c220e4b
...finished in 0:06:51.316686

--- Fetching IRR ---

Downloading afrinic.db.gz
Downloaded afrinic.db.gz, file hash: 80c67e8a092d784a5a884081268e4b335b2b0f826d941c9d78ead43b6b7fff31
Downloading apnic.db.route.gz
Downloaded apnic.db.route.gz, file hash: 3432127ad2073f79f4dd5375eb1e4af9855cd761d417178e33bfff0bf55ff9f7
Downloading apnic.db.route6.gz
Downloaded apnic.db.route6.gz, file hash: f4dc0fac71fef794dfae726121b5dfabec3a44deb961a11236e75b954f2db8c6
Downloading arin.db.gz
Downloaded arin.db.gz, file hash: 1cdc86af7855fb692deebccfeda841ef920068d3046ef84671e563bc7430094a
Downloading lacnic.db.gz
Downloaded lacnic.db.gz, file hash: 85fb54881e10c8dc2a8f000a77a357b3dac9fb7d224337a41a07c510222b3533
Downloading ripe.db.route.gz
Downloaded ripe.db.route.gz, file hash: 3da41dc65c002ae75e647581e49fbd6729a3d05131e10a19c738aa49b11d8b69
Downloading ripe.db.route6.gz
Downloaded ripe.db.route6.gz, file hash: 6d002ed9305b14a5f6c2d33e55568bf7e6f4f24375a7b86c034cce8a8a6c9138
...finished in 0:00:19.351397

--- Fetching Routeviews pfx2as ---

Downloading from https://publicdata.caida.org/datasets/routing/routeviews-prefix2as/2025/09/routeviews-rv2-20250909-0400.pfx2as.gz
Downloaded /home/emzy/kartograf/data/1757606400/collectors/routeviews_pfx2asn_ip4.txt.gz, file hash: 2f0b475fa6a44dd325833a25cc82e3fe3a56793875a68bacf2
02a32dcd1d5e4c
Downloading from https://publicdata.caida.org/datasets/routing/routeviews6-prefix2as/2025/09/routeviews-rv6-20250910-1200.pfx2as.gz
Downloaded /home/emzy/kartograf/data/1757606400/collectors/routeviews_pfx2asn_ip6.txt.gz, file hash: dfb95bc53bcc9400f1ec55ff32daab500fc71165bc6aa6a73d
6d8eeacfbb9481
...finished in 0:00:07.762978

--- Validating RPKI ---

Validating RPKI ROAs
319660 raw RKPI ROA files found.
100%|██████████████████████████████████████████████████████████████████████████████████████████████████████████████| 1279/1279 [03:41<00:00, 5.76it/s]
319660 RKPI ROAs validated and saved to /home/emzy/kartograf/out/1757606400/rpki/rpki_raw.json, file hash: 7b1a1cbc240ff9937c1212c286e4e533dcfa689cd20b
72506f7441fecf260e73
...finished in 0:04:06.587349

--- Parsing RPKI ---

Parsing 319660 ROAs
Result entries written: 646411
Duplicates found: 90884
Invalids found: 2350
Incompletes: 0
Non-ROA files: 0
...finished in 0:00:37.361295

--- Parsing IRR ---

Extracting afrinic.db.gz
Extracting apnic.db.route.gz
Extracting apnic.db.route6.gz
Extracting arin.db.gz
Extracting lacnic.db.gz
Extracting ripe.db.route.gz
Extracting ripe.db.route6.gz
Parsing /home/emzy/kartograf/out/1757606400/irr/lacnic.db
Found in this file: 15596
Parsing /home/emzy/kartograf/out/1757606400/irr/ripe.db.route
Found in this file: 397476
Parsing /home/emzy/kartograf/out/1757606400/irr/apnic.db.route
Found in this file: 592353
Parsing /home/emzy/kartograf/out/1757606400/irr/afrinic.db
Found in this file: 117814
Parsing /home/emzy/kartograf/out/1757606400/irr/arin.db
Found in this file: 112719
Parsing /home/emzy/kartograf/out/1757606400/irr/apnic.db.route6
Found in this file: 532806
Parsing /home/emzy/kartograf/out/1757606400/irr/ripe.db.route6
Found in this file: 153830
Found valid, unique entries: 1922594
...finished in 0:02:43.376936

--- Merging RPKI and IRR data ---

Parse base file to dictionary
Parse extra file to Pandas DataFrame
Merging extra prefixes that were not included in the base file.
Finished merging extra prefixes.
Finished filtering! Originally 1922594 entries filtered down to 430837
Merging base file with filtered extra file
...finished in 0:11:56.007757

--- Parsing Routeviews pfx2as ---

Unzipping /home/emzy/kartograf/data/1757606400/collectors/routeviews_pfx2asn_ip4.txt.gz
Formatting /home/emzy/kartograf/out/1757606400/collectors/routeviews_pfx2asn_ip4.txt
Unzipping /home/emzy/kartograf/data/1757606400/collectors/routeviews_pfx2asn_ip6.txt.gz
Formatting /home/emzy/kartograf/out/1757606400/collectors/routeviews_pfx2asn_ip6.txt
Cleaning /home/emzy/kartograf/out/1757606400/collectors/pfx2asn.txt
Entries after cleanup: 1286356
...finished in 0:00:52.299281

--- Merging Routeviews and base data ---

Parse base file to dictionary
Parse extra file to Pandas DataFrame
Merging extra prefixes that were not included in the base file.
Finished merging extra prefixes.
Finished filtering! Originally 1286356 entries filtered down to 329551
Merging base file with filtered extra file
...finished in 0:10:08.096545

--- Sorting results ---

...finished in 0:00:19.341570

--- Finishing Kartograf ---

The SHA-256 hash of the result file is: 83df4d8c93e22deed800ab7c6cdc598cff8cf5e1b6e7e378932141011a7573d0
Total runtime: 0:38:05.087377

[jurraca]

I got da9ba5a4f307ad2ee2bb2b5f98a1ff1bae6f7ac03c746eea2aca08518d57a4d5

Logs

--- Start Kartograf ---

Kartograf version: 0.4.12
Using rpki-client version 9.5 (recommended).
Coordinated launch mode: Waiting until 1757606400 (2025-09-11 18:00:00 CEST) to launch mapping process.
Countdown: 0 second(s)
Starting...
The epoch for this run is: 1757606400 (2025-09-11 16:00:00 UTC, local: 2025-09-11 18:00:00 CEST)

--- Fetching RPKI ---

Downloaded TAL for AFRINIC to /home/base/code/asmap/kartograf/data/1757606400/rpki/tals/afrinic.tal, file hash: 2838ef30ea27ce5705abf5f5adb131d8c35b1f50858338a2f3c84bb207c2fa35
Downloaded TAL for APNIC to /home/base/code/asmap/kartograf/data/1757606400/rpki/tals/apnic.tal, file hash: 472e551f7c551c2e999e582b7c9437d3bee4900fe53afff62aeb28d4940ade94
Downloaded TAL for ARIN to /home/base/code/asmap/kartograf/data/1757606400/rpki/tals/arin.tal, file hash: 1f8bdb03bcc30a3b8e11fd9a87102fba250c22137a3c8baa9c81b139cb412639
Downloaded TAL for LACNIC to /home/base/code/asmap/kartograf/data/1757606400/rpki/tals/lacnic.tal, file hash: d44bb9394ab009c8b53e5efebf2a1c9450bab61a27efe00de5a3e4587a3a2f6a
Downloaded TAL for RIPE to /home/base/code/asmap/kartograf/data/1757606400/rpki/tals/ripe.tal, file hash: 59ca27ef93f23682749fcefe7c6d70fbc723343549ff9e4d3996acaff79817fb
Downloading RPKI Data, this may take a while.
Using only stable RPKI repositories.
Downloaded RPKI Data, hash sum: 8c1323faae4716960c1fde14f25b2b4959dcabde4a9aa870c921e2843da87558
...finished in 0:07:04.826010

--- Fetching IRR ---

Downloading afrinic.db.gz
Downloaded afrinic.db.gz, file hash: 80c67e8a092d784a5a884081268e4b335b2b0f826d941c9d78ead43b6b7fff31
Downloading apnic.db.route.gz
Downloaded apnic.db.route.gz, file hash: 3432127ad2073f79f4dd5375eb1e4af9855cd761d417178e33bfff0bf55ff9f7
Downloading apnic.db.route6.gz
Downloaded apnic.db.route6.gz, file hash: f4dc0fac71fef794dfae726121b5dfabec3a44deb961a11236e75b954f2db8c6
Downloading arin.db.gz
Downloaded arin.db.gz, file hash: 1cdc86af7855fb692deebccfeda841ef920068d3046ef84671e563bc7430094a
Downloading lacnic.db.gz
Downloaded lacnic.db.gz, file hash: 85fb54881e10c8dc2a8f000a77a357b3dac9fb7d224337a41a07c510222b3533
Downloading ripe.db.route.gz
Downloaded ripe.db.route.gz, file hash: 3da41dc65c002ae75e647581e49fbd6729a3d05131e10a19c738aa49b11d8b69
Downloading ripe.db.route6.gz
Downloaded ripe.db.route6.gz, file hash: 6d002ed9305b14a5f6c2d33e55568bf7e6f4f24375a7b86c034cce8a8a6c9138
...finished in 0:00:25.635984

--- Fetching Routeviews pfx2as ---

Downloading from https://publicdata.caida.org/datasets/routing/routeviews-prefix2as/2025/09/routeviews-rv2-20250909-0400.pfx2as.gz
Downloaded /home/base/code/asmap/kartograf/data/1757606400/collectors/routeviews_pfx2asn_ip4.txt.gz, file hash: 2f0b475fa6a44dd325833a25cc82e3fe3a56793875a68bacf202a32dcd1d5e4c
Downloading from https://publicdata.caida.org/datasets/routing/routeviews6-prefix2as/2025/09/routeviews-rv6-20250910-1200.pfx2as.gz
Downloaded /home/base/code/asmap/kartograf/data/1757606400/collectors/routeviews_pfx2asn_ip6.txt.gz, file hash: dfb95bc53bcc9400f1ec55ff32daab500fc71165bc6aa6a73d6d8eeacfbb9481
...finished in 0:00:05.958340

--- Validating RPKI ---

Validating RPKI ROAs
319660 raw RKPI ROA files found.
100%|██████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 1279/1279 [01:12<00:00, 17.75it/s]
319660 RKPI ROAs validated and saved to /home/base/code/asmap/kartograf/out/1757606400/rpki/rpki_raw.json, file hash: ab44cf7dc587f5858dace944ba97be0590ef187dd61b5195e8acf084ad713b17
...finished in 0:01:35.526270

--- Parsing RPKI ---

Parsing 319660 ROAs
Result entries written: 622132
Duplicates found: 89453
Invalids found: 26131
Incompletes: 0
Non-ROA files: 0
...finished in 0:00:38.054306

--- Parsing IRR ---

Extracting afrinic.db.gz
Extracting apnic.db.route.gz
Extracting apnic.db.route6.gz
Extracting arin.db.gz
Extracting lacnic.db.gz
Extracting ripe.db.route.gz
Extracting ripe.db.route6.gz
Parsing /home/base/code/asmap/kartograf/out/1757606400/irr/afrinic.db
Found in this file: 117814
Parsing /home/base/code/asmap/kartograf/out/1757606400/irr/arin.db
Found in this file: 112719
Parsing /home/base/code/asmap/kartograf/out/1757606400/irr/ripe.db.route6
Found in this file: 153830
Parsing /home/base/code/asmap/kartograf/out/1757606400/irr/apnic.db.route6
Found in this file: 532806
Parsing /home/base/code/asmap/kartograf/out/1757606400/irr/lacnic.db
Found in this file: 15596
Parsing /home/base/code/asmap/kartograf/out/1757606400/irr/ripe.db.route
Found in this file: 397476
Parsing /home/base/code/asmap/kartograf/out/1757606400/irr/apnic.db.route
Found in this file: 592353
Found valid, unique entries: 1922594
...finished in 0:02:40.921922

--- Merging RPKI and IRR data ---

Parse base file to dictionary
Parse extra file to Pandas DataFrame
Merging extra prefixes that were not included in the base file.
Finished merging extra prefixes.
Finished filtering! Originally 1922594 entries filtered down to 438356
Merging base file with filtered extra file
...finished in 0:13:04.725607

--- Parsing Routeviews pfx2as ---

Unzipping /home/base/code/asmap/kartograf/data/1757606400/collectors/routeviews_pfx2asn_ip4.txt.gz
Formatting /home/base/code/asmap/kartograf/out/1757606400/collectors/routeviews_pfx2asn_ip4.txt
Unzipping /home/base/code/asmap/kartograf/data/1757606400/collectors/routeviews_pfx2asn_ip6.txt.gz
Formatting /home/base/code/asmap/kartograf/out/1757606400/collectors/routeviews_pfx2asn_ip6.txt
Cleaning /home/base/code/asmap/kartograf/out/1757606400/collectors/pfx2asn.txt
Entries after cleanup: 1286356
...finished in 0:00:55.591638

--- Merging Routeviews and base data ---

Parse base file to dictionary
Parse extra file to Pandas DataFrame
Merging extra prefixes that were not included in the base file.
Finished merging extra prefixes.
Finished filtering! Originally 1286356 entries filtered down to 337542
Merging base file with filtered extra file
...finished in 0:11:37.256173

--- Sorting results ---

...finished in 0:00:21.598852

--- Finishing Kartograf ---

The SHA-256 hash of the result file is: da9ba5a4f307ad2ee2bb2b5f98a1ff1bae6f7ac03c746eea2aca08518d57a4d5
Total runtime: 0:38:32.756085

[jurraca]

kind of odd, we all got the same RPKI and IRR data, but my RPKI validation step produced 10x more invalids that everyone else's. Emzy's is a little off from fjahr and bruno's run.

[fjahr]

kind of odd, we all got the same RPKI and IRR data, but my RPKI validation step produced 10x more invalids that everyone else's. Emzy's is a little off from fjahr and bruno's run.

Hmm, try a reproduction run on that data with the debug flag and see if there is a different result or what the logs say?

[jurraca]

same outcome, but I have 5895 lines of "CRL is not yet valid" from ARIN. Otherwise just bogon ASNs and routes, and some certificates not found.

[fjahr]

Hm, no more participants? I guess then we just made it with 3/5... :)

[jurraca]

alright with 3/5 this doesn't pass. I probably should have given a bit longer notice. In that spirit, here's the next run date.

On another note, I can't seem to reproduce this by running on three different machines, but trying a few things. Will also improve the logging so we can get more relevant summary outputs.

[jurraca]

Hm, no more participants? I guess then we just made it with 3/5... :)

I thought we said a minimum of 5 matches? or just majority out of 5 participants.

[fjahr]

Why does it not pass? I thought we said minimum 5 participants and majority should have the same result?

[jurraca]

Sounds good, I recalled wrong, fine by me.

[fjahr]

Here is an older one with 3/5 that I merged: #12

We can adjust the rules to be more strict of course but I think getting enough participants every time so that we have 5 matches will be hard for now. Happy to raise it to 5 if we consistently get to enough participants that it is realistic to get this many matches (I would say 8+). 3 ACKs should be enough if it's the majority of the participants.

[fjahr]

Here is the final result file with the winning hash: final_result.txt.zip