Collaborative Launch: 1755187200 (Thu Aug 14 2025 16:00:00 GMT)

[fjahr]

Next proposed collaborative launch date is 1755187200 (Thu Aug 14 2025 16:00:00 GMT). You can run the following command to set kartograf to wait and run at that time:

./run map -w=1755187200 -irr -rv -s

The latest kartograf release is 0.4.11 "Hipparchus". It features a change that should make results between participants more consistent and increase the chances of complete matches by cutting out unreliable RPKI repositories. Please make sure to use this version and definitely use the -s option like in the command above, which is new.

The requirements are Python 3.11 and rpki-client 9.5. We recommend you use Nix and run nix develop to enter an environment with all the required dependencies included. Otherwise, see the setup instructions for your platform in the README.

If people would rather we push it to a different date, please let us know below.

@jurraca @0xB10C @dunxen @Sjors @luisschwab @Emzy @jonatack @freerko @sr-gi

[luisschwab]

@fjahr you have an extra space between = and 1755187200.

[fjahr]

@fjahr you have an extra space between = and 1755187200.

fixed, thanks!

[dunxen]

I got e3a345c1d04520b813a838e3ac028aea26aad932f01d8d210d46b9aae0ac5ebd

Logs

./run map -w=1755187200 -irr -rv -s

--- Start Kartograf ---

Kartograf version: 0.4.11
Using rpki-client version 9.5 (recommended).
Coordinated launch mode: Waiting until 1755187200 (2025-08-14 18:00:00 SAST) to launch mapping process.
Countdown: 0 second(s)
Starting...
The epoch for this run is: 1755187200 (2025-08-14 16:00:00 UTC, local: 2025-08-14 18:00:00 SAST)

--- Fetching RPKI ---

Downloaded TAL for AFRINIC to /home/dunxen/repos/github.com/asmap/kartograf/data/1755187200/rpki/tals/afrinic.tal, file hash: 2838ef30ea27ce5705abf5f5adb131d8c35b1f50858338a2f3c84bb207c2fa35
Downloaded TAL for APNIC to /home/dunxen/repos/github.com/asmap/kartograf/data/1755187200/rpki/tals/apnic.tal, file hash: 472e551f7c551c2e999e582b7c9437d3bee4900fe53afff62aeb28d4940ade94
Downloaded TAL for ARIN to /home/dunxen/repos/github.com/asmap/kartograf/data/1755187200/rpki/tals/arin.tal, file hash: 1f8bdb03bcc30a3b8e11fd9a87102fba250c22137a3c8baa9c81b139cb412639
Downloaded TAL for LACNIC to /home/dunxen/repos/github.com/asmap/kartograf/data/1755187200/rpki/tals/lacnic.tal, file hash: d44bb9394ab009c8b53e5efebf2a1c9450bab61a27efe00de5a3e4587a3a2f6a
Downloaded TAL for RIPE to /home/dunxen/repos/github.com/asmap/kartograf/data/1755187200/rpki/tals/ripe.tal, file hash: 59ca27ef93f23682749fcefe7c6d70fbc723343549ff9e4d3996acaff79817fb
Downloading RPKI Data, this may take a while.
Using only stable RPKI repositories.
Downloaded RPKI Data, hash sum: f841dd90751531b14ba9b943b132180b6fb5bbd7d486e278c1aead17ebd80737
...finished in 0:04:20.446156

--- Fetching IRR ---

Downloading afrinic.db.gz
Downloaded afrinic.db.gz, file hash: eaa103617d8ffed91efaee0ee70dd92af72f5d1eca565de96565caa631dfad7f
Downloading apnic.db.route.gz
Downloaded apnic.db.route.gz, file hash: 63e7610c52777bcc0003cd986d056382dcb25f092e587c03b4308d12105bf0f9
Downloading apnic.db.route6.gz
Downloaded apnic.db.route6.gz, file hash: 9d3dbd5e8cf02bc6d030b50b15b0c53662c79ce4778253e91104f806bfed2cc4
Downloading arin.db.gz
Downloaded arin.db.gz, file hash: e75e330faf5a1956de68d5e04b48972a7d59987c1660589b65d456e7b47156b3
Downloading lacnic.db.gz
Downloaded lacnic.db.gz, file hash: 5e38f7db1672ef510d7f62a696f191e1ebb1b542e612c4e17d7029790a291212
Downloading ripe.db.route.gz
Downloaded ripe.db.route.gz, file hash: d3e2db929952fa814933fceadc111013c418175ae3694aa5baaf02b7e5a1682b
Downloading ripe.db.route6.gz
Downloaded ripe.db.route6.gz, file hash: d2b669b225e79eb744b0226dd134af92f7a20fcec4a14e74d3e5feb24950058e
...finished in 0:00:48.969387

--- Fetching Routeviews pfx2as ---

Downloading from https://publicdata.caida.org/datasets/routing/routeviews-prefix2as/2025/08/routeviews-rv2-20250812-1200.pfx2as.gz
Downloaded /home/dunxen/repos/github.com/asmap/kartograf/data/1755187200/collectors/routeviews_pfx2asn_ip4.txt.gz, file hash: 83d95dd9fc00383d2e12e16b6aca60fa7425005655737acaf06f87f99d5ecfe3
Downloading from https://publicdata.caida.org/datasets/routing/routeviews6-prefix2as/2025/08/routeviews-rv6-20250813-1200.pfx2as.gz
Downloaded /home/dunxen/repos/github.com/asmap/kartograf/data/1755187200/collectors/routeviews_pfx2asn_ip6.txt.gz, file hash: 566ba9ef07f33e751928330f1e467690298f9ab9adfb015dcfe9fc2fa4b81e93
...finished in 0:00:13.449933

--- Validating RPKI ---

Validating RPKI ROAs
315621 raw RKPI ROA files found.
100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 1263/1263 [00:15<00:00, 81.85it/s]
315621 RKPI ROAs validated and saved to /home/dunxen/repos/github.com/asmap/kartograf/out/1755187200/rpki/rpki_raw.json, file hash: fe1286e590bc9d14a8cac4f9fba91200577d7ce3033fae4b46896d2f61794cac
...finished in 0:00:33.439149

--- Parsing RPKI ---

Parsing 315621 ROAs
Result entries written: 640553
Duplicates found: 91022
Invalids found: 2056
Incompletes: 0
Non-ROA files: 0
...finished in 0:00:23.781678

--- Parsing IRR ---

Extracting afrinic.db.gz
Extracting apnic.db.route.gz
Extracting apnic.db.route6.gz
Extracting arin.db.gz
Extracting lacnic.db.gz
Extracting ripe.db.route.gz
Extracting ripe.db.route6.gz
Parsing /home/dunxen/repos/github.com/asmap/kartograf/out/1755187200/irr/afrinic.db
Found in this file: 117479
Parsing /home/dunxen/repos/github.com/asmap/kartograf/out/1755187200/irr/apnic.db.route
Found in this file: 613779
Parsing /home/dunxen/repos/github.com/asmap/kartograf/out/1755187200/irr/apnic.db.route6
Found in this file: 523644
Parsing /home/dunxen/repos/github.com/asmap/kartograf/out/1755187200/irr/arin.db
Found in this file: 110575
Parsing /home/dunxen/repos/github.com/asmap/kartograf/out/1755187200/irr/lacnic.db
Found in this file: 15454
Parsing /home/dunxen/repos/github.com/asmap/kartograf/out/1755187200/irr/ripe.db.route
Found in this file: 395571
Parsing /home/dunxen/repos/github.com/asmap/kartograf/out/1755187200/irr/ripe.db.route6
Found in this file: 148194
Found valid, unique entries: 1924696
...finished in 0:01:39.994565

--- Merging RPKI and IRR data ---

Parse base file to dictionary
Parse extra file to Pandas DataFrame
Merging extra prefixes that were not included in the base file.
Finished merging extra prefixes.
Finished filtering! Originally 1924696 entries filtered down to 435180
Merging base file with filtered extra file
...finished in 0:05:51.654202

--- Parsing Routeviews pfx2as ---

Unzipping /home/dunxen/repos/github.com/asmap/kartograf/data/1755187200/collectors/routeviews_pfx2asn_ip4.txt.gz
Formatting /home/dunxen/repos/github.com/asmap/kartograf/out/1755187200/collectors/routeviews_pfx2asn_ip4.txt
Unzipping /home/dunxen/repos/github.com/asmap/kartograf/data/1755187200/collectors/routeviews_pfx2asn_ip6.txt.gz
Formatting /home/dunxen/repos/github.com/asmap/kartograf/out/1755187200/collectors/routeviews_pfx2asn_ip6.txt
Cleaning /home/dunxen/repos/github.com/asmap/kartograf/out/1755187200/collectors/pfx2asn.txt
Entries after cleanup: 1281207
...finished in 0:00:33.062244

--- Merging Routeviews and base data ---

Parse base file to dictionary
Parse extra file to Pandas DataFrame
Merging extra prefixes that were not included in the base file.
Finished merging extra prefixes.
Finished filtering! Originally 1281207 entries filtered down to 333842
Merging base file with filtered extra file
...finished in 0:05:15.051411

--- Sorting results ---

...finished in 0:00:13.908687

--- Finishing Kartograf ---

The SHA-256 hash of the result file is: e3a345c1d04520b813a838e3ac028aea26aad932f01d8d210d46b9aae0ac5ebd
Total runtime: 0:19:55.699537

P.S. I had a hiccup with my network connection for a few minutes. I'm not sure if that might have caused some issues during download.

[jurraca]

hash: 97c5e82a1626afdaa40989b957bb84650907c30df9d666f4246f15c5e6db40a7

Logs

--- Start Kartograf ---

Kartograf version: 0.4.11
Using rpki-client version 9.5 (recommended).
Coordinated launch mode: Waiting until 1755187200 (2025-08-14 18:00:00 CEST) to launch mapping process.
Countdown: 0 second(s)
Starting...
The epoch for this run is: 1755187200 (2025-08-14 16:00:00 UTC, local: 2025-08-14 18:00:00 CEST)

--- Fetching RPKI ---

Downloaded TAL for AFRINIC to /home/base/code/asmap/kartograf/data/1755187200/rpki/tals/afrinic.tal, file hash: 2838ef30ea27ce5705abf5f5adb131d8c35b1f50858338a2f3c84bb
207c2fa35
Downloaded TAL for APNIC to /home/base/code/asmap/kartograf/data/1755187200/rpki/tals/apnic.tal, file hash: 472e551f7c551c2e999e582b7c9437d3bee4900fe53afff62aeb28d4940
ade94
Downloaded TAL for ARIN to /home/base/code/asmap/kartograf/data/1755187200/rpki/tals/arin.tal, file hash: 1f8bdb03bcc30a3b8e11fd9a87102fba250c22137a3c8baa9c81b139cb412
639
Downloaded TAL for LACNIC to /home/base/code/asmap/kartograf/data/1755187200/rpki/tals/lacnic.tal, file hash: d44bb9394ab009c8b53e5efebf2a1c9450bab61a27efe00de5a3e4587
a3a2f6a
Downloaded TAL for RIPE to /home/base/code/asmap/kartograf/data/1755187200/rpki/tals/ripe.tal, file hash: 59ca27ef93f23682749fcefe7c6d70fbc723343549ff9e4d3996acaff7981
7fb
Downloading RPKI Data, this may take a while.
Using only stable RPKI repositories.
Downloaded RPKI Data, hash sum: e002158596bcd1469983de9986041a5b9479172847f97c7306d8859299e66f10
...finished in 0:05:10.609600

--- Fetching IRR ---

Downloading afrinic.db.gz
Downloaded afrinic.db.gz, file hash: eaa103617d8ffed91efaee0ee70dd92af72f5d1eca565de96565caa631dfad7f
Downloading apnic.db.route.gz
Downloaded apnic.db.route.gz, file hash: 63e7610c52777bcc0003cd986d056382dcb25f092e587c03b4308d12105bf0f9
Downloading apnic.db.route6.gz
Downloaded apnic.db.route6.gz, file hash: 9d3dbd5e8cf02bc6d030b50b15b0c53662c79ce4778253e91104f806bfed2cc4
Downloading arin.db.gz
Downloaded arin.db.gz, file hash: e75e330faf5a1956de68d5e04b48972a7d59987c1660589b65d456e7b47156b3
Downloading lacnic.db.gz
Downloaded lacnic.db.gz, file hash: 5e38f7db1672ef510d7f62a696f191e1ebb1b542e612c4e17d7029790a291212
Downloading ripe.db.route.gz
Downloaded ripe.db.route.gz, file hash: d3e2db929952fa814933fceadc111013c418175ae3694aa5baaf02b7e5a1682b
Downloading ripe.db.route6.gz
Downloaded ripe.db.route6.gz, file hash: d2b669b225e79eb744b0226dd134af92f7a20fcec4a14e74d3e5feb24950058e
...finished in 0:00:25.067006

--- Fetching Routeviews pfx2as ---

Downloading from https://publicdata.caida.org/datasets/routing/routeviews-prefix2as/2025/08/routeviews-rv2-20250812-1200.pfx2as.gz
Downloaded /home/base/code/asmap/kartograf/data/1755187200/collectors/routeviews_pfx2asn_ip4.txt.gz, file hash: 83d95dd9fc00383d2e12e16b6aca60fa7425005655737acaf06f87f
99d5ecfe3
Downloading from https://publicdata.caida.org/datasets/routing/routeviews6-prefix2as/2025/08/routeviews-rv6-20250813-1200.pfx2as.gz
Downloaded /home/base/code/asmap/kartograf/data/1755187200/collectors/routeviews_pfx2asn_ip6.txt.gz, file hash: 566ba9ef07f33e751928330f1e467690298f9ab9adfb015dcfe9fc2
fa4b81e93
...finished in 0:00:05.660200

--- Validating RPKI ---

Validating RPKI ROAs
317282 raw RKPI ROA files found.
100%|████████████████████████████████████████████████████████| 1270/1270 [00:51<00:00, 24.56it/s]
317282 RKPI ROAs validated and saved to /home/base/code/asmap/kartograf/out/1755187200/rpki/rpki_raw.json, file hash: 8f8a3c99c0858f39262e2c67cf2a4e4bf5b50aa9219c04518
7dd7d5545f66ebb
...finished in 0:01:12.821366

--- Parsing RPKI ---

Parsing 317282 ROAs
Result entries written: 641909
Duplicates found: 91493
Invalids found: 2076
Incompletes: 0
Non-ROA files: 0
...finished in 0:00:36.272875

--- Parsing IRR ---

Extracting afrinic.db.gz
Extracting apnic.db.route.gz
Extracting apnic.db.route6.gz
Extracting arin.db.gz
Extracting lacnic.db.gz
Extracting ripe.db.route.gz
Extracting ripe.db.route6.gz

Parsing /home/base/code/asmap/kartograf/out/1755187200/irr/afrinic.db
Found in this file: 117479
Parsing /home/base/code/asmap/kartograf/out/1755187200/irr/arin.db
Found in this file: 110575
Parsing /home/base/code/asmap/kartograf/out/1755187200/irr/ripe.db.route6
Found in this file: 148194
Parsing /home/base/code/asmap/kartograf/out/1755187200/irr/apnic.db.route6
Found in this file: 523644
Parsing /home/base/code/asmap/kartograf/out/1755187200/irr/lacnic.db
Found in this file: 15454
Parsing /home/base/code/asmap/kartograf/out/1755187200/irr/ripe.db.route
Found in this file: 395571
Parsing /home/base/code/asmap/kartograf/out/1755187200/irr/apnic.db.route
Found in this file: 613779
Found valid, unique entries: 1924696
...finished in 0:02:28.105730

--- Merging RPKI and IRR data ---

Parse base file to dictionary
Parse extra file to Pandas DataFrame
Merging extra prefixes that were not included in the base file.
Finished merging extra prefixes.
Finished filtering! Originally 1924696 entries filtered down to 430986
Merging base file with filtered extra file
...finished in 0:12:25.230054

--- Parsing Routeviews pfx2as ---

Unzipping /home/base/code/asmap/kartograf/data/1755187200/collectors/routeviews_pfx2asn_ip4.txt.gz
Formatting /home/base/code/asmap/kartograf/out/1755187200/collectors/routeviews_pfx2asn_ip4.txt
Unzipping /home/base/code/asmap/kartograf/data/1755187200/collectors/routeviews_pfx2asn_ip6.txt.gz
Formatting /home/base/code/asmap/kartograf/out/1755187200/collectors/routeviews_pfx2asn_ip6.txt
Cleaning /home/base/code/asmap/kartograf/out/1755187200/collectors/pfx2asn.txt
Entries after cleanup: 1281207
...finished in 0:00:51.868822

--- Merging Routeviews and base data ---

Parse base file to dictionary
Parse extra file to Pandas DataFrame
Merging extra prefixes that were not included in the base file.
Finished merging extra prefixes.

Finished filtering! Originally 1281207 entries filtered down to 332891
Merging base file with filtered extra file
...finished in 0:11:11.998796

--- Sorting results ---

...finished in 0:00:20.080039

--- Finishing Kartograf ---

The SHA-256 hash of the result file is: 97c5e82a1626afdaa40989b957bb84650907c30df9d666f4246f15c5e6db40a7
Total runtime: 0:34:49.806456

[fjahr]

I got 97c5e82a1626afdaa40989b957bb84650907c30df9d666f4246f15c5e6db40a7

Matching with @jurraca 👍

logs

$ ./run map -w=1755187200 -irr -rv -s

--- Start Kartograf ---

Kartograf version: 0.4.11
Using rpki-client version 9.5 (recommended).
Coordinated launch mode: Waiting until 1755187200 (2025-08-14 18:00:00 CEST) to launch mapping process.
Countdown: 0 second(s)
Starting...
The epoch for this run is: 1755187200 (2025-08-14 16:00:00 UTC, local: 2025-08-14 18:00:00 CEST)

--- Fetching RPKI ---

Downloaded TAL for AFRINIC to /Users/FJ/projects/python/kartograf/data/1755187200/rpki/tals/afrinic.tal, file hash: 2838ef30ea27ce5705abf5f5adb131d8c35b1f50858338a2f3c84bb207c2fa35
Downloaded TAL for APNIC to /Users/FJ/projects/python/kartograf/data/1755187200/rpki/tals/apnic.tal, file hash: 472e551f7c551c2e999e582b7c9437d3bee4900fe53afff62aeb28d4940ade94
Downloaded TAL for ARIN to /Users/FJ/projects/python/kartograf/data/1755187200/rpki/tals/arin.tal, file hash: 1f8bdb03bcc30a3b8e11fd9a87102fba250c22137a3c8baa9c81b139cb412639
Downloaded TAL for LACNIC to /Users/FJ/projects/python/kartograf/data/1755187200/rpki/tals/lacnic.tal, file hash: d44bb9394ab009c8b53e5efebf2a1c9450bab61a27efe00de5a3e4587a3a2f6a
Downloaded TAL for RIPE to /Users/FJ/projects/python/kartograf/data/1755187200/rpki/tals/ripe.tal, file hash: 59ca27ef93f23682749fcefe7c6d70fbc723343549ff9e4d3996acaff79817fb
Downloading RPKI Data, this may take a while.
Using only stable RPKI repositories.
Downloaded RPKI Data, hash sum: 5656be6f707226885fa8cceede6efbb986663a3eb7cc45e503a31731adac23a1
...finished in 0:03:57.683696

--- Fetching IRR ---

Downloading afrinic.db.gz
Downloaded afrinic.db.gz, file hash: eaa103617d8ffed91efaee0ee70dd92af72f5d1eca565de96565caa631dfad7f
Downloading apnic.db.route.gz
Downloaded apnic.db.route.gz, file hash: 63e7610c52777bcc0003cd986d056382dcb25f092e587c03b4308d12105bf0f9
Downloading apnic.db.route6.gz
Downloaded apnic.db.route6.gz, file hash: 9d3dbd5e8cf02bc6d030b50b15b0c53662c79ce4778253e91104f806bfed2cc4
Downloading arin.db.gz
Downloaded arin.db.gz, file hash: e75e330faf5a1956de68d5e04b48972a7d59987c1660589b65d456e7b47156b3
Downloading lacnic.db.gz
Downloaded lacnic.db.gz, file hash: 5e38f7db1672ef510d7f62a696f191e1ebb1b542e612c4e17d7029790a291212
Downloading ripe.db.route.gz
Downloaded ripe.db.route.gz, file hash: d3e2db929952fa814933fceadc111013c418175ae3694aa5baaf02b7e5a1682b
Downloading ripe.db.route6.gz
Downloaded ripe.db.route6.gz, file hash: d2b669b225e79eb744b0226dd134af92f7a20fcec4a14e74d3e5feb24950058e
...finished in 0:00:25.171765

--- Fetching Routeviews pfx2as ---

Downloading from https://publicdata.caida.org/datasets/routing/routeviews-prefix2as/2025/08/routeviews-rv2-20250812-1200.pfx2as.gz
Downloaded /Users/FJ/projects/python/kartograf/data/1755187200/collectors/routeviews_pfx2asn_ip4.txt.gz, file hash: 83d95dd9fc00383d2e12e16b6aca60fa7425005655737acaf06f87f99d5ecfe3
Downloading from https://publicdata.caida.org/datasets/routing/routeviews6-prefix2as/2025/08/routeviews-rv6-20250813-1200.pfx2as.gz
Downloaded /Users/FJ/projects/python/kartograf/data/1755187200/collectors/routeviews_pfx2asn_ip6.txt.gz, file hash: 566ba9ef07f33e751928330f1e467690298f9ab9adfb015dcfe9fc2fa4b81e93
...finished in 0:00:06.071173

--- Validating RPKI ---

Validating RPKI ROAs
317282 raw RKPI ROA files found.
100%|██████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 1270/1270 [00:19<00:00, 66.08it/s]
317282 RKPI ROAs validated and saved to /Users/FJ/projects/python/kartograf/out/1755187200/rpki/rpki_raw.json, file hash: ff2a5d57f683aeb65c8ea4dfb751dd5fbc8062ad320a821934c8935dfb9c8514
...finished in 0:00:37.030056

--- Parsing RPKI ---

Parsing 317282 ROAs
Result entries written: 641909
Duplicates found: 91493
Invalids found: 2076
Incompletes: 0
Non-ROA files: 0
...finished in 0:00:13.757905

--- Parsing IRR ---

Extracting afrinic.db.gz
Extracting apnic.db.route.gz
Extracting apnic.db.route6.gz
Extracting arin.db.gz
Extracting lacnic.db.gz
Extracting ripe.db.route.gz
Extracting ripe.db.route6.gz
Parsing /Users/FJ/projects/python/kartograf/out/1755187200/irr/lacnic.db
Found in this file: 15454
Parsing /Users/FJ/projects/python/kartograf/out/1755187200/irr/ripe.db.route
Found in this file: 395571
Parsing /Users/FJ/projects/python/kartograf/out/1755187200/irr/apnic.db.route6
Found in this file: 523644
Parsing /Users/FJ/projects/python/kartograf/out/1755187200/irr/apnic.db.route
Found in this file: 613779
Parsing /Users/FJ/projects/python/kartograf/out/1755187200/irr/arin.db
Found in this file: 110575
Parsing /Users/FJ/projects/python/kartograf/out/1755187200/irr/afrinic.db
Found in this file: 117479
Parsing /Users/FJ/projects/python/kartograf/out/1755187200/irr/ripe.db.route6
Found in this file: 148194
Found valid, unique entries: 1924696
...finished in 0:00:48.255589

--- Merging RPKI and IRR data ---

Parse base file to dictionary
Parse extra file to Pandas DataFrame
Merging extra prefixes that were not included in the base file.
Finished merging extra prefixes.
Finished filtering! Originally 1924696 entries filtered down to 430986
Merging base file with filtered extra file
...finished in 0:03:17.773605

--- Parsing Routeviews pfx2as ---

Unzipping /Users/FJ/projects/python/kartograf/data/1755187200/collectors/routeviews_pfx2asn_ip4.txt.gz
Formatting /Users/FJ/projects/python/kartograf/out/1755187200/collectors/routeviews_pfx2asn_ip4.txt
Unzipping /Users/FJ/projects/python/kartograf/data/1755187200/collectors/routeviews_pfx2asn_ip6.txt.gz
Formatting /Users/FJ/projects/python/kartograf/out/1755187200/collectors/routeviews_pfx2asn_ip6.txt
Cleaning /Users/FJ/projects/python/kartograf/out/1755187200/collectors/pfx2asn.txt
Entries after cleanup: 1281207
...finished in 0:00:18.706569

--- Merging Routeviews and base data ---

Parse base file to dictionary
Parse extra file to Pandas DataFrame
Merging extra prefixes that were not included in the base file.
Finished merging extra prefixes.
Finished filtering! Originally 1281207 entries filtered down to 332891
Merging base file with filtered extra file
...finished in 0:03:03.387809

--- Sorting results ---

...finished in 0:00:07.390398

--- Finishing Kartograf ---

The SHA-256 hash of the result file is: 97c5e82a1626afdaa40989b957bb84650907c30df9d666f4246f15c5e6db40a7
Total runtime: 0:12:56.203109

[Emzy]

The SHA-256 hash of the result file is: 97c5e82a1626afdaa40989b957bb84650907c30df9d666f4246f15c5e6db40a7
Total runtime: 0:35:23.656639

[Sjors]

97c5e82a1626afdaa40989b957bb84650907c30df9d666f4246f15c5e6db40a7

$ ./run map -w=1755187200 -irr -rv -s


--- Start Kartograf ---

Kartograf version: 0.4.11
Using rpki-client version 9.5 (recommended).
Coordinated launch mode: Waiting until 1755187200 (2025-08-14 18:00:00 CEST) to launch mapping process.
Countdown: 0 second(s)
Starting...
The epoch for this run is: 1755187200 (2025-08-14 16:00:00 UTC, local: 2025-08-14 18:00:00 CEST)

--- Fetching RPKI ---

Downloaded TAL for AFRINIC to /home/sjors/dev/kartograf/data/1755187200/rpki/tals/afrinic.tal, file hash: 2838ef30ea27ce5705abf5f5adb131d8c35b1f50858338a2f3c84bb207c2fa35
Downloaded TAL for APNIC to /home/sjors/dev/kartograf/data/1755187200/rpki/tals/apnic.tal, file hash: 472e551f7c551c2e999e582b7c9437d3bee4900fe53afff62aeb28d4940ade94
Downloaded TAL for ARIN to /home/sjors/dev/kartograf/data/1755187200/rpki/tals/arin.tal, file hash: 1f8bdb03bcc30a3b8e11fd9a87102fba250c22137a3c8baa9c81b139cb412639
Downloaded TAL for LACNIC to /home/sjors/dev/kartograf/data/1755187200/rpki/tals/lacnic.tal, file hash: d44bb9394ab009c8b53e5efebf2a1c9450bab61a27efe00de5a3e4587a3a2f6a
Downloaded TAL for RIPE to /home/sjors/dev/kartograf/data/1755187200/rpki/tals/ripe.tal, file hash: 59ca27ef93f23682749fcefe7c6d70fbc723343549ff9e4d3996acaff79817fb
Downloading RPKI Data, this may take a while.
Using only stable RPKI repositories.
Downloaded RPKI Data, hash sum: c04cfa05bb86d113455d63dac8fc8617f6bcf069b8654990b98b124a2911549d
...finished in 0:02:38.581339

--- Fetching IRR ---

Downloading afrinic.db.gz
Downloaded afrinic.db.gz, file hash: eaa103617d8ffed91efaee0ee70dd92af72f5d1eca565de96565caa631dfad7f
Downloading apnic.db.route.gz
Downloaded apnic.db.route.gz, file hash: 63e7610c52777bcc0003cd986d056382dcb25f092e587c03b4308d12105bf0f9
Downloading apnic.db.route6.gz
Downloaded apnic.db.route6.gz, file hash: 9d3dbd5e8cf02bc6d030b50b15b0c53662c79ce4778253e91104f806bfed2cc4
Downloading arin.db.gz
Downloaded arin.db.gz, file hash: e75e330faf5a1956de68d5e04b48972a7d59987c1660589b65d456e7b47156b3
Downloading lacnic.db.gz
Downloaded lacnic.db.gz, file hash: 5e38f7db1672ef510d7f62a696f191e1ebb1b542e612c4e17d7029790a291212
Downloading ripe.db.route.gz
Downloaded ripe.db.route.gz, file hash: d3e2db929952fa814933fceadc111013c418175ae3694aa5baaf02b7e5a1682b
Downloading ripe.db.route6.gz
Downloaded ripe.db.route6.gz, file hash: d2b669b225e79eb744b0226dd134af92f7a20fcec4a14e74d3e5feb24950058e
...finished in 0:00:21.690840

--- Fetching Routeviews pfx2as ---

Downloading from https://publicdata.caida.org/datasets/routing/routeviews-prefix2as/2025/08/routeviews-rv2-20250812-1200.pfx2as.gz
Downloaded /home/sjors/dev/kartograf/data/1755187200/collectors/routeviews_pfx2asn_ip4.txt.gz, file hash: 83d95dd9fc00383d2e12e16b6aca60fa7425005655737acaf06f87f99d5ecfe3
Downloading from https://publicdata.caida.org/datasets/routing/routeviews6-prefix2as/2025/08/routeviews-rv6-20250813-1200.pfx2as.gz
Downloaded /home/sjors/dev/kartograf/data/1755187200/collectors/routeviews_pfx2asn_ip6.txt.gz, file hash: 566ba9ef07f33e751928330f1e467690298f9ab9adfb015dcfe9fc2fa4b81e93
...finished in 0:00:08.474548

--- Validating RPKI ---

Validating RPKI ROAs
317282 raw RKPI ROA files found.
100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 1270/1270 [00:07<00:00, 171.29it/s]
317282 RKPI ROAs validated and saved to /home/sjors/dev/kartograf/out/1755187200/rpki/rpki_raw.json, file hash: a74aa71b599491d43f401f4aabef068fc6f503e802f63a2747011def80de1ec5
...finished in 0:00:19.388821

--- Parsing RPKI ---

Parsing 317282 ROAs
Result entries written: 641909
Duplicates found: 91493
Invalids found: 2076
Incompletes: 0
Non-ROA files: 0
...finished in 0:00:18.749625

--- Parsing IRR ---

Extracting afrinic.db.gz
Extracting apnic.db.route.gz
Extracting apnic.db.route6.gz
Extracting arin.db.gz
Extracting lacnic.db.gz
Extracting ripe.db.route.gz
Extracting ripe.db.route6.gz
Parsing /home/sjors/dev/kartograf/out/1755187200/irr/arin.db
Found in this file: 110575
Parsing /home/sjors/dev/kartograf/out/1755187200/irr/afrinic.db
Found in this file: 117479
Parsing /home/sjors/dev/kartograf/out/1755187200/irr/lacnic.db
Found in this file: 15454
Parsing /home/sjors/dev/kartograf/out/1755187200/irr/ripe.db.route
Found in this file: 395571
Parsing /home/sjors/dev/kartograf/out/1755187200/irr/apnic.db.route6
Found in this file: 523644
Parsing /home/sjors/dev/kartograf/out/1755187200/irr/ripe.db.route6
Found in this file: 148194
Parsing /home/sjors/dev/kartograf/out/1755187200/irr/apnic.db.route
Found in this file: 613779
Found valid, unique entries: 1924696
...finished in 0:01:11.936347

--- Merging RPKI and IRR data ---

Parse base file to dictionary
Parse extra file to Pandas DataFrame
Merging extra prefixes that were not included in the base file.
Finished merging extra prefixes.
Finished filtering! Originally 1924696 entries filtered down to 430986
Merging base file with filtered extra file
...finished in 0:05:13.876525

--- Parsing Routeviews pfx2as ---

Unzipping /home/sjors/dev/kartograf/data/1755187200/collectors/routeviews_pfx2asn_ip4.txt.gz
Formatting /home/sjors/dev/kartograf/out/1755187200/collectors/routeviews_pfx2asn_ip4.txt
Unzipping /home/sjors/dev/kartograf/data/1755187200/collectors/routeviews_pfx2asn_ip6.txt.gz
Formatting /home/sjors/dev/kartograf/out/1755187200/collectors/routeviews_pfx2asn_ip6.txt
Cleaning /home/sjors/dev/kartograf/out/1755187200/collectors/pfx2asn.txt
Entries after cleanup: 1281207
...finished in 0:00:26.921319

--- Merging Routeviews and base data ---

Parse base file to dictionary
Parse extra file to Pandas DataFrame
Merging extra prefixes that were not included in the base file.
Finished merging extra prefixes.
Finished filtering! Originally 1281207 entries filtered down to 332891
Merging base file with filtered extra file
...finished in 0:04:42.686303

--- Sorting results ---

...finished in 0:00:11.828731

--- Finishing Kartograf ---

The SHA-256 hash of the result file is: 97c5e82a1626afdaa40989b957bb84650907c30df9d666f4246f15c5e6db40a7
Total runtime: 0:15:35.442599

[luisschwab]

Also got 97c5e82a1626afdaa40989b957bb84650907c30df9d666f4246f15c5e6db40a7

Accidentally cleared my term, so no logs. I think stdout should be saved to file as well.

[jurraca]

yess thank you gents. yea @dunxen is missing about 1500 rpki entries, might be a network thing -- both IRR and RV hashes match but RPKI doesn't.

[brunoerg]

fdf086fe308e00405432752abe22d73e4b23de74296151a2d0da56d1fa948105

Logs

  --- Fetching RPKI ---

Downloaded TAL for AFRINIC to /Users/brunogarcia/projects/kartograf/data/1755187200/rpki/tals/afrinic.tal, file hash: 2838ef30ea27ce5705abf5f5adb131d8c35b1f50858338a2f3c84bb207c2fa35
Downloaded TAL for APNIC to /Users/brunogarcia/projects/kartograf/data/1755187200/rpki/tals/apnic.tal, file hash: 472e551f7c551c2e999e582b7c9437d3bee4900fe53afff62aeb28d4940ade94
Downloaded TAL for ARIN to /Users/brunogarcia/projects/kartograf/data/1755187200/rpki/tals/arin.tal, file hash: 1f8bdb03bcc30a3b8e11fd9a87102fba250c22137a3c8baa9c81b139cb412639
Downloaded TAL for LACNIC to /Users/brunogarcia/projects/kartograf/data/1755187200/rpki/tals/lacnic.tal, file hash: d44bb9394ab009c8b53e5efebf2a1c9450bab61a27efe00de5a3e4587a3a2f6a
Downloaded TAL for RIPE to /Users/brunogarcia/projects/kartograf/data/1755187200/rpki/tals/ripe.tal, file hash: 59ca27ef93f23682749fcefe7c6d70fbc723343549ff9e4d3996acaff79817fb
Downloading RPKI Data, this may take a while.
Using only stable RPKI repositories.
Downloaded RPKI Data, hash sum: f47e1d507297afbb295a5cb9c71804ee147bee6875cc61016b815b4cda8e0fff
...finished in 0:05:25.304513

--- Fetching IRR ---

Downloading afrinic.db.gz
Downloaded afrinic.db.gz, file hash: eaa103617d8ffed91efaee0ee70dd92af72f5d1eca565de96565caa631dfad7f
Downloading apnic.db.route.gz
Downloaded apnic.db.route.gz, file hash: 63e7610c52777bcc0003cd986d056382dcb25f092e587c03b4308d12105bf0f9
Downloading apnic.db.route6.gz
Downloaded apnic.db.route6.gz, file hash: 9d3dbd5e8cf02bc6d030b50b15b0c53662c79ce4778253e91104f806bfed2cc4
Downloading arin.db.gz
Downloaded arin.db.gz, file hash: e75e330faf5a1956de68d5e04b48972a7d59987c1660589b65d456e7b47156b3
Downloading lacnic.db.gz
Downloaded lacnic.db.gz, file hash: 5e38f7db1672ef510d7f62a696f191e1ebb1b542e612c4e17d7029790a291212
Downloading ripe.db.route.gz
Downloaded ripe.db.route.gz, file hash: d3e2db929952fa814933fceadc111013c418175ae3694aa5baaf02b7e5a1682b
Downloading ripe.db.route6.gz
Downloaded ripe.db.route6.gz, file hash: d2b669b225e79eb744b0226dd134af92f7a20fcec4a14e74d3e5feb24950058e
...finished in 0:01:22.970503

--- Fetching Routeviews pfx2as ---

Downloading from https://publicdata.caida.org/datasets/routing/routeviews-prefix2as/2025/08/routeviews-rv2-20250812-1200.pfx2as.gz
Downloaded /Users/brunogarcia/projects/kartograf/data/1755187200/collectors/routeviews_pfx2asn_ip4.txt.gz, file hash: 83d95dd9fc00383d2e12e16b6aca60fa7425005655737acaf06f87f99d5ecfe3
Downloading from https://publicdata.caida.org/datasets/routing/routeviews6-prefix2as/2025/08/routeviews-rv6-20250813-1200.pfx2as.gz
Downloaded /Users/brunogarcia/projects/kartograf/data/1755187200/collectors/routeviews_pfx2asn_ip6.txt.gz, file hash: 566ba9ef07f33e751928330f1e467690298f9ab9adfb015dcfe9fc2fa4b81e93
...finished in 0:00:08.657702

--- Validating RPKI ---

Validating RPKI ROAs
317282 raw RKPI ROA files found.
100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 1270/1270 [00:49<00:00, 25.74it/s]
317282 RKPI ROAs validated and saved to /Users/brunogarcia/projects/kartograf/out/1755187200/rpki/rpki_raw.json, file hash: d376d9c8f991d6d17f759736752b87f8f8495fc8189345459524a302888a3640
...finished in 0:01:14.202586

--- Parsing RPKI ---

Parsing 317282 ROAs
Result entries written: 641906
Duplicates found: 91492
Invalids found: 2080
Incompletes: 0
Non-ROA files: 0
...finished in 0:00:20.085284

--- Parsing IRR ---

Extracting afrinic.db.gz
Extracting apnic.db.route.gz
Extracting apnic.db.route6.gz
Extracting arin.db.gz
Extracting lacnic.db.gz
Extracting ripe.db.route.gz
Extracting ripe.db.route6.gz
Parsing /Users/brunogarcia/projects/kartograf/out/1755187200/irr/lacnic.db
Found in this file: 15454
Parsing /Users/brunogarcia/projects/kartograf/out/1755187200/irr/ripe.db.route
Found in this file: 395571
Parsing /Users/brunogarcia/projects/kartograf/out/1755187200/irr/apnic.db.route6
Found in this file: 523644
Parsing /Users/brunogarcia/projects/kartograf/out/1755187200/irr/apnic.db.route
Found in this file: 613779
Parsing /Users/brunogarcia/projects/kartograf/out/1755187200/irr/arin.db
Found in this file: 110575
Parsing /Users/brunogarcia/projects/kartograf/out/1755187200/irr/afrinic.db
Found in this file: 117479
Parsing /Users/brunogarcia/projects/kartograf/out/1755187200/irr/ripe.db.route6
Found in this file: 148194
Found valid, unique entries: 1924696
...finished in 0:01:13.646593

--- Merging RPKI and IRR data ---

Parse base file to dictionary
Parse extra file to Pandas DataFrame
Merging extra prefixes that were not included in the base file.
Finished merging extra prefixes.
Finished filtering! Originally 1924696 entries filtered down to 430986
Merging base file with filtered extra file
...finished in 0:05:08.787046

--- Parsing Routeviews pfx2as ---

Unzipping /Users/brunogarcia/projects/kartograf/data/1755187200/collectors/routeviews_pfx2asn_ip4.txt.gz
Formatting /Users/brunogarcia/projects/kartograf/out/1755187200/collectors/routeviews_pfx2asn_ip4.txt
Unzipping /Users/brunogarcia/projects/kartograf/data/1755187200/collectors/routeviews_pfx2asn_ip6.txt.gz
Formatting /Users/brunogarcia/projects/kartograf/out/1755187200/collectors/routeviews_pfx2asn_ip6.txt
Cleaning /Users/brunogarcia/projects/kartograf/out/1755187200/collectors/pfx2asn.txt
Entries after cleanup: 1281207
...finished in 0:00:29.101204

--- Merging Routeviews and base data ---

Parse base file to dictionary
Parse extra file to Pandas DataFrame
Merging extra prefixes that were not included in the base file.
Finished merging extra prefixes.
Finished filtering! Originally 1281207 entries filtered down to 332897
Merging base file with filtered extra file
...finished in 0:04:31.006374

--- Sorting results ---

...finished in 0:00:11.832767

--- Finishing Kartograf ---

The SHA-256 hash of the result file is: fdf086fe308e00405432752abe22d73e4b23de74296151a2d0da56d1fa948105
Total runtime: 0:20:06.956434

[fjahr]

@dunxen could you maybe run ls data/1755187200/rpki/cache/ from the kartograf directory and let us know the result? We could see if any of the repositories didn't respond at all for you, then their folder should be missing.

[jurraca]

there's also scripts/rpki_repo_summary.py that may give more detail: python scripts/rpki_repo_summary.py data/1755187200

[fjahr]

5/7 for 97c5e82a1626afdaa40989b957bb84650907c30df9d666f4246f15c5e6db40a7 looks very good. Thanks to everyone who posted a result so far. I will keep this open until tomorrow to see if more results come in but it seems safe to say that the latest changes are an improvement. Great work @jurraca !

[0xB10C]

The SHA-256 hash of the result file is: 97c5e82a1626afdaa40989b957bb84650907c30df9d666f4246f15c5e6db40a7