Collaborative Launch: 1742572800 (Friday, March 21st, 16:00:00 UTC)

[jurraca]

Next proposed collaborative launch date is 1742572800 (Friday, March 21st, 16:00:00 UTC).

You can run the following command to set kartograf to wait and run at that time:

./run map -w=1742572800 -irr -rv

The latest kartograf release is 0.4.9.
The requirements are Python 3.11 and rpki-client 9.4. We recommend you use Nix and run nix develop to enter an environment with all the required dependencies included. Otherwise, see the setup instructions for your platform in the README.

If people would rather we push it to next week, please let us know below.

@fjahr @0xB10C @dunxen @Sjors @luisschwab @Emzy @jonatack

[Emzy]

I did a test run. It only took 45 minutes instead of 17 hours like before.

[jurraca]

yea, we've made some speed improvements. Looking forward to seeing how it goes for everyone.

[fjahr]

I did a test run. It only took 45 minutes instead of 17 hours like before.

May I ask what the rough specs are of this machine? We plan to do workshops on asmap again including a collaborative run and we were going to aim for doing it in 1h which is only now made possible by all the speed improvements. On a high end laptop I'm seeing 15min so I was hoping most people would see 30min or less. If it ends up being more we might have to aim for taking a bit more time with the workshops.

[Emzy]

It's an old cheep thin client running Debian GNU/Linux 12 (bookworm).
Hardware: Lenovo ThinkCentre M910q Tiny Intel i3-6100T (3,2GHz) 8GB DDR4 512GB SATA-SSD

[Sjors]

Ubuntu 24.10 is still at rpki-client 9.3 (Ubuntu 25.04 will have the newer version).

So I'll try a manual compile of 9.4 or the nix alternative.

rpki-client/rpki-client-portable#120

[Sjors]

My test run took 15 minutes, down from 3 hours back in August 2024: #15 (comment) (AMD Ryzen 7950x)

[brunoerg]

I did a test run recently and the performance improvement is really notable. Will join tomorrow!

[jonatack]

Just did a first test run of ./run map and it took 12 minutes (ARM64 M1 Max).

[jonatack]

Started my run 3 minutes ago. Do we share them here?

[fjahr]

Started my run 3 minutes ago. Do we share them here?

Yepp, see the last run as an example: #18

EDIT: actually that's not the last one but you get the idea :)

[fjahr]

FIRST ;)195ca71dcfadfd482539a809d2476ea319a15b2b8fac8f62f376ad00fdd33174

logs

$ ./run map -w=1742572800 -irr -rv

--- Start Kartograf ---

Kartograf version: 0.4.9
Using rpki-client version 9.4 (recommended).
Coordinated launch mode: Waiting until 1742572800 (2025-03-21 17:00:00 CET) to launch mapping process.
Countdown: 0 second(s)
Starting...
The epoch for this run is: 1742572800 (2025-03-21 16:00:00 UTC, local: 2025-03-21 17:00:00 CET)

--- Fetching RPKI ---

Downloaded TAL for AFRINIC to /Users/FJ/projects/python/kartograf/data/1742572800/rpki/tals/afrinic.tal, file hash: 2838ef30ea27ce5705abf5f5adb131d8c35b1f50858338a2f3c84bb207c2fa35
Downloaded TAL for APNIC to /Users/FJ/projects/python/kartograf/data/1742572800/rpki/tals/apnic.tal, file hash: 472e551f7c551c2e999e582b7c9437d3bee4900fe53afff62aeb28d4940ade94
Downloaded TAL for ARIN to /Users/FJ/projects/python/kartograf/data/1742572800/rpki/tals/arin.tal, file hash: 1f8bdb03bcc30a3b8e11fd9a87102fba250c22137a3c8baa9c81b139cb412639
Downloaded TAL for LACNIC to /Users/FJ/projects/python/kartograf/data/1742572800/rpki/tals/lacnic.tal, file hash: d44bb9394ab009c8b53e5efebf2a1c9450bab61a27efe00de5a3e4587a3a2f6a
Downloaded TAL for RIPE to /Users/FJ/projects/python/kartograf/data/1742572800/rpki/tals/ripe.tal, file hash: 59ca27ef93f23682749fcefe7c6d70fbc723343549ff9e4d3996acaff79817fb
Downloading RPKI Data, this may take a while.
Downloaded RPKI Data, hash sum: 9555b4911c1e0a213b32ea4de052ab3c02f5d48a0f83b86e48674b6b72732171
...finished in 0:04:08.801698

--- Fetching IRR ---

Downloading afrinic.db.gz
Downloaded afrinic.db.gz, file hash: 248c4fcff7e32c4dbecac9b6ba02eb824662331cd16fe42cc5acd60a9049e748
Downloading apnic.db.route.gz
Downloaded apnic.db.route.gz, file hash: 391c11dc3c8f89c7f0b7ff2209e56769c1dad099a6d6740884912eb6d2514514
Downloading apnic.db.route6.gz
Downloaded apnic.db.route6.gz, file hash: 9d3f074f6f9f89fc1b58c145e8eee04993d462e8ebfaec7fdaddb041d4291cdb
Downloading arin.db.gz
Downloaded arin.db.gz, file hash: a3b7ec63c95995470d11c14a3cd16f8679dcd160079190b4a568585bfba86d56
Downloading lacnic.db.gz
Downloaded lacnic.db.gz, file hash: 2d05bf7701b27622bb2da295124f4879f500e8d45933283c2989e808fa0e4cb2
Downloading ripe.db.route.gz
Downloaded ripe.db.route.gz, file hash: ad546d6699ab783ab129d2705ffc9fa5706fe43f09b689ddb9cefd89fd38e4cf
Downloading ripe.db.route6.gz
Downloaded ripe.db.route6.gz, file hash: 7a999e197e17e859749050fc6dea9d385074e82df32089ac2e74ed91eaf20ea0
...finished in 0:01:58.881572

--- Fetching Routeviews pfx2as ---

Downloading from https://publicdata.caida.org/datasets/routing/routeviews-prefix2as/2025/03/routeviews-rv2-20250319-0000.pfx2as.gz
Downloaded /Users/FJ/projects/python/kartograf/data/1742572800/collectors/routeviews_pfx2asn_ip4.txt.gz, file hash: d339a35aacee76f04ef975e6df713ae339af61d0d6dbab43688d1719972861ec
Downloading from https://publicdata.caida.org/datasets/routing/routeviews6-prefix2as/2025/03/routeviews-rv6-20250320-1200.pfx2as.gz
Downloaded /Users/FJ/projects/python/kartograf/data/1742572800/collectors/routeviews_pfx2asn_ip6.txt.gz, file hash: 79652109bacf51beed598aa39dd05b28bd91b9404b2e59b400f1e8cfe5b73ab4
...finished in 0:00:06.196052

--- Validating RPKI ---

Validating RPKI ROAs
297425 raw RKPI ROA files found.
100%|██████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 1190/1190 [01:05<00:00, 18.11it/s]
297425 RKPI ROAs validated and saved to /Users/FJ/projects/python/kartograf/out/1742572800/rpki/rpki_raw.json, file hash: cedd89ae02a148e6ebf820f652eabebbd25fdc59ad29e53804e56522c78173e3
...finished in 0:01:23.441125

--- Parsing RPKI ---

Parsing 297425 ROAs
Result entries written: 599405
Duplicates found: 84714
Invalids found: 2190
Incompletes: 0
Non-ROA files: 0
...finished in 0:00:11.962048

--- Parsing IRR ---

Extracting afrinic.db.gz
Extracting apnic.db.route.gz
Extracting apnic.db.route6.gz
Extracting arin.db.gz
Extracting lacnic.db.gz
Extracting ripe.db.route.gz
Extracting ripe.db.route6.gz
Parsing /Users/FJ/projects/python/kartograf/out/1742572800/irr/lacnic.db
Parsing /Users/FJ/projects/python/kartograf/out/1742572800/irr/ripe.db.route
Parsing /Users/FJ/projects/python/kartograf/out/1742572800/irr/apnic.db.route6
Parsing /Users/FJ/projects/python/kartograf/out/1742572800/irr/apnic.db.route
Parsing /Users/FJ/projects/python/kartograf/out/1742572800/irr/arin.db
Parsing /Users/FJ/projects/python/kartograf/out/1742572800/irr/afrinic.db
Parsing /Users/FJ/projects/python/kartograf/out/1742572800/irr/ripe.db.route6
Found valid, unique entries: 1907812
...finished in 0:00:45.337525

--- Merging RPKI and IRR data ---

Parse base file to dictionary
Parse extra file to Pandas DataFrame
Merging extra prefixes that were not included in the base file.
Finished merging extra prefixes.
Finished filtering! Originally 1907812 entries filtered down to 374079
Merging base file with filtered extra file
...finished in 0:03:10.623430

--- Parsing Routeviews pfx2as ---

Unzipping /Users/FJ/projects/python/kartograf/data/1742572800/collectors/routeviews_pfx2asn_ip4.txt.gz
Formatting /Users/FJ/projects/python/kartograf/out/1742572800/collectors/routeviews_pfx2asn_ip4.txt
Unzipping /Users/FJ/projects/python/kartograf/data/1742572800/collectors/routeviews_pfx2asn_ip6.txt.gz
Formatting /Users/FJ/projects/python/kartograf/out/1742572800/collectors/routeviews_pfx2asn_ip6.txt
Cleaning /Users/FJ/projects/python/kartograf/out/1742572800/collectors/pfx2asn.txt
...finished in 0:00:16.805799

--- Merging Routeviews and base data ---

Parse base file to dictionary
Parse extra file to Pandas DataFrame
Merging extra prefixes that were not included in the base file.
Finished merging extra prefixes.
Finished filtering! Originally 1255173 entries filtered down to 375232
Merging base file with filtered extra file
...finished in 0:02:50.675177

--- Sorting results ---

...finished in 0:00:06.411940

--- Finishing Kartograf ---

The SHA-256 hash of the result file is: 195ca71dcfadfd482539a809d2476ea319a15b2b8fac8f62f376ad00fdd33174
Total runtime: 0:14:59.974235

[freerko]

5d6fa1c75aae3d678dc034461921fdf7dcaa1fdb72adfcb73e0f3a84f63a7104

logs

./run map -w=1742572800 -irr -rv

--- Start Kartograf ---

Kartograf version: 0.4.9
Using rpki-client version 9.4 (recommended).
Coordinated launch mode: Waiting until 1742572800 (2025-03-21 17:00:00 CET) to launch mapping process.
Countdown: 0 second(s)
Starting...
The epoch for this run is: 1742572800 (2025-03-21 16:00:00 UTC, local: 2025-03-21 17:00:00 CET)

--- Fetching RPKI ---

Downloaded TAL for AFRINIC to /Users/macbook/kartograf/data/1742572800/rpki/tals/afrinic.tal, file hash: 2838ef30ea27ce5705abf5f5adb131d8c35b1f50858338a2f3c84bb207c2fa35
Downloaded TAL for APNIC to /Users/macbook/kartograf/data/1742572800/rpki/tals/apnic.tal, file hash: 472e551f7c551c2e999e582b7c9437d3bee4900fe53afff62aeb28d4940ade94
Downloaded TAL for ARIN to /Users/macbook/kartograf/data/1742572800/rpki/tals/arin.tal, file hash: 1f8bdb03bcc30a3b8e11fd9a87102fba250c22137a3c8baa9c81b139cb412639
Downloaded TAL for LACNIC to /Users/macbook/kartograf/data/1742572800/rpki/tals/lacnic.tal, file hash: d44bb9394ab009c8b53e5efebf2a1c9450bab61a27efe00de5a3e4587a3a2f6a
Downloaded TAL for RIPE to /Users/macbook/kartograf/data/1742572800/rpki/tals/ripe.tal, file hash: 59ca27ef93f23682749fcefe7c6d70fbc723343549ff9e4d3996acaff79817fb
Downloading RPKI Data, this may take a while.
Downloaded RPKI Data, hash sum: 69be2971caf8141d7b22a45fcbe8d2f1402b3c41b46c2547adbeeef251f455e3
...finished in 0:04:35.308108

--- Fetching IRR ---

Downloading afrinic.db.gz
Downloaded afrinic.db.gz, file hash: 248c4fcff7e32c4dbecac9b6ba02eb824662331cd16fe42cc5acd60a9049e748
Downloading apnic.db.route.gz
Downloaded apnic.db.route.gz, file hash: 391c11dc3c8f89c7f0b7ff2209e56769c1dad099a6d6740884912eb6d2514514
Downloading apnic.db.route6.gz
Downloaded apnic.db.route6.gz, file hash: 9d3f074f6f9f89fc1b58c145e8eee04993d462e8ebfaec7fdaddb041d4291cdb
Downloading arin.db.gz
Downloaded arin.db.gz, file hash: a3b7ec63c95995470d11c14a3cd16f8679dcd160079190b4a568585bfba86d56
Downloading lacnic.db.gz
Downloaded lacnic.db.gz, file hash: 2d05bf7701b27622bb2da295124f4879f500e8d45933283c2989e808fa0e4cb2
Downloading ripe.db.route.gz
Downloaded ripe.db.route.gz, file hash: ad546d6699ab783ab129d2705ffc9fa5706fe43f09b689ddb9cefd89fd38e4cf
Downloading ripe.db.route6.gz
Downloaded ripe.db.route6.gz, file hash: 7a999e197e17e859749050fc6dea9d385074e82df32089ac2e74ed91eaf20ea0
...finished in 0:01:05.602717

--- Fetching Routeviews pfx2as ---

Downloading from https://publicdata.caida.org/datasets/routing/routeviews-prefix2as/2025/03/routeviews-rv2-20250319-0000.pfx2as.gz
Downloaded /Users/macbook/kartograf/data/1742572800/collectors/routeviews_pfx2asn_ip4.txt.gz, file hash: d339a35aacee76f04ef975e6df713ae339af61d0d6dbab43688d1719972861ec
Downloading from https://publicdata.caida.org/datasets/routing/routeviews6-prefix2as/2025/03/routeviews-rv6-20250320-1200.pfx2as.gz
Downloaded /Users/macbook/kartograf/data/1742572800/collectors/routeviews_pfx2asn_ip6.txt.gz, file hash: 79652109bacf51beed598aa39dd05b28bd91b9404b2e59b400f1e8cfe5b73ab4
...finished in 0:00:07.948847

--- Validating RPKI ---

Validating RPKI ROAs
297429 raw RKPI ROA files found.
100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 1190/1190 [02:24<00:00, 8.21it/s]
297429 RKPI ROAs validated and saved to /Users/macbook/kartograf/out/1742572800/rpki/rpki_raw.json, file hash: 84b6fdf13c9b4b3cf443cdf853f791dd59e77d4d52c60e9bf27ce1d8782d85c7
...finished in 0:02:43.205462

--- Parsing RPKI ---

Parsing 297429 ROAs
Result entries written: 599409
Duplicates found: 84714
Invalids found: 2190
Incompletes: 0
Non-ROA files: 0
...finished in 0:00:13.768271

--- Parsing IRR ---

Extracting afrinic.db.gz
Extracting apnic.db.route.gz
Extracting apnic.db.route6.gz
Extracting arin.db.gz
Extracting lacnic.db.gz
Extracting ripe.db.route.gz
Extracting ripe.db.route6.gz
Parsing /Users/macbook/kartograf/out/1742572800/irr/lacnic.db
Parsing /Users/macbook/kartograf/out/1742572800/irr/ripe.db.route
Parsing /Users/macbook/kartograf/out/1742572800/irr/apnic.db.route6
Parsing /Users/macbook/kartograf/out/1742572800/irr/apnic.db.route
Parsing /Users/macbook/kartograf/out/1742572800/irr/arin.db
Parsing /Users/macbook/kartograf/out/1742572800/irr/afrinic.db
Parsing /Users/macbook/kartograf/out/1742572800/irr/ripe.db.route6
Found valid, unique entries: 1907812
...finished in 0:00:50.995382

--- Merging RPKI and IRR data ---

Parse base file to dictionary
Parse extra file to Pandas DataFrame
Merging extra prefixes that were not included in the base file.
Finished merging extra prefixes.
Finished filtering! Originally 1907812 entries filtered down to 374079
Merging base file with filtered extra file
...finished in 0:03:25.274305

--- Parsing Routeviews pfx2as ---

Unzipping /Users/macbook/kartograf/data/1742572800/collectors/routeviews_pfx2asn_ip4.txt.gz
Formatting /Users/macbook/kartograf/out/1742572800/collectors/routeviews_pfx2asn_ip4.txt
Unzipping /Users/macbook/kartograf/data/1742572800/collectors/routeviews_pfx2asn_ip6.txt.gz
Formatting /Users/macbook/kartograf/out/1742572800/collectors/routeviews_pfx2asn_ip6.txt
Cleaning /Users/macbook/kartograf/out/1742572800/collectors/pfx2asn.txt
...finished in 0:00:19.039319

--- Merging Routeviews and base data ---

Parse base file to dictionary
Parse extra file to Pandas DataFrame
Merging extra prefixes that were not included in the base file.
Finished merging extra prefixes.
Finished filtering! Originally 1255173 entries filtered down to 375222
Merging base file with filtered extra file
...finished in 0:03:10.577151

--- Sorting results ---

...finished in 0:00:07.348829

--- Finishing Kartograf ---

The SHA-256 hash of the result file is: 5d6fa1c75aae3d678dc034461921fdf7dcaa1fdb72adfcb73e0f3a84f63a7104
Total runtime: 0:16:39.964677

[dunxen]

I got ffdc3cab6a17225ee2f85099968e771b84a5c59236fe3cd7964d05cbb2c4e792

Logs

./run map -w=1742572800 -irr -rv

--- Start Kartograf ---

Kartograf version: 0.4.9
Using rpki-client version 9.4 (recommended).
Coordinated launch mode: Waiting until 1742572800 (2025-03-21 18:00:00 SAST) to launch mapping process.
Countdown: 0 second(s)
Starting...
The epoch for this run is: 1742572800 (2025-03-21 16:00:00 UTC, local: 2025-03-21 18:00:00 SAST)

--- Fetching RPKI ---

Downloaded TAL for AFRINIC to /home/dunxen/repos/github.com/asmap/kartograf/data/1742572800/rpki/tals/afrinic.tal, file hash: 2838ef30ea27ce5705abf5f5adb131d8c35b1f50858338a2f3c84bb207c2fa35
Downloaded TAL for APNIC to /home/dunxen/repos/github.com/asmap/kartograf/data/1742572800/rpki/tals/apnic.tal, file hash: 472e551f7c551c2e999e582b7c9437d3bee4900fe53afff62aeb28d4940ade94
Downloaded TAL for ARIN to /home/dunxen/repos/github.com/asmap/kartograf/data/1742572800/rpki/tals/arin.tal, file hash: 1f8bdb03bcc30a3b8e11fd9a87102fba250c22137a3c8baa9c81b139cb412639
Downloaded TAL for LACNIC to /home/dunxen/repos/github.com/asmap/kartograf/data/1742572800/rpki/tals/lacnic.tal, file hash: d44bb9394ab009c8b53e5efebf2a1c9450bab61a27efe00de5a3e4587a3a2f6a
Downloaded TAL for RIPE to /home/dunxen/repos/github.com/asmap/kartograf/data/1742572800/rpki/tals/ripe.tal, file hash: 59ca27ef93f23682749fcefe7c6d70fbc723343549ff9e4d3996acaff79817fb
Downloading RPKI Data, this may take a while.
Downloaded RPKI Data, hash sum: 049e09b0ff9cadb8710f66dffb5cc9147cdec9e2a6347db39b144e8738433e43
...finished in 0:06:40.082360

--- Fetching IRR ---

Downloading afrinic.db.gz
Downloaded afrinic.db.gz, file hash: 248c4fcff7e32c4dbecac9b6ba02eb824662331cd16fe42cc5acd60a9049e748
Downloading apnic.db.route.gz
Downloaded apnic.db.route.gz, file hash: 391c11dc3c8f89c7f0b7ff2209e56769c1dad099a6d6740884912eb6d2514514
Downloading apnic.db.route6.gz
Downloaded apnic.db.route6.gz, file hash: 9d3f074f6f9f89fc1b58c145e8eee04993d462e8ebfaec7fdaddb041d4291cdb
Downloading arin.db.gz
Downloaded arin.db.gz, file hash: a3b7ec63c95995470d11c14a3cd16f8679dcd160079190b4a568585bfba86d56
Downloading lacnic.db.gz
Downloaded lacnic.db.gz, file hash: 2d05bf7701b27622bb2da295124f4879f500e8d45933283c2989e808fa0e4cb2
Downloading ripe.db.route.gz
Downloaded ripe.db.route.gz, file hash: ad546d6699ab783ab129d2705ffc9fa5706fe43f09b689ddb9cefd89fd38e4cf
Downloading ripe.db.route6.gz
Downloaded ripe.db.route6.gz, file hash: 7a999e197e17e859749050fc6dea9d385074e82df32089ac2e74ed91eaf20ea0
...finished in 0:02:30.493463

--- Fetching Routeviews pfx2as ---

Downloading from https://publicdata.caida.org/datasets/routing/routeviews-prefix2as/2025/03/routeviews-rv2-20250319-0000.pfx2as.gz
Downloaded /home/dunxen/repos/github.com/asmap/kartograf/data/1742572800/collectors/routeviews_pfx2asn_ip4.txt.gz, file hash: d339a35aacee76f04ef975e6df713ae339af61d0d6dbab43688d1719972861ec
Downloading from https://publicdata.caida.org/datasets/routing/routeviews6-prefix2as/2025/03/routeviews-rv6-20250320-1200.pfx2as.gz
Downloaded /home/dunxen/repos/github.com/asmap/kartograf/data/1742572800/collectors/routeviews_pfx2asn_ip6.txt.gz, file hash: 79652109bacf51beed598aa39dd05b28bd91b9404b2e59b400f1e8cfe5b73ab4
...finished in 0:00:09.585096

--- Validating RPKI ---

Validating RPKI ROAs
133342 raw RKPI ROA files found.
100%|██████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 534/534 [00:31<00:00, 17.16it/s]
133342 RKPI ROAs validated and saved to /home/dunxen/repos/github.com/asmap/kartograf/out/1742572800/rpki/rpki_raw.json, file hash: a166730f50a3ad1b01643b9ceaa2880dbbb556d990f7c7768d4eb4c4644fd25b
...finished in 0:00:41.963211

--- Parsing RPKI ---

Parsing 133342 ROAs
Result entries written: 443634
Duplicates found: 51158
Invalids found: 3851
Incompletes: 0
Non-ROA files: 0
...finished in 0:00:15.270219

--- Parsing IRR ---

Extracting afrinic.db.gz
Extracting apnic.db.route.gz
Extracting apnic.db.route6.gz
Extracting arin.db.gz
Extracting lacnic.db.gz
Extracting ripe.db.route.gz
Extracting ripe.db.route6.gz
Parsing /home/dunxen/repos/github.com/asmap/kartograf/out/1742572800/irr/afrinic.db
Parsing /home/dunxen/repos/github.com/asmap/kartograf/out/1742572800/irr/apnic.db.route
Parsing /home/dunxen/repos/github.com/asmap/kartograf/out/1742572800/irr/apnic.db.route6
Parsing /home/dunxen/repos/github.com/asmap/kartograf/out/1742572800/irr/arin.db
Parsing /home/dunxen/repos/github.com/asmap/kartograf/out/1742572800/irr/lacnic.db
Parsing /home/dunxen/repos/github.com/asmap/kartograf/out/1742572800/irr/ripe.db.route
Parsing /home/dunxen/repos/github.com/asmap/kartograf/out/1742572800/irr/ripe.db.route6
Found valid, unique entries: 1907812
...finished in 0:01:41.050819

--- Merging RPKI and IRR data ---

Parse base file to dictionary
Parse extra file to Pandas DataFrame
Merging extra prefixes that were not included in the base file.
Finished merging extra prefixes.
Finished filtering! Originally 1907812 entries filtered down to 424229
Merging base file with filtered extra file
...finished in 0:05:09.752658

--- Parsing Routeviews pfx2as ---

Unzipping /home/dunxen/repos/github.com/asmap/kartograf/data/1742572800/collectors/routeviews_pfx2asn_ip4.txt.gz
Formatting /home/dunxen/repos/github.com/asmap/kartograf/out/1742572800/collectors/routeviews_pfx2asn_ip4.txt
Unzipping /home/dunxen/repos/github.com/asmap/kartograf/data/1742572800/collectors/routeviews_pfx2asn_ip6.txt.gz
Formatting /home/dunxen/repos/github.com/asmap/kartograf/out/1742572800/collectors/routeviews_pfx2asn_ip6.txt
Cleaning /home/dunxen/repos/github.com/asmap/kartograf/out/1742572800/collectors/pfx2asn.txt
...finished in 0:00:31.757035

--- Merging Routeviews and base data ---

Parse base file to dictionary
Parse extra file to Pandas DataFrame
Merging extra prefixes that were not included in the base file.
Finished merging extra prefixes.
Finished filtering! Originally 1255173 entries filtered down to 459072
Merging base file with filtered extra file
...finished in 0:04:27.382142

--- Sorting results ---

...finished in 0:00:12.921266

--- Finishing Kartograf ---

The SHA-256 hash of the result file is: ffdc3cab6a17225ee2f85099968e771b84a5c59236fe3cd7964d05cbb2c4e792
Total runtime: 0:22:22.197785

[sr-gi]

5d6fa1c75aae3d678dc034461921fdf7dcaa1fdb72adfcb73e0f3a84f63a7104

logs

./run map -w=1742572800 -irr -rv

--- Start Kartograf ---

Kartograf version: 0.4.9
Using rpki-client version 9.4 (recommended).
Coordinated launch mode: Waiting until 1742572800 (2025-03-21 12:00:00 EDT) to launch mapping process.
Countdown: 0 second(s)
Starting...
The epoch for this run is: 1742572800 (2025-03-21 16:00:00 UTC, local: 2025-03-21 12:00:00 EDT)

--- Fetching RPKI ---

Downloaded TAL for AFRINIC to /Users/sergi/git/kartograf/data/1742572800/rpki/tals/afrinic.tal, file hash: 2838ef30ea27ce5705abf5f5adb131d8c35b1f50858338a2f3c84bb207c2fa35
Downloaded TAL for APNIC to /Users/sergi/git/kartograf/data/1742572800/rpki/tals/apnic.tal, file hash: 472e551f7c551c2e999e582b7c9437d3bee4900fe53afff62aeb28d4940ade94
Downloaded TAL for ARIN to /Users/sergi/git/kartograf/data/1742572800/rpki/tals/arin.tal, file hash: 1f8bdb03bcc30a3b8e11fd9a87102fba250c22137a3c8baa9c81b139cb412639
Downloaded TAL for LACNIC to /Users/sergi/git/kartograf/data/1742572800/rpki/tals/lacnic.tal, file hash: d44bb9394ab009c8b53e5efebf2a1c9450bab61a27efe00de5a3e4587a3a2f6a
Downloaded TAL for RIPE to /Users/sergi/git/kartograf/data/1742572800/rpki/tals/ripe.tal, file hash: 59ca27ef93f23682749fcefe7c6d70fbc723343549ff9e4d3996acaff79817fb
Downloading RPKI Data, this may take a while.
Downloaded RPKI Data, hash sum: e2b23ca975f2bb2105ff8fed0231ad2bf360c2113446f2236947f07d30335557
...finished in 0:05:24.301450

--- Fetching IRR ---

Downloading afrinic.db.gz
Downloaded afrinic.db.gz, file hash: 248c4fcff7e32c4dbecac9b6ba02eb824662331cd16fe42cc5acd60a9049e748
Downloading apnic.db.route.gz
Downloaded apnic.db.route.gz, file hash: 391c11dc3c8f89c7f0b7ff2209e56769c1dad099a6d6740884912eb6d2514514
Downloading apnic.db.route6.gz
Downloaded apnic.db.route6.gz, file hash: 9d3f074f6f9f89fc1b58c145e8eee04993d462e8ebfaec7fdaddb041d4291cdb
Downloading arin.db.gz
Downloaded arin.db.gz, file hash: a3b7ec63c95995470d11c14a3cd16f8679dcd160079190b4a568585bfba86d56
Downloading lacnic.db.gz
Downloaded lacnic.db.gz, file hash: 2d05bf7701b27622bb2da295124f4879f500e8d45933283c2989e808fa0e4cb2
Downloading ripe.db.route.gz
Downloaded ripe.db.route.gz, file hash: ad546d6699ab783ab129d2705ffc9fa5706fe43f09b689ddb9cefd89fd38e4cf
Downloading ripe.db.route6.gz
Downloaded ripe.db.route6.gz, file hash: 7a999e197e17e859749050fc6dea9d385074e82df32089ac2e74ed91eaf20ea0
...finished in 0:00:55.196176

--- Fetching Routeviews pfx2as ---

Downloading from https://publicdata.caida.org/datasets/routing/routeviews-prefix2as/2025/03/routeviews-rv2-20250319-0000.pfx2as.gz
Downloaded /Users/sergi/git/kartograf/data/1742572800/collectors/routeviews_pfx2asn_ip4.txt.gz, file hash: d339a35aacee76f04ef975e6df713ae339af61d0d6dbab43688d1719972861ec
Downloading from https://publicdata.caida.org/datasets/routing/routeviews6-prefix2as/2025/03/routeviews-rv6-20250320-1200.pfx2as.gz
Downloaded /Users/sergi/git/kartograf/data/1742572800/collectors/routeviews_pfx2asn_ip6.txt.gz, file hash: 79652109bacf51beed598aa39dd05b28bd91b9404b2e59b400f1e8cfe5b73ab4
...finished in 0:00:41.162133

--- Validating RPKI ---

Validating RPKI ROAs
297427 raw RKPI ROA files found.
100%|██████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 1190/1190 [01:10<00:00, 16.85it/s]
297427 RKPI ROAs validated and saved to /Users/sergi/git/kartograf/out/1742572800/rpki/rpki_raw.json, file hash: 433837bc20804581692aa394e3174ad91dbea8c9df1bc737031c750701377c87
...finished in 0:01:25.436695

--- Parsing RPKI ---

Parsing 297427 ROAs
Result entries written: 599409
Duplicates found: 84714
Invalids found: 2188
Incompletes: 0
Non-ROA files: 0
...finished in 0:00:13.875883

--- Parsing IRR ---

Extracting afrinic.db.gz
Extracting apnic.db.route.gz
Extracting apnic.db.route6.gz
Extracting arin.db.gz
Extracting lacnic.db.gz
Extracting ripe.db.route.gz
Extracting ripe.db.route6.gz
Parsing /Users/sergi/git/kartograf/out/1742572800/irr/lacnic.db
Parsing /Users/sergi/git/kartograf/out/1742572800/irr/ripe.db.route
Parsing /Users/sergi/git/kartograf/out/1742572800/irr/apnic.db.route6
Parsing /Users/sergi/git/kartograf/out/1742572800/irr/apnic.db.route
Parsing /Users/sergi/git/kartograf/out/1742572800/irr/arin.db
Parsing /Users/sergi/git/kartograf/out/1742572800/irr/afrinic.db
Parsing /Users/sergi/git/kartograf/out/1742572800/irr/ripe.db.route6
Found valid, unique entries: 1907812
...finished in 0:00:51.283268

--- Merging RPKI and IRR data ---

Parse base file to dictionary
Parse extra file to Pandas DataFrame
Merging extra prefixes that were not included in the base file.
Finished merging extra prefixes.
Finished filtering! Originally 1907812 entries filtered down to 374079
Merging base file with filtered extra file
...finished in 0:03:22.220157

--- Parsing Routeviews pfx2as ---

Unzipping /Users/sergi/git/kartograf/data/1742572800/collectors/routeviews_pfx2asn_ip4.txt.gz
Formatting /Users/sergi/git/kartograf/out/1742572800/collectors/routeviews_pfx2asn_ip4.txt
Unzipping /Users/sergi/git/kartograf/data/1742572800/collectors/routeviews_pfx2asn_ip6.txt.gz
Formatting /Users/sergi/git/kartograf/out/1742572800/collectors/routeviews_pfx2asn_ip6.txt
Cleaning /Users/sergi/git/kartograf/out/1742572800/collectors/pfx2asn.txt
...finished in 0:00:19.391060

--- Merging Routeviews and base data ---

Parse base file to dictionary
Parse extra file to Pandas DataFrame
Merging extra prefixes that were not included in the base file.
Finished merging extra prefixes.
Finished filtering! Originally 1255173 entries filtered down to 375222
Merging base file with filtered extra file
...finished in 0:03:06.663555

--- Sorting results ---

...finished in 0:00:07.368024

--- Finishing Kartograf ---

The SHA-256 hash of the result file is: 5d6fa1c75aae3d678dc034461921fdf7dcaa1fdb72adfcb73e0f3a84f63a7104
Total runtime: 0:16:29.938212

[fjahr]

Unfortunately, after the run finished, I did somehow typed something odd that lost all the terminal output at the end :/

You can re-run it with ./run map -r /YOUR_KARTOGRAF_DIR/data/1742572800 -t 1742572800 , that is taking the data you have already downloaded and rerun s the process