Once we use pooch/huggingface this is not a big deal. Just need to add the appropriate directory to the github actions cache.