Use Pathlib rather than os.path.*

[symroe]

As per #389

We mostly use Pathlib for things, but there is at least one place we're not.