Prepare for pytest 7 deprecations

[bluetech]

Pytest 7 (not released yet when I'm writing this) will contain some deprecations mostly around py.path -> pathlib. We should make sure pytest-xdist doesn't use any deprecated functionality when running on pytest 7. This also includes the test suite.