Use pytest-rerunfailures for flaky tests

[mathbunnyru]

Describe your changes

Issue ticket if applicable

Checklist (especially for first-time contributors)

• I have performed a self-review of my code
• If it is a core feature, I have added thorough tests
• I will try not to use force-push to make the review process easier for reviewers
• I have updated the documentation for significant changes

[mathbunnyru]

There is an official plugin for flaky tests, so let's use it!
https://github.com/pytest-dev/pytest-rerunfailures/tree/master