unidist 0.4.0

This release makes MPI the default backend, includes new features and
important documentation updates for it, as well as contains a bunch of bugfixes.

Key Features and Updates

• Stability and Bugfixes
  • FIX-#275: Pass python flags into workers (#276)
  • FIX-#281: Do not shutdown MPI backend multiple times (#282)
  • FIX-#283: Exit monitor and worker processes in SPMD mode (#284)
  • FIX-#294: Fix MPI backend launch for Open MPI in a cluster (#295)
  • FIX-#242: Fix behavior of unidist.wait for MPI backend (#291)
  • FIX-#000: Add licence header to request_store.py (#307)
  • FIX-#296: Make workers exit the loop correctly (#312)
  • FIX-#318: Do not initialize MPI in serialization.py (#319)
  • FIX-#320: Improve CI (#321)
  • FIX-#322: Disable actor tests for Ray (#323)
  • FIX-#324: Pin pydantic<2 to fix CI (#325)
  • FIX-#326: Set I_MPI_SPAWN for Intel MPI when using dynamic spawn (#327)
• Performance enhancements
  • PERF-#287: Optimize python list appends (#290)
• New Features
  • FEAT-#288: Make MPI as default backend (#293)
  • FEAT-#305: Introduce MpiBackoff configuration value (#306)
  • FEAT-#316: Introduce MpiLog configuration value (#317)
• Refactor Codebase
  • REFACTOR-#000: Refactor request store to make it clearer (#311)
• Documentation improvements
  • DOCS-#000: Clarify the phrases regarding pyseq backend (#272)
  • DOCS-#277: Add notes regarding installation of MPI implementations (#278)
  • DOCS-#279: Advise original MPI binaries rather than conda-forge packages (#280)
  • DOCS-#299: Extend troubleshooting page as to MPI errors (#300)
  • DOCS-#301: Add Optimization Notes section to the docs (#302)
  • DOCS-#303: Fix a typo in unidist_on_mpi.rst (#304)
  • DOCS-#314: Add troubleshooting block for 'OpenSSL version mismatch' error (#315)

Contributors

@YarShev
@Retribution98
@arunjose696
@luweizheng