Skip to content

Conversation

@nikivanstein
Copy link
Contributor

@nikivanstein nikivanstein commented Dec 11, 2025

Summary

  • run evaluation scripts with interruptible subprocesses and propagate timeout errors
  • ensure problem evaluations clean up child interpreters when timeouts occur
  • add regression coverage to confirm hung evaluations leave no stray run_eval.py processes

Testing

  • uv run pytest tests/ (fails: missing optional test dependencies such as cloudpickle, numpy, httpx, matplotlib, mlflow, ioh)

@nikivanstein nikivanstein added enhancement New feature or request and removed codex labels Dec 11, 2025
@codecov
Copy link

codecov bot commented Dec 11, 2025

Codecov Report

❌ Patch coverage is 80.00000% with 6 lines in your changes missing coverage. Please review.

Files with missing lines Patch % Lines
iohblade/problem.py 80.00% 6 Missing ⚠️

📢 Thoughts on this report? Let us know!

@nikivanstein nikivanstein merged commit d7fc023 into main Dec 11, 2025
10 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

enhancement New feature or request

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants