Skip to content

Improve automation run observability and LLM preflight#220

Open
all-hands-bot wants to merge 2 commits into
mainfrom
automation-run-observability
Open

Improve automation run observability and LLM preflight#220
all-hands-bot wants to merge 2 commits into
mainfrom
automation-run-observability

Conversation

@all-hands-bot

@all-hands-bot all-hands-bot commented Jun 28, 2026

Copy link
Copy Markdown
Contributor

Summary

  • Persist a run's conversation ID as soon as preset automations create the RemoteConversation, so activity logs can link to running or watchdog-failed conversations.
  • Pass the effective automation timeout into preset scripts and use a shorter conversation.run(timeout=...) deadline so failures can callback before the outer bash command is killed.

This change was requested by @neubig.

Testing

  • uv run pytest tests/test_preset_router.py -q - 58 passed, 26 skipped
  • uv run ruff check openhands/automation/router.py openhands/automation/schemas.py openhands/automation/dispatcher.py tests/test_preset_router.py tests/test_router.py
  • uv run pytest tests/test_preset_router.py tests/test_router.py -q could not complete in this sandbox because tests/test_router.py requires Docker/testcontainers and no Docker socket is available.

This PR was created by an AI agent (OpenHands) on behalf of the user.

Co-authored-by: openhands <openhands@all-hands.dev>
@github-actions

github-actions Bot commented Jun 28, 2026

Copy link
Copy Markdown
Contributor

Coverage

Co-authored-by: openhands <openhands@all-hands.dev>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants