Skip to content

Add production Task lifecycle check command - #531

Draft
ChinmayK0607 wants to merge 7 commits into
mainfrom
chinmay/hud-task-check
Draft

Add production Task lifecycle check command#531
ChinmayK0607 wants to merge 7 commits into
mainfrom
chinmay/hud-task-check

Conversation

@ChinmayK0607

Copy link
Copy Markdown
Contributor

Why

Authors need a fast way to catch environment startup, Task setup, and grader integration failures before paying for a full rollout. hud check --start-only stops after a cheap smoke test, and direct-answer mode exercises the grader without model inference. Agent mode remains available when full behavior is required.

What changed

  • add hud check <task> with explicit start-only, direct-answer, and agent proof strategies
  • support local sources, attached environments, HUD runtimes, and hosted execution
  • report environment startup, Task startup, agent execution, grader execution, and reward separately
  • emit a stable hud.task-check.v1 JSON contract and actionable exit codes
  • redact and bound evidence, attribute lifecycle failures, and clean up unfinished direct sessions
  • share Task resolution and placement logic with the existing hud task commands

Dependency

Stacked on #530 because hosted checks use its control-channel stability and connection-phase attribution.

Test plan

  • uv run --extra dev pytest hud/cli/tests/test_check.py -q (25 passed)
  • Ruff
  • Pyright
  • local Task lifecycle and attached-environment integration coverage

Made with Cursor

Comment thread hud/cli/check.py Outdated
@jdchawla29
jdchawla29 dismissed their stale review August 6, 2026 03:22

Submitted unintentionally; withdrawing this review.

@jdchawla29
jdchawla29 force-pushed the chinmay/control-channel-keepalive branch 2 times, most recently from 5ef4cd7 to a9fd7ee Compare August 6, 2026 06:25
@ChinmayK0607
ChinmayK0607 force-pushed the chinmay/hud-task-check branch from fd7e066 to 3b46fe5 Compare August 6, 2026 06:48
@ChinmayK0607
ChinmayK0607 changed the base branch from chinmay/control-channel-keepalive to main August 6, 2026 06:48
Comment thread hud/cli/check.py
@ChinmayK0607
ChinmayK0607 force-pushed the chinmay/hud-task-check branch from 09ff8cb to a896a5e Compare August 6, 2026 18:40
Comment thread hud/cli/check.py
Comment thread hud/cli/check.py
ChinmayK0607 and others added 5 commits August 7, 2026 00:26
Provide stable local, attached, HUD, and hosted Task checks by composing existing start, grade, rollout, and runtime primitives with explicit proof and exit contracts.

Co-authored-by: Cursor <cursoragent@cursor.com>
Cancel live task sessions when start-only checks or grading failures leave them unfinished.

Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
@ChinmayK0607
ChinmayK0607 force-pushed the chinmay/hud-task-check branch from a896a5e to 804fe8e Compare August 6, 2026 18:56
Co-authored-by: Cursor <cursoragent@cursor.com>

@cursor cursor Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Cursor Bugbot has reviewed your changes using default effort and found 1 potential issue.

Fix All in Cursor

❌ Bugbot Autofix is OFF. To automatically fix reported issues with cloud agents, enable autofix in the Cursor dashboard.

Reviewed by Cursor Bugbot for commit 09026ad. Configure here.

Comment thread hud/cli/check.py
@jdchawla29
jdchawla29 marked this pull request as draft August 7, 2026 07:19
Map the rollout's actual cleanup phase to grader execution so task check reports identify the failing lifecycle step correctly.

Co-authored-by: Cursor <cursoragent@cursor.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants