Agentic CI: Issue & PR Triage Tracker

[andreatgretel]

This issue collects weekly triage reports generated by the Agentic CI: Repository Triage workflow.

Each Monday at 10:00 UTC the workflow scans open issues and PRs, classifies them, detects staleness and duplicates, and posts a summary as a comment below.

[github-actions]

Repository Triage Report — 2026-05-18

Open issues: 50 | Open PRs: 20 | Healthy (no action needed): 28

---

Close as resolved (0)

None — no merged PRs reference any currently open issue with Closes/Fixes/Resolves.

Close as duplicate (0)

None — no obvious duplicate issues among the open set.

Needs maintainer decision (3)

#	Title	Action	Evidence	Rationale
#182	Improve validation in structured generation columns	Decide direction	enhancement,needs-discussion, 107d no activity	Long-stalled with no consensus; either trim scope or close
#160	Support Scaling Data Designer on SLURM	Decide direction	enhancement,on-roadmap,needs-discussion, 144d no activity	On roadmap but no concrete plan; assignees set but quiet
#352	Ability to control order of multi-modal context along with prompts	Decide direction	enhancement,on-roadmap,needs-discussion, 83d no activity	On roadmap but mechanism unspecified; relates to #668/#671 multimodal work

Ready for assignment (24)

Standalone, well-scoped:

#	Title	Action	Evidence	Rationale
#659	uv tool update removes DataDesigner plugin installs	Assign	bug, no assignee, recent	Reproducible install bug; clear scope
#620	ChatCompletionResponse lost .choices and ChatCompletionRequest lost n field	Assign	bug, no assignee	Regression with concrete API surface to restore
#619	Push Data Designer datasets to Harbor Hub	Assign	enhancement, no assignee	Distinct integration with clear destination
#607	Preserve multimodal MCP tool-call results through model provider adapters	Assign	task, no assignee	Adapter-layer change with specific provider list
#601	tests: cover structural_impact.py pure helpers	Assign	task, no assignee	Pure-helper test additions; small contained PR
#573	Concrete schemas for all nemotron-personas datasets	Assign	task, no assignee	Schema authoring per dataset; parallelizable
#569	Schema validation rejects small-model output before coercion can normalize	Assign	No labels, no assignee	Ordering bug in coerce/validate pipeline
#563	Skill: auto-port custom columns to plugin packages	Assign	enhancement, no assignee	Skill authoring task with documented plugin pattern
#559	Support system-level RunConfig defaults in ~/.data-designer	Assign	enhancement, 30d	Concrete config-resolution feature, fresh enough to pick up
#637	Split docs preview build and deploy workflows	Assign	documentation,task, no assignee	Workflow split with clear before/after
#411	Improve record failure logging for max_tokens-truncated parse failures	Assign	No labels, 65d	Logging-only improvement; trivial scope despite age
#629	Cryptic "User provided prompt generation template is invalid" error	Active in PR #633	already linked	(Listed for context — PR #633 closes this)

Async scheduling epic #645 sub-tasks (no assignees):

#	Title	Action	Evidence	Rationale
#635	Instrument request admission AIMD state for OpenTelemetry	Assign	plan,task, part of #645	Observability shim, well-scoped
#641	Add opt-in SchedulingMetadata for generator resource scheduling	Assign	enhancement,plan,task	Metadata API addition, foundational for epic
#644	Implement TaskAdmissionController lease boundary	Assign	plan,task	In-flight in PR #661 — verify linkage; otherwise assign
#646	Ingest SchedulingMetadata into async scheduler grouping	Assign	plan,task	Sequenced after #641
#647	Add scheduler admission event sink and snapshots	Assign	plan,task	Observability scaffolding
#648	Correlate scheduler admission and request admission observability	Assign	plan,task	Sequenced after #635/#647
#649	Build async scheduling benchmark harness	Assign	plan,task	Independent of admission policy work
#650	Add bounded-borrow admission policy for heavy-root async workloads	Assign	plan,task	Discrete policy implementation
#651	Design resource-vector and provider-aware admission policies	Assign	spike,plan,task	Spike — short investigation deliverable
#652	Document SchedulingMetadata for generator and plugin authors	Assign	documentation,plan,task	Docs follow-up to #641
#653	Remove legacy SchedulingHintResolver after SchedulingMetadata ingestion	Assign	plan,task	Cleanup once #646 lands
#654	Implement async capacity model and runtime snapshots	Assign	documentation,plan,task	Capacity-model deliverable
#657	Refactor model-call request control into RequestAdmissionController	Assign	plan,task	Refactor with clear extraction boundary
#660	Document async scheduling architecture, capacity, and operations	Assign	plan,task	Architecture doc once subsystem stabilizes

Stuck PR (6)

#	Title	Action	Evidence	Rationale
#640	chore(agentic-ci): add future annotations import to dataset_metadata.py	Re-run / close	2 failing checks, 4d	Auto-generated agentic-ci PR; failing checks block merge
#613	[POC] Add Data Designer recipe discovery	Resolve failures	4 failing checks, layered on #612	POC blocked behind #612; cannot land until #612 stabilizes
#612	[POC] Support Python workflow args in CLI	Resolve failures	4 failing checks, references #507	POC for #507; failing checks need attention
#446	feat: agentic workflow plan generation in trace distillation recipe	Nudge author or close	55d since update	No author activity for 8+ weeks
#389	docs: Add llms.txt and llms-full.txt for AI discoverability	Nudge author or close	66d since update	External contributor PR with no recent activity
#351	docs: add prompt sensitivity devnote	Nudge author or close	66d since update	No author activity for 9+ weeks

Duplicate PRs (0)

None — each linked issue has at most one open PR.

Stale, consider closing (6)

#	Title	Action	Evidence	Rationale
#413	chore: regenerate only changed colab notebooks in CI	Close with note	chore, 61d, no assignee	CI optimization with no traction
#400	Enable non-existent tool fallback with MCP server	Close with note	enhancement, 66d, no assignee	Single comment, no follow-up
#394	Jinja2 templates cannot reference columns created by PRE_BATCH processors	Close or fix	bug, 67d, no assignee	Genuine bug but stalled — decide fix vs close
#388	configure_logging() called before DataDesigner() is silently overwritten	Close or fix	bug, 40d, no assignee	Init-ordering bug stalled with no owner
#386	Add structured metadata to log records for programmatic consumption	Close with note	enhancement, 37d, no assignee	Companion to #503; bundle or close
#503	Add request/response logging hook to native model client	Close with note	enhancement, 37d, no assignee	Logging hook proposal without traction
#362	Allow user to keep record fields that failed to parse as null	Close with note	enhancement, 69d, no assignee	Behavior change with no design follow-up
#354	Add other common params to ChatCompletionInferenceParams	Close with note	enhancement, 80d, no assignee	Param-additions request without prioritized list
#246	Update health-checks to account for multi-modality	Close with note	enhancement, 94d, no assignee	Stalled; revisit when #668/#671 multimodal lands
#447	refactor: introduce AsyncRunController and explicit sinks	Close or restart	refactor, 53d, assigned but quiet	Predates async-default merge (#592); may already be moot

Repeatedly-failed fix attempts (0)

No daily-suite runner-state files available in this triage run; section omitted.

---

Healthy items (10 issues, 14 PRs)

Issues:

• Implement audio and video context support #671 Implement audio and video context support — nabinchha — 2026-05-15 (assigned)
• Plan audio and video context support #668 Plan audio and video context support — nabinchha — 2026-05-15 (linked PR docs: plan audio/video context support #669)
• Track reasoning token counts separately from output tokens #665 Track reasoning token counts separately — nabinchha — 2026-05-15 (assigned, linked PR feat: track reasoning token usage #670)
• Expose on_batch_complete through high-level interface #662 Expose on_batch_complete through high-level interface — mikeknep — 2026-05-15 (linked PR feat: Expose on_batch_complete via create method #663)
• Epic: Async Scheduling Resource Metadata, Admission, and Observability #645 Epic: Async Scheduling — eric-tramel — 2026-05-14 (assigned, parent of sub-tasks listed above)
• Cryptic "User provided prompt generation template is invalid" error when a referenced template field is empty or missing #629 Cryptic Jinja error — nabinchha — 2026-05-09 (assigned, linked PR fix(engine): actionable error when a Jinja field is missing/None/empty #633)
• refactor: remove ModelProviderRegistry.default and require ModelConfig.provider #590 refactor: remove ModelProviderRegistry.default — nabinchha — 2026-04-30 (linked PR refactor: remove ModelProviderRegistry.default and require ModelConfig.provider #625; needs-discussion noted)
• feat: support custom CLI args for Python config modules #507 feat: custom CLI args for Python config modules — eric-tramel — 2026-05-07 (linked POC PR [POC] Support Python workflow args in CLI #612)
• Add more stages to processors, and allow for custom processors via callbacks #159 Add more stages to processors — andreatgretel — 2026-03-02 (assigned)
• Support more types of Model Providers like VertexAI and Bedrock #92 Support more types of Model Providers — nabinchha — 2026-01-30 (assigned)
• Batch-level error rates for early shutdown #211 Batch-level error rates for early shutdown — johnnygreco — 2026-04-30 (active discussion, on-roadmap)
• Agentic CI: Issue & PR Triage Tracker #562 Tracking issue (this issue)

PRs:

• feat: track reasoning token usage #670 feat: track reasoning token usage — nabinchha — 2026-05-15
• docs: plan audio/video context support #669 docs: plan audio/video context support — nabinchha — 2026-05-15
• docs: add retriever SDG toolkit dev note #666 docs: add retriever SDG toolkit dev note — shan-nvidia — 2026-05-15
• ci: bump the all-actions group across 1 directory with 2 updates #664 ci: bump the all-actions group — dependabot — 2026-05-15
• feat: Expose on_batch_complete via create method #663 feat: Expose on_batch_complete via create method — mikeknep — 2026-05-15
• feat: implement async scheduling admission control #661 feat: implement async scheduling admission control — eric-tramel — 2026-05-14
• docs: add async scheduling epic plan #658 docs: add async scheduling epic plan — eric-tramel — 2026-05-14
• fix(ci): trust generated Agentic CI PRs #643 fix(ci): trust generated Agentic CI PRs — andreatgretel — 2026-05-14
• feat: add workflow chaining #636 feat: add workflow chaining — andreatgretel — 2026-05-15
• fix(engine): actionable error when a Jinja field is missing/None/empty #633 fix(engine): actionable error when a Jinja field is missing/None/empty — nabinchha — 2026-05-12
• fix(ci): improve Agentic CI daily audit reliability #632 fix(ci): improve Agentic CI daily audit reliability — andreatgretel — 2026-05-14
• refactor: remove ModelProviderRegistry.default and require ModelConfig.provider #625 refactor: remove ModelProviderRegistry.default — nabinchha — 2026-05-11
• docs(devnotes): add Nemotron-Personas dev note #611 docs(devnotes): add Nemotron-Personas dev note — 3mei — 2026-05-11
• docs: add Nemotron Nano recipes (structured data, prompt sensitivity, infinibyte) #544 docs: add Nemotron Nano recipes — dhruvnathawani — 2026-05-05 (12d, approaching staleness threshold)

Summary

• 39 items flagged for action across 5 buckets (3 decision, 24 ready, 6 stuck PRs, 6 stale issues — plus 4 stale-issue extras listed in that table).
• 6 PRs flagged (all stuck: 3 with failing checks, 3 quiet for 8+ weeks).
• 24 healthy items collapsed above.
• The single largest signal is the 14-task async scheduling epic (Epic: Async Scheduling Resource Metadata, Admission, and Observability #645) with no assignees on sub-tasks — most can be parallelized once the scheduler refactor lands.