Skip to content

[ai-projects] Self-contain 4 trace-based eval samples #47322

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
aprilk-ms wants to merge 6 commits into
base: main
Choose a base branch
from
Draft

[ai-projects] Self-contain 4 trace-based eval samples #47322

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
6 commits
Select commit Hold shift + click to select a range
b4580ad
[ai-projects] Self-contain sample_multiturn_trace_evaluation_by_id
aprilk-ms Jun 3, 2026
f0b2269
[ai-projects] Self-contain sample_multiturn_trace_evaluation_agent_fi…
aprilk-ms Jun 3, 2026
f630dde
[ai-projects] Self-contain sample_agent_trace_evaluation_smart_filter
aprilk-ms Jun 3, 2026
ec60ce0
[ai-projects] Self-contain sample_evaluations_builtin_with_traces
aprilk-ms Jun 3, 2026
9c5886a
[ai-projects] CHANGELOG: note self-contained trace eval samples
aprilk-ms Jun 3, 2026
417b927
[ai-projects] Update stale skip reason for builtin_with_traces sample
aprilk-ms Jun 3, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions sdk/ai/azure-ai-projects/CHANGELOG.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -8,6 +8,7 @@
* Added `sample_routines_with_timer_trigger.py` to demonstrate triggering a routine with a timer.
* Added `sample_routines_with_schedule_trigger.py` to demonstrate triggering a routine on a recurring cron schedule via `ScheduleRoutineTrigger`.
* Updated `sample_dataset_generation_job_traces_for_evaluation.py` and `sample_dataset_generation_job_traces_for_finetuning.py` to create a temporary agent, seed conversations, retry the data generation job over the trace window, and clean up all created resources.
* Updated `sample_multiturn_trace_evaluation_by_id.py`, `sample_multiturn_trace_evaluation_agent_filter.py`, `sample_agent_trace_evaluation_smart_filter.py`, and `sample_evaluations_builtin_with_traces.py` to be self-contained: each sample now creates a temporary agent, seeds conversations, waits for App Insights ingestion, retries the eval over the trace window, and cleans up all created resources (no `FOUNDRY_AGENT_NAME`, `APPINSIGHTS_RESOURCE_ID`, or `AGENT_ID` environment variables required).
* Updated `sample_memory_crud.py` and `sample_memory_crud_async.py` to demonstrate memory item CRUD (`create_memory`, `get_memory`, `update_memory`, `list_memories`, `delete_memory`) in addition to memory store CRUD.

## 2.2.0 (2026-05-29)
Expand Down
Loading
Loading