sdk-v2.0.0,otel-v1.0.0

[yaythomas]

aws-durable-execution-sdk-python v2.0.0

This is a major release. It contains breaking changes. If you are upgrading from 1.x, read the 1.x to 2.0 migration guide. The guide covers every breaking change below with before and after code.

Breaking Changes

• Typed per-operation error hierarchy; CallableRuntimeError, UserlandError, CallableRuntimeErrorSerializableDetails removed (136976d, feat(errors): typed per-operation error hierarchy #540)
• Graded callback errors; CallbackError out of the termination tree (c089f9f, feat(errors): Add graded callback error types #563)
• Serdes failures raise SerDesError instead of ExecutionError; first-run serialize/deserialize round trip for step, child contexts, map/parallel, and wait_for_condition; RetryableSerDesError added (d527f19 fix(step): Return round-tripped result on first run #543, caa57ad fix: round-trip serdes result on first run across ops #550)
• map/parallel: max_concurrency bounds in-flight branches, config validation at construction and call time, all_completed() now tolerates all failures, BatchResult.all omits never-started branches, summary payloads use an SDK-owned envelope (fdc952b)
• Replay validates operation identity (type, sub_type, name, parent_id); mismatches raise NonDeterministicExecutionError (38d94dc, fix(core): validate replay operation identity #698)
• wait_for_condition raises WaitForConditionError on exhaustion; WaitDecision and WaitStrategyConfig.timeout removed (e77a53e)
• wait_for_condition fails on unreadable polling state instead of restarting from initial_state (c183ec8)
• InvokeConfig.timeout / timeout_seconds removed (a982efa, fix: remove timeout from Invoke Config #340)
• Removed 1.x-only names: ItemBatcher, ItemsPerBatchUnit, BatchedInput, TerminationMode, StepFuture, MapConfig.item_batcher, ChildConfig.item_serdes, ChainedInvoke* enums (6a89b70)

Features

• should_complete custom completion predicate for map/parallel, with complete_batch/continue_batch, CompletionOutcome, CompletionStatus, and BatchCompletionError (d4090f1, feat: add should_complete to CompletionConfig #605)
• attempt exposed on StepContext and WaitForConditionCheckContext (6aa6a02, feat: expose operation attempt in contexts #549)
• Plugin auto-discovery and PluginLoadError (808e9a8, feat: auto-discover instrumentation plugins #620); plugin interface stabilization (c93073f, feat(plugin): stabilize plugin interface and otel package #625) — interface remains experimental

Bug Fixes

• Empty-string payloads preserved when serializing (b448f3e, fix: keep empty string payloads when serializing #555)
• Orphan checkpoint race rejected (ae73e73, fix: reject orphan checkpoint race #690)
• Missing checkpoint token from service handled (432cf07, fix: handle missing checkpoint token from service #571)

Docs

• 1.x to 2.0 migration guide

aws-durable-execution-sdk-python-otel v1.0.0

First stable release of the OpenTelemetry plugin, built for SDK 2.0. Requires aws-durable-execution-sdk-python>=2.0.0.

Documentation: OpenTelemetry plugin and plugin interface.

Changes since 0.3.0

• OpenTelemetry dependencies come from the Lambda layer instead of being pinned by this package; use the [standalone] extra outside layers (fix(otel): rely on Lambda layers for OpenTelemetry dependencies #651). OpenTelemetry upper bounds removed (fix(otel): remove OpenTelemetry upper bounds #609)
• OtelPluginConfig is fully enum-driven (feat(otel): fully enum-driven OtelPluginConfig #612); instrumentation enums decoupled from the Lambda service (feat(plugin): decouple instrumentation enums from lambda service #634)
• faas/cloud attributes dropped from the invocation span (feat(otel): drop faas/cloud attrs from invocation span #596)

Features

• ExecutionOtelPlugin with a Workflow-rooted trace hierarchy (feat(otel): add ExecutionOtelPlugin with Workflow-rooted trace hierarchy #576) and a Workflow span on InvocationOtelPlugin (feat(otel): add Workflow span to InvocationOtelPlugin #593)
• Shared execution trace: durable spans parent to one canonical trace across invocations, with sampling coordination and a trace-context resolver (ee22f2b, 9052f35, b29edad)
• Incomplete user function outcomes reported to plugins (feat(plugin): report incomplete user function outcomes #661); execution_start_time on invocation info (feat(plugin)!: add execution_start_time to invocation info #561)

Bug Fixes

• Recording spans ended on non-terminal invocations (fix(otel): end recording spans on non-terminal #696)
• Balanced OTel context attach and detach, and scope release on operation re-entry (6050f42, ecdf6ed); child spans closed before parent contexts (fix(otel): close child spans before parent contexts #598)
• Deterministic span IDs scoped per plugin tracer, generator reuse fixed (fix(otel): scope deterministic IDs to plugin tracers #646, fix(otel): reuse deterministic ID generator #602)
• Span status corrections: RETRY maps to UNSET, workflow spans INTERNAL (fix(otel): RETRY->UNSET status, workflow INTERNAL #592); operation status spans aligned (fix(otel): align operation status spans #604); invocation span metadata set (fix(otel): set invocation span metadata #577); retried operation start spans preserved (fix(otel): preserve retried operation start spans #568); continuation span start time fixed (fix(otel): fix continuation span start time #542)
• Cross-language plugin differences aligned (fix(otel): fix cross language otel plugin differences #584); dependencies aligned with the ADOT layer (fix(otel): align dependencies with ADOT layer #545)

What's Changed

• ci: add log retention to example Lambdas by @zhongkechen in ci: add log retention to example Lambdas #528
• feat(testing): per-execution worker serialization by @yaythomas in feat(testing): per-execution worker serialization #516
• chore(deps): bump the actions-deps group with 2 updates by @dependabot[bot] in chore(deps): bump the actions-deps group with 2 updates #529
• ci: prevent script injection in commit lint by @zhongkechen in ci: prevent script injection in commit lint #535
• fix: remove timeout from Invoke Config by @AdityaAudi in fix: remove timeout from Invoke Config #340
• docs: slim AGENTS.md to defer to the developer guide by @yaythomas in docs: slim AGENTS.md to defer to the developer guide #538
• feat(testing): add skip-time virtual clock by @yaythomas in feat(testing): add skip-time virtual clock #523
• fix(otel): align dependencies with ADOT layer by @zhongkechen in fix(otel): align dependencies with ADOT layer #545
• fix(otel): fix continuation span start time by @nvasiu in fix(otel): fix continuation span start time #542
• test: retry incomplete X-Ray traces by @zhongkechen in test: retry incomplete X-Ray traces #548
• ci: pin GitHub Actions to commits by @zhongkechen in ci: pin GitHub Actions to commits #547
• fix(step): Return round-tripped result on first run by @ayushiahjolia in fix(step): Return round-tripped result on first run #543
• feat: expose operation attempt in contexts by @zhongkechen in feat: expose operation attempt in contexts #549
• chore(deps): bump the actions-deps group with 4 updates by @dependabot[bot] in chore(deps): bump the actions-deps group with 4 updates #553
• ci: scope OIDC permissions to jobs by @zhongkechen in ci: scope OIDC permissions to jobs #551
• feat: add Python conformance test package by @wangyb-A in feat: add Python conformance test package #556
• fix: keep empty string payloads when serializing by @nvasiu in fix: keep empty string payloads when serializing #555
• fix(plugin): set OperationStartInfo start_time from operation by @nvasiu in fix(plugin): set OperationStartInfo start_time from operation #559
• ci: run conformance tests on main SDK package changes by @wangyb-A in ci: run conformance tests on main SDK package changes #558
• feat(errors): typed per-operation error hierarchy by @ayushiahjolia in feat(errors): typed per-operation error hierarchy #540
• feat(plugin)!: add execution_start_time to invocation info by @nvasiu in feat(plugin)!: add execution_start_time to invocation info #561
• feat: add callback, invoke, wait_for_callback conformance suites by @wangyb-A in feat: add callback, invoke, wait_for_callback conformance suites #562
• feat: add four more conformance suites by @wangyb-A in feat: add four more conformance suites #566
• fix(plugin): make InvocationEndInfo status required by @nvasiu in fix(plugin): make InvocationEndInfo status required #567
• test: add parallel and map early-stop cases by @wangyb-A in test: add parallel and map early-stop cases #569
• test: add child custom-serdes case (3-14) by @wangyb-A in test: add child custom-serdes case (3-14) #570
• feat(errors): Add graded callback error types by @ayushiahjolia in feat(errors): Add graded callback error types #563
• fix(otel): preserve retried operation start spans by @zhongkechen in fix(otel): preserve retried operation start spans #568
• test: add wait-strategy cases (6-5, 6-6) by @wangyb-A in test: add wait-strategy cases (6-5, 6-6) #572
• fix(waits): repair strategy, fail on exhaustion by @AdityaAudi in fix(waits): repair strategy, fail on exhaustion #541
• fix: fail invalid polling state by @Sanjays2402 in fix: fail invalid polling state #575
• fix(otel): set invocation span metadata by @zhongkechen in fix(otel): set invocation span metadata #577
• refactor(config): remove unused config types by @ayushiahjolia in refactor(config): remove unused config types #579
• fix(plugin): order operation starts before attempts by @zhongkechen in fix(plugin): order operation starts before attempts #578
• test: add error preservation regression tests by @ayushiahjolia in test: add error preservation regression tests #582
• docs: clarify local variable annotations by @zhongkechen in docs: clarify local variable annotations #583
• feat(otel): add ExecutionOtelPlugin with Workflow-rooted trace hierarchy by @SilanHe in feat(otel): add ExecutionOtelPlugin with Workflow-rooted trace hierarchy #576
• feat: limit in-flight operations in map/parallel by @yaythomas in feat: limit in-flight operations in map/parallel #533
• chore(deps): bump the actions-deps group with 4 updates by @dependabot[bot] in chore(deps): bump the actions-deps group with 4 updates #589
• fix(otel): fix cross language otel plugin differences by @SilanHe in fix(otel): fix cross language otel plugin differences #584
• fix(testing): deliver due waits on checkpoint by @yaythomas in fix(testing): deliver due waits on checkpoint #588
• ci: use latest conformance suite (git main) in conformance CI by @wangyb-A in ci: use latest conformance suite (git main) in conformance CI #586
• fix: handle missing checkpoint token from service by @ayushiahjolia in fix: handle missing checkpoint token from service #571
• ci: add AI pull request review workflow by @zhongkechen in ci: add AI pull request review workflow #585
• fix(otel): RETRY->UNSET status, workflow INTERNAL by @SilanHe in fix(otel): RETRY->UNSET status, workflow INTERNAL #592
• fix(plugin): correct replay callbacks and operation span timing by @zhongkechen in fix(plugin): correct replay callbacks and operation span timing #591
• test: add plugin conformance suite handlers (10-1..10-7) by @wangyb-A in test: add plugin conformance suite handlers (10-1..10-7) #580
• feat(otel): drop faas/cloud attrs from invocation span by @SilanHe in feat(otel): drop faas/cloud attrs from invocation span #596
• fix(testing): honor history reverse order by @mahayash315 in fix(testing): honor history reverse order #595
• feat(otel): add Workflow span to InvocationOtelPlugin by @SilanHe in feat(otel): add Workflow span to InvocationOtelPlugin #593
• fix(otel): close child spans before parent contexts by @zhongkechen in fix(otel): close child spans before parent contexts #598
• fix(otel): reuse deterministic ID generator by @zhongkechen in fix(otel): reuse deterministic ID generator #602
• Add plugin-suite conformance handlers for requirements 10-8..10-18 by @wangyb-A in Add plugin-suite conformance handlers for requirements 10-8..10-18 #601
• fix(otel): align operation status spans by @zhongkechen in fix(otel): align operation status spans #604
• chore(deps): bump the actions-deps group with 5 updates by @dependabot[bot] in chore(deps): bump the actions-deps group with 5 updates #608
• ci: reuse OpenTelemetry conformance workflow by @zhongkechen in ci: reuse OpenTelemetry conformance workflow #607
• fix(otel): remove OpenTelemetry upper bounds by @zhongkechen in fix(otel): remove OpenTelemetry upper bounds #609
• ci: reuse shared notification and AI review workflows by @zhongkechen in ci: reuse shared notification and AI review workflows #606
• ci: Add issue triage workflow by @ayushiahjolia in ci: Add issue triage workflow #610
• chore(deps): bump aws/aws-durable-execution-conformance-tests/.github/workflows/python-opentelemetry.yml from 810cc12607fc28edf2d7864859ca08db42ff069a to 9d03d8a66aa20238e786fefdcb3ff166b54e2891 in the actions-deps group by @dependabot[bot] in chore(deps): bump aws/aws-durable-execution-conformance-tests/.github/workflows/python-opentelemetry.yml from 810cc12607fc28edf2d7864859ca08db42ff069a to 9d03d8a66aa20238e786fefdcb3ff166b54e2891 in the actions-deps group #611
• docs: add testing requirements to contributing and agent guides by @ayushiahjolia in docs: add testing requirements to contributing and agent guides #613
• feat(otel): fully enum-driven OtelPluginConfig by @SilanHe in feat(otel): fully enum-driven OtelPluginConfig #612
• chore(deps): bump the actions-deps group with 5 updates by @dependabot[bot] in chore(deps): bump the actions-deps group with 5 updates #621
• feat: auto-discover instrumentation plugins by @zhongkechen in feat: auto-discover instrumentation plugins #620
• ci: publish otel plugin lambda layer by @zhongkechen in ci: publish otel plugin lambda layer #619
• feat(plugin): stabilize plugin interface and otel package by @zhongkechen in feat(plugin): stabilize plugin interface and otel package #625
• feat(plugin): surface execution input and result by @wangyb-A in feat(plugin): surface execution input and result #616
• fix(plugin): make payload fields additive on hook infos by @wangyb-A in fix(plugin): make payload fields additive on hook infos #627
• fix: avoid vendoring adot layer dependencies by @zhongkechen in fix: avoid vendoring adot layer dependencies #628
• fix: round-trip serdes result on first run across ops by @ayushiahjolia in fix: round-trip serdes result on first run across ops #550
• fix(testing): reject blank execution ARNs by @SravyaPeri in fix(testing): reject blank execution ARNs #636
• fix(testing): filter EXECUTION ops by type, not index by @SravyaPeri in fix(testing): filter EXECUTION ops by type, not index #637
• feat(plugin): operation maps on invocation hooks by @wangyb-A in feat(plugin): operation maps on invocation hooks #629
• Update shared CI workflows to v0.2.0 by @zhongkechen in Update shared CI workflows to v0.2.0 #645
• chore(deps): bump the actions-deps group with 2 updates by @dependabot[bot] in chore(deps): bump the actions-deps group with 2 updates #649
• feat(plugin): decouple instrumentation enums from lambda service by @zhongkechen in feat(plugin): decouple instrumentation enums from lambda service #634
• fix(otel): scope deterministic IDs to plugin tracers by @zhongkechen in fix(otel): scope deterministic IDs to plugin tracers #646
• fix(otel): rely on Lambda layers for OpenTelemetry dependencies by @zhongkechen in fix(otel): rely on Lambda layers for OpenTelemetry dependencies #651
• ci: call OpenTelemetry orchestrator workflow by @zhongkechen in ci: call OpenTelemetry orchestrator workflow #653
• fix(otel): balance otel context attach and detach by @wangyb-A in fix(otel): balance otel context attach and detach #650
• fix(otel): release unreleased scope on operation re-entry by @wangyb-A in fix(otel): release unreleased scope on operation re-entry #654
• docs: add conformance status badges by @zhongkechen in docs: add conformance status badges #657
• fix(otel): require execution start time for trace IDs by @zhongkechen in fix(otel): require execution start time for trace IDs #660
• ci: add stale issue closer workflow by @hln33 in ci: add stale issue closer workflow #662
• feat(otel): add in-repo OTel conformance handlers by @ayushiahjolia in feat(otel): add in-repo OTel conformance handlers #664
• feat(plugin): report incomplete user function outcomes by @wangyb-A in feat(plugin): report incomplete user function outcomes #661
• ci: schedule long-running OTel conformance tests by @zhongkechen in ci: schedule long-running OTel conformance tests #665
• fix: avoid unsafe yaml load in conformance tests by @hln33 in fix: avoid unsafe yaml load in conformance tests #668
• ci: run conformance tests on pushes to main by @wangyb-A in ci: run conformance tests on pushes to main #667
• ci: grant id-token: write for Slack notify workflow by @hln33 in ci: grant id-token: write for Slack notify workflow #672
• chore(deps): bump the actions-deps group with 3 updates by @dependabot[bot] in chore(deps): bump the actions-deps group with 3 updates #675
• feat: add should_complete to CompletionConfig by @ayushiahjolia in feat: add should_complete to CompletionConfig #605
• test: add plugin info-shape handlers by @wangyb-A in test: add plugin info-shape handlers #683
• fix(testing): handle workflow failure states correctly by @hln33 in fix(testing): handle workflow failure states correctly #682
• chore(deps): bump the actions-deps group with 6 updates by @dependabot[bot] in chore(deps): bump the actions-deps group with 6 updates #691
• feat(otel): add structured trace-context types and execution-trace resolver by @ayushiahjolia in feat(otel): add structured trace-context types and execution-trace resolver #685
• fix(ci): grant AI review contents write permission by @zhongkechen in fix(ci): grant AI review contents write permission #695
• fix: reject orphan checkpoint race by @warren830 in fix: reject orphan checkpoint race #690
• feat(otel): add durable sampling coordination by @ayushiahjolia in feat(otel): add durable sampling coordination #688
• feat(otel): parent durable spans to shared trace by @ayushiahjolia in feat(otel): parent durable spans to shared trace #693
• docs(otel): document shared execution trace by @ayushiahjolia in docs(otel): document shared execution trace #694
• feat: add Workflow Insight instrumentation plugin by @wangyb-A in feat: add Workflow Insight instrumentation plugin #632
• fix(insight): fail open on NaN sampling_rate + on-change note by @wangyb-A in fix(insight): fail open on NaN sampling_rate + on-change note #699
• Add comment/review triggers to AI PR review by @wangyb-A in Add comment/review triggers to AI PR review #703
• fix(core): validate replay operation identity by @zhongkechen in fix(core): validate replay operation identity #698
• Docs/migration 1x to 2x by @ayushiahjolia in Docs/migration 1x to 2x #655
• chore(release): bump sdk to 2.0.0 by @yaythomas in chore(release): bump sdk to 2.0.0 #706

New Contributors

• @Sanjays2402 made their first contribution in fix: fail invalid polling state #575
• @mahayash315 made their first contribution in fix(testing): honor history reverse order #595
• @SravyaPeri made their first contribution in fix(testing): reject blank execution ARNs #636
• @hln33 made their first contribution in ci: add stale issue closer workflow #662
• @warren830 made their first contribution in fix: reject orphan checkpoint race #690

Full Changelog: sdk-v1.7.0,otel-v0.3.0...sdk-v2.0.0

---

This discussion was created from the release sdk-v2.0.0,otel-v1.0.0.