Adding features to test optimization data by nccatoni · Pull Request #7202 · DataDog/system-tests

nccatoni · 2026-06-23T13:48:28Z

Motivation

Changes

Workflow

⚠️ Create your PR as draft ⚠️
Work on you PR until the CI passes
Mark it as ready for review
- Test logic is modified? -> Get a review from RFC owner.
- Framework is modified, or non obvious usage of it -> get a review from R&P team

🚀 Once your PR is reviewed and the CI green, you can merge it!

🛟 #apm-shared-testing 🛟

Reviewer checklist

Anything but tests/ or manifests/ is modified ? I have the approval from R&P team
A docker base image is modified?
- the relevant build-XXX-image label is present
A scenario is added, removed or renamed?
- Get a review from R&P team

github-actions · 2026-06-23T13:49:01Z

CODEOWNERS have been resolved as:

conftest.py                                                             @DataDog/system-tests-core
tests/test_the_test/reportJunit_expected.xml                            @DataDog/system-tests-core

datadog-datadog-prod-us1 · 2026-06-23T13:49:35Z

Tests

✨ Fix all issues with BitsAI

⚠️ Warnings

🚦 15 Pipeline jobs failed

Testing the test | System Tests (nodejs, dev) / End-to-end #2 / express4 2

🧪 2 Tests failed

tests.appsec.rasp.test_api10.Test_API10_response_body_ignored_content_length_missing.test_api10_response_body_ignored_content_length_missing[express4]

from system_tests_suite

AssertionError: assert 404 == 200
 &#43;  where 404 = HttpResponse(status_code:404, headers:{&#39;X-Powered-By&#39;: &#39;Express&#39;, &#39;Strict-Transport-Security&#39;: &#39;max-age=31536000&#39;, &#39;X-...rror&lt;/title&gt;\n&lt;/head&gt;\n&lt;body&gt;\n&lt;pre&gt;Cannot GET /external_request/body_limit/content_length_missing&lt;/pre&gt;\n&lt;/body&gt;\n&lt;/html&gt;\n).status_code
 &#43;    where HttpResponse(status_code:404, headers:{&#39;X-Powered-By&#39;: &#39;Express&#39;, &#39;Strict-Transport-Security&#39;: &#39;max-age=31536000&#39;, &#39;X-...rror&lt;/title&gt;\n&lt;/head&gt;\n&lt;body&gt;\n&lt;pre&gt;Cannot GET /external_request/body_limit/content_length_missing&lt;/pre&gt;\n&lt;/body&gt;\n&lt;/html&gt;\n) = &lt;tests.appsec.rasp.test_api10.Test_API10_response_body_ignored_content_length_missing object at 0x7ffa514912e0&gt;.r

self = &lt;tests.appsec.rasp.test_api10.Test_API10_response_body_ignored_content_length_missing object at 0x7ffa514912e0&gt;

    def test_api10_response_body_ignored_content_length_missing(self):
&gt;       assert self.r.status_code == 200
E       AssertionError: assert 404 == 200
E        &#43;  where 404 = HttpResponse(status_code:404, headers:{&#39;X-Powered-By&#39;: &#39;Express&#39;, &#39;Strict-Transport-Security&#39;: &#39;max-age=31536000&#39;, &#39;X-...rror&lt;/title&gt;\n&lt;/head&gt;\n&lt;body&gt;\n&lt;pre&gt;Cannot GET /external_request/body_limit/content_length_missing&lt;/pre&gt;\n&lt;/body&gt;\n&lt;/html&gt;\n).status_code
...

tests.appsec.rasp.test_api10.Test_API10_response_body_ignored_content_length_too_big.test_api10_response_body_ignored_content_length_too_big[express4]

from system_tests_suite

AssertionError: assert 404 == 200
 &#43;  where 404 = HttpResponse(status_code:404, headers:{&#39;X-Powered-By&#39;: &#39;Express&#39;, &#39;Strict-Transport-Security&#39;: &#39;max-age=31536000&#39;, &#39;X-...rror&lt;/title&gt;\n&lt;/head&gt;\n&lt;body&gt;\n&lt;pre&gt;Cannot GET /external_request/body_limit/content_length_too_big&lt;/pre&gt;\n&lt;/body&gt;\n&lt;/html&gt;\n).status_code
 &#43;    where HttpResponse(status_code:404, headers:{&#39;X-Powered-By&#39;: &#39;Express&#39;, &#39;Strict-Transport-Security&#39;: &#39;max-age=31536000&#39;, &#39;X-...rror&lt;/title&gt;\n&lt;/head&gt;\n&lt;body&gt;\n&lt;pre&gt;Cannot GET /external_request/body_limit/content_length_too_big&lt;/pre&gt;\n&lt;/body&gt;\n&lt;/html&gt;\n) = &lt;tests.appsec.rasp.test_api10.Test_API10_response_body_ignored_content_length_too_big object at 0x7ffa51490c80&gt;.r

self = &lt;tests.appsec.rasp.test_api10.Test_API10_response_body_ignored_content_length_too_big object at 0x7ffa51490c80&gt;

    def test_api10_response_body_ignored_content_length_too_big(self):
&gt;       assert self.r.status_code == 200
E       AssertionError: assert 404 == 200
E        &#43;  where 404 = HttpResponse(status_code:404, headers:{&#39;X-Powered-By&#39;: &#39;Express&#39;, &#39;Strict-Transport-Security&#39;: &#39;max-age=31536000&#39;, &#39;X-...rror&lt;/title&gt;\n&lt;/head&gt;\n&lt;body&gt;\n&lt;pre&gt;Cannot GET /external_request/body_limit/content_length_too_big&lt;/pre&gt;\n&lt;/body&gt;\n&lt;/html&gt;\n).status_code
...

Testing the test | System Tests (nodejs, dev) / End-to-end #2 / express4-typescript 2

🧪 2 Tests failed

tests.appsec.rasp.test_api10.Test_API10_response_body_ignored_content_length_missing.test_api10_response_body_ignored_content_length_missing[express4-typescript]

from system_tests_suite

AssertionError: assert 404 == 200
 &#43;  where 404 = HttpResponse(status_code:404, headers:{&#39;X-Powered-By&#39;: &#39;Express&#39;, &#39;Strict-Transport-Security&#39;: &#39;max-age=31536000&#39;, &#39;X-...rror&lt;/title&gt;\n&lt;/head&gt;\n&lt;body&gt;\n&lt;pre&gt;Cannot GET /external_request/body_limit/content_length_missing&lt;/pre&gt;\n&lt;/body&gt;\n&lt;/html&gt;\n).status_code
 &#43;    where HttpResponse(status_code:404, headers:{&#39;X-Powered-By&#39;: &#39;Express&#39;, &#39;Strict-Transport-Security&#39;: &#39;max-age=31536000&#39;, &#39;X-...rror&lt;/title&gt;\n&lt;/head&gt;\n&lt;body&gt;\n&lt;pre&gt;Cannot GET /external_request/body_limit/content_length_missing&lt;/pre&gt;\n&lt;/body&gt;\n&lt;/html&gt;\n) = &lt;tests.appsec.rasp.test_api10.Test_API10_response_body_ignored_content_length_missing object at 0x7fae2035cbc0&gt;.r

self = &lt;tests.appsec.rasp.test_api10.Test_API10_response_body_ignored_content_length_missing object at 0x7fae2035cbc0&gt;

    def test_api10_response_body_ignored_content_length_missing(self):
&gt;       assert self.r.status_code == 200
E       AssertionError: assert 404 == 200
E        &#43;  where 404 = HttpResponse(status_code:404, headers:{&#39;X-Powered-By&#39;: &#39;Express&#39;, &#39;Strict-Transport-Security&#39;: &#39;max-age=31536000&#39;, &#39;X-...rror&lt;/title&gt;\n&lt;/head&gt;\n&lt;body&gt;\n&lt;pre&gt;Cannot GET /external_request/body_limit/content_length_missing&lt;/pre&gt;\n&lt;/body&gt;\n&lt;/html&gt;\n).status_code
...

tests.appsec.rasp.test_api10.Test_API10_response_body_ignored_content_length_too_big.test_api10_response_body_ignored_content_length_too_big[express4-typescript]

from system_tests_suite

AssertionError: assert 404 == 200
 &#43;  where 404 = HttpResponse(status_code:404, headers:{&#39;X-Powered-By&#39;: &#39;Express&#39;, &#39;Strict-Transport-Security&#39;: &#39;max-age=31536000&#39;, &#39;X-...rror&lt;/title&gt;\n&lt;/head&gt;\n&lt;body&gt;\n&lt;pre&gt;Cannot GET /external_request/body_limit/content_length_too_big&lt;/pre&gt;\n&lt;/body&gt;\n&lt;/html&gt;\n).status_code
 &#43;    where HttpResponse(status_code:404, headers:{&#39;X-Powered-By&#39;: &#39;Express&#39;, &#39;Strict-Transport-Security&#39;: &#39;max-age=31536000&#39;, &#39;X-...rror&lt;/title&gt;\n&lt;/head&gt;\n&lt;body&gt;\n&lt;pre&gt;Cannot GET /external_request/body_limit/content_length_too_big&lt;/pre&gt;\n&lt;/body&gt;\n&lt;/html&gt;\n) = &lt;tests.appsec.rasp.test_api10.Test_API10_response_body_ignored_content_length_too_big object at 0x7fae2035c2f0&gt;.r

self = &lt;tests.appsec.rasp.test_api10.Test_API10_response_body_ignored_content_length_too_big object at 0x7fae2035c2f0&gt;

    def test_api10_response_body_ignored_content_length_too_big(self):
&gt;       assert self.r.status_code == 200
E       AssertionError: assert 404 == 200
E        &#43;  where 404 = HttpResponse(status_code:404, headers:{&#39;X-Powered-By&#39;: &#39;Express&#39;, &#39;Strict-Transport-Security&#39;: &#39;max-age=31536000&#39;, &#39;X-...rror&lt;/title&gt;\n&lt;/head&gt;\n&lt;body&gt;\n&lt;pre&gt;Cannot GET /external_request/body_limit/content_length_too_big&lt;/pre&gt;\n&lt;/body&gt;\n&lt;/html&gt;\n).status_code
...

Testing the test | System Tests (nodejs, dev) / End-to-end #2 / express5 2

🧪 2 Tests failed

tests.appsec.rasp.test_api10.Test_API10_response_body_ignored_content_length_missing.test_api10_response_body_ignored_content_length_missing[express5]

from system_tests_suite

AssertionError: assert 404 == 200
 &#43;  where 404 = HttpResponse(status_code:404, headers:{&#39;X-Powered-By&#39;: &#39;Express&#39;, &#39;Strict-Transport-Security&#39;: &#39;max-age=31536000&#39;, &#39;X-...rror&lt;/title&gt;\n&lt;/head&gt;\n&lt;body&gt;\n&lt;pre&gt;Cannot GET /external_request/body_limit/content_length_missing&lt;/pre&gt;\n&lt;/body&gt;\n&lt;/html&gt;\n).status_code
 &#43;    where HttpResponse(status_code:404, headers:{&#39;X-Powered-By&#39;: &#39;Express&#39;, &#39;Strict-Transport-Security&#39;: &#39;max-age=31536000&#39;, &#39;X-...rror&lt;/title&gt;\n&lt;/head&gt;\n&lt;body&gt;\n&lt;pre&gt;Cannot GET /external_request/body_limit/content_length_missing&lt;/pre&gt;\n&lt;/body&gt;\n&lt;/html&gt;\n) = &lt;tests.appsec.rasp.test_api10.Test_API10_response_body_ignored_content_length_missing object at 0x7f7fa48e6ae0&gt;.r

self = &lt;tests.appsec.rasp.test_api10.Test_API10_response_body_ignored_content_length_missing object at 0x7f7fa48e6ae0&gt;

    def test_api10_response_body_ignored_content_length_missing(self):
&gt;       assert self.r.status_code == 200
E       AssertionError: assert 404 == 200
E        &#43;  where 404 = HttpResponse(status_code:404, headers:{&#39;X-Powered-By&#39;: &#39;Express&#39;, &#39;Strict-Transport-Security&#39;: &#39;max-age=31536000&#39;, &#39;X-...rror&lt;/title&gt;\n&lt;/head&gt;\n&lt;body&gt;\n&lt;pre&gt;Cannot GET /external_request/body_limit/content_length_missing&lt;/pre&gt;\n&lt;/body&gt;\n&lt;/html&gt;\n).status_code
...

tests.appsec.rasp.test_api10.Test_API10_response_body_ignored_content_length_too_big.test_api10_response_body_ignored_content_length_too_big[express5]

from system_tests_suite

AssertionError: assert 404 == 200
 &#43;  where 404 = HttpResponse(status_code:404, headers:{&#39;X-Powered-By&#39;: &#39;Express&#39;, &#39;Strict-Transport-Security&#39;: &#39;max-age=31536000&#39;, &#39;X-...rror&lt;/title&gt;\n&lt;/head&gt;\n&lt;body&gt;\n&lt;pre&gt;Cannot GET /external_request/body_limit/content_length_too_big&lt;/pre&gt;\n&lt;/body&gt;\n&lt;/html&gt;\n).status_code
 &#43;    where HttpResponse(status_code:404, headers:{&#39;X-Powered-By&#39;: &#39;Express&#39;, &#39;Strict-Transport-Security&#39;: &#39;max-age=31536000&#39;, &#39;X-...rror&lt;/title&gt;\n&lt;/head&gt;\n&lt;body&gt;\n&lt;pre&gt;Cannot GET /external_request/body_limit/content_length_too_big&lt;/pre&gt;\n&lt;/body&gt;\n&lt;/html&gt;\n) = &lt;tests.appsec.rasp.test_api10.Test_API10_response_body_ignored_content_length_too_big object at 0x7f7fa48e66c0&gt;.r

self = &lt;tests.appsec.rasp.test_api10.Test_API10_response_body_ignored_content_length_too_big object at 0x7f7fa48e66c0&gt;

    def test_api10_response_body_ignored_content_length_too_big(self):
&gt;       assert self.r.status_code == 200
E       AssertionError: assert 404 == 200
E        &#43;  where 404 = HttpResponse(status_code:404, headers:{&#39;X-Powered-By&#39;: &#39;Express&#39;, &#39;Strict-Transport-Security&#39;: &#39;max-age=31536000&#39;, &#39;X-...rror&lt;/title&gt;\n&lt;/head&gt;\n&lt;body&gt;\n&lt;pre&gt;Cannot GET /external_request/body_limit/content_length_too_big&lt;/pre&gt;\n&lt;/body&gt;\n&lt;/html&gt;\n).status_code
...

View all 15 failed jobs.

ℹ️ Info

No other issues found (see more)

❄️ No new flaky tests detected

Useful? React with 👍 / 👎

_{This comment will be updated automatically if new data arrives.

🔗 Commit SHA: 3d0c940 | Docs | Datadog PR Page | Give us feedback!}

Adding features to test optimization data

174341f

nccatoni added 3 commits June 23, 2026 16:02

Fix typing

555d66d

Update test reference data

1f19283

Update field name

3d0c940

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Adding features to test optimization data#7202

Adding features to test optimization data#7202
nccatoni wants to merge 4 commits into
mainfrom
nccatoni/feature-test-optim

nccatoni commented Jun 23, 2026

Uh oh!

github-actions Bot commented Jun 23, 2026 •

edited

Loading

Uh oh!

datadog-datadog-prod-us1 Bot commented Jun 23, 2026 •

edited by datadog-prod-us1-3 Bot

Loading

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

Conversation

nccatoni commented Jun 23, 2026

Motivation

Changes

Workflow

Reviewer checklist

Uh oh!

github-actions Bot commented Jun 23, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

datadog-datadog-prod-us1 Bot commented Jun 23, 2026 • edited by datadog-prod-us1-3 Bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

⚠️ Warnings

ℹ️ Info

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

github-actions Bot commented Jun 23, 2026 •

edited

Loading

datadog-datadog-prod-us1 Bot commented Jun 23, 2026 •

edited by datadog-prod-us1-3 Bot

Loading