Skip to content

Smola/proxy uds#6964

Draft
smola wants to merge 5 commits into
mainfrom
smola/proxy-uds
Draft

Smola/proxy uds#6964
smola wants to merge 5 commits into
mainfrom
smola/proxy-uds

Conversation

@smola
Copy link
Copy Markdown
Member

@smola smola commented May 18, 2026

Motivation

Changes

Workflow

  1. ⚠️ Create your PR as draft ⚠️
  2. Work on you PR until the CI passes
  3. Mark it as ready for review
    • Test logic is modified? -> Get a review from RFC owner.
    • Framework is modified, or non obvious usage of it -> get a review from R&P team

🚀 Once your PR is reviewed and the CI green, you can merge it!

🛟 #apm-shared-testing 🛟

Reviewer checklist

  • Anything but tests/ or manifests/ is modified ? I have the approval from R&P team
  • A docker base image is modified?
    • the relevant build-XXX-image label is present
  • A scenario is added, removed or renamed?

@github-actions
Copy link
Copy Markdown
Contributor

CODEOWNERS have been resolved as:

PLAN.md                                                                 @DataDog/system-tests-core
utils/proxy/config.py                                                   @DataDog/system-tests-core
tests/test_the_test/test_ci_orchestrator.py                             @DataDog/system-tests-core
utils/_context/_scenarios/debugger.py                                   @DataDog/system-tests-core
utils/_context/containers.py                                            @DataDog/system-tests-core
utils/build/docker/dotnet/uds.Dockerfile                                @DataDog/apm-dotnet @DataDog/asm-dotnet @DataDog/system-tests-core
utils/build/docker/dotnet/weblog/app.sh                                 @DataDog/apm-dotnet @DataDog/asm-dotnet @DataDog/system-tests-core
utils/build/docker/golang/app.sh                                        @DataDog/dd-trace-go-guild @DataDog/system-tests-core
utils/build/docker/golang/uds-echo.Dockerfile                           @DataDog/dd-trace-go-guild @DataDog/system-tests-core
utils/build/docker/java/spring-boot/app.sh                              @DataDog/apm-java @DataDog/asm-java @DataDog/system-tests-core
utils/build/docker/java/uds-spring-boot.Dockerfile                      @DataDog/apm-java @DataDog/asm-java @DataDog/system-tests-core
utils/build/docker/java_otel/spring-boot/app.sh                         @DataDog/opentelemetry @DataDog/system-tests-core
utils/build/docker/nodejs/app.sh                                        @DataDog/dd-trace-js @DataDog/system-tests-core
utils/build/docker/nodejs/parametric/app.sh                             @DataDog/dd-trace-js @DataDog/system-tests-core
utils/build/docker/nodejs/uds-express4.Dockerfile                       @DataDog/dd-trace-js @DataDog/system-tests-core
utils/build/docker/python/flask/app.sh                                  @DataDog/apm-python @DataDog/asm-python @DataDog/system-tests-core
utils/build/docker/python/uds-flask.Dockerfile                          @DataDog/apm-python @DataDog/asm-python @DataDog/system-tests-core
utils/build/docker/ruby/uds-rails.Dockerfile                            @DataDog/ruby-guild @DataDog/asm-ruby @DataDog/system-tests-core
utils/build/docker/ruby/uds-sinatra.Dockerfile                          @DataDog/ruby-guild @DataDog/asm-ruby @DataDog/system-tests-core
utils/proxy/core.py                                                     @DataDog/system-tests-core
utils/scripts/ci_orchestrators/workflow_data.py                         @DataDog/system-tests-core
utils/build/docker/set-uds-transport.sh                                 @DataDog/system-tests-core

@datadog-datadog-prod-us1-2
Copy link
Copy Markdown

datadog-datadog-prod-us1-2 Bot commented May 18, 2026

Pipelines  Tests

Fix all issues with BitsAI

⚠️ Warnings

🚦 25 Pipeline jobs failed

Testing the test | System Tests (python, prod) / End-to-end #1 / uds-flask 1   View in Datadog   GitHub Actions

🔧 Fix in code (Fix with Cursor). 12 failed tests due to assertions on missing probe IDs.

🧪 7 Tests failed

tests.appsec.api_security.test_api_security_rc.Test_API_Security_RC_ASM_DD_processors.test_request_method[uds-flask] from system_tests_suite   View in Datadog (Fix with Cursor)
assert None

self = <tests.appsec.api_security.test_api_security_rc.Test_API_Security_RC_ASM_DD_processors object at 0x7f45703c8f20>

    def test_request_method(self):
        """Can provide custom req.querytest schema"""
        schema = get_schema(self.request, "req.querytest")
        assert self.request.status_code == 200
>       assert schema
E       assert None
...
tests.appsec.api_security.test_api_security_rc.Test_API_Security_RC_ASM_DD_scanners.test_request_method[uds-flask] from system_tests_suite   View in Datadog (Fix with Cursor)
assert None

self = <tests.appsec.api_security.test_api_security_rc.Test_API_Security_RC_ASM_DD_scanners object at 0x7f45703c90a0>

    def test_request_method(self):
        """Can provide custom req.querytest schema"""
        schema = get_schema(self.request, "req.bodytest")
        expected_mail_schema = [8, {"category": "pii", "type": "email"}]
    
        assert self.request.status_code == 200
...
View all 7 test failures

Testing the test | System Tests (python, dev) / End-to-end #1 / uds-flask 1   View in Datadog   GitHub Actions

🔄 Retry job. This looks flaky and may succeed on retry. AssertionError: Not all probes were received. Missing ids: log95f49-6aa7-4057-a20a-7bc0519651a6, log54890-6aef-4675-b82e-9deb99c571b1, log3ee46-bd53-4e77-a1b7-9715bb06d2f7, log9e8c1-d029-4a97-aedc-459d63be1083, loga4214-7f4f-4d97-b128-1214420f76f8.

🧪 7 Tests failed

tests.appsec.api_security.test_api_security_rc.Test_API_Security_RC_ASM_DD_processors.test_request_method[uds-flask] from system_tests_suite   View in Datadog (Fix with Cursor)
assert None

self = <tests.appsec.api_security.test_api_security_rc.Test_API_Security_RC_ASM_DD_processors object at 0x7fa568d4ac90>

    def test_request_method(self):
        """Can provide custom req.querytest schema"""
        schema = get_schema(self.request, "req.querytest")
        assert self.request.status_code == 200
>       assert schema
E       assert None
...
tests.appsec.api_security.test_api_security_rc.Test_API_Security_RC_ASM_DD_scanners.test_request_method[uds-flask] from system_tests_suite   View in Datadog (Fix with Cursor)
assert None

self = <tests.appsec.api_security.test_api_security_rc.Test_API_Security_RC_ASM_DD_scanners object at 0x7fa568d4a960>

    def test_request_method(self):
        """Can provide custom req.querytest schema"""
        schema = get_schema(self.request, "req.bodytest")
        expected_mail_schema = [8, {"category": "pii", "type": "email"}]
    
        assert self.request.status_code == 200
...
View all 7 test failures

Testing the test | System Tests (python, dev) / End-to-end #2 / uds-flask 2   View in Datadog   GitHub Actions

🛟 This job is unlikely to succeed on retry. Please review your pipeline configuration. 13 test failures due to missing telemetry data in metrics and assertions about expected configurations not found.

🧪 3 Tests failed

tests.apm_tracing_e2e.test_process_tags.Test_Process_Tags.test_remote_config_process_tags[uds-flask] from system_tests_suite   View in Datadog (Fix with Cursor)
AssertionError: Process tags are missing
assert False

self = <tests.apm_tracing_e2e.test_process_tags.Test_Process_Tags object at 0x7f40d78f7770>

    def test_remote_config_process_tags(self):
>       self.check_remote_config_process_tags(validate_process_tags)

tests/apm_tracing_e2e/test_process_tags.py:59: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
...
tests.apm_tracing_e2e.test_process_tags.Test_Process_Tags.test_telemetry_process_tags[uds-flask] from system_tests_suite   View in Datadog (Fix with Cursor)
AssertionError: Process tags are missing
assert False

self = <tests.apm_tracing_e2e.test_process_tags.Test_Process_Tags object at 0x7f40d78f7980>

    def test_telemetry_process_tags(self):
>       self.check_telemetry_process_tags(validate_process_tags)

tests/apm_tracing_e2e/test_process_tags.py:86: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
...
View all 3 test failures

View all 25 failed jobs.

ℹ️ Info

No other issues found (see more)

❄️ No new flaky tests detected

Useful? React with 👍 / 👎

This comment will be updated automatically if new data arrives.
🔗 Commit SHA: 1920756 | Docs | Datadog PR Page | Give us feedback!

@smola smola added the ai-generated The pull request includes a significant amount of AI-generated code label May 20, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ai-generated The pull request includes a significant amount of AI-generated code

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant