Skip to content

ci(vscode): Keep CI green when Azure Functions E2E flakes - #19760

Merged
Ankit Jain (radical) merged 1 commit into
microsoft:mainfrom
radical:radical-advisory-azure-functions-e2e
Sep 1, 2026
Merged

ci(vscode): Keep CI green when Azure Functions E2E flakes#19760
Ankit Jain (radical) merged 1 commit into
microsoft:mainfrom
radical:radical-advisory-azure-functions-e2e

Conversation

@radical

@radical Ankit Jain (radical) commented Aug 27, 2026

Copy link
Copy Markdown
Member

Description

Rolling main CI stays red when the Linux Azure Functions extension E2E shard intermittently fails with:

AssertionError [ERR_ASSERTION]: Expected the Azure Functions resource to expose an HTTPS URL.

Only 3 of 11 rolling main runs passed during the latest 36-hour investigation window. This shard appeared in five of the seven failed runs, making it the dominant recurring cause of red rolling CI.

This change keeps the shard running and uploading diagnostics, but reports completed Mocha test failures as advisory warnings so this known flake no longer fails the overall CI run. Setup failures, process crashes, signals, timeouts, unexpected exit codes, and cleanup failures remain blocking.

This preserves coverage and failure evidence instead of disabling the shard entirely. The explicit advisory-shard allowlist keeps the mitigation deliberate and reviewable.

Addresses #19639

Checklist

  • Is this feature complete?
    • Yes. Ready to ship.
    • No. Follow-up changes expected.
  • Are you including unit tests for the changes and scenario tests if relevant?
    • Yes
    • No
  • Did you add public API?
    • Yes
      • If yes, did you have an API Review for it?
        • Yes
        • No
      • Did you add <remarks /> and <code /> elements on your triple slash comments?
        • Yes
        • No
    • No
  • Does the change make any security assumptions or guarantees?
    • Yes
      • If yes, have you done a threat model and had a security review?
        • Yes
        • No
    • No
The Linux Azure Functions E2E shard intermittently fails because the
Functions resource does not expose its expected HTTPS URL. This failure
caused five of seven red main CI runs in a recent 36-hour window.

Keep running the shard and uploading diagnostics, but treat completed
Mocha test failures as advisory. Setup, process, timeout, unexpected exit,
and cleanup failures remain blocking. Update the explicit advisory-shard
allowlist so the mitigation remains reviewable.

Refs microsoft#19639

Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Copilot-Session: 8f5ea755-6426-482e-a619-6c65f8924f71
Copilot AI balanced review requested due to automatic review settings August 27, 2026 22:02
@github-actions

Copy link
Copy Markdown
Contributor

🚀 Dogfood this PR with:

⚠️ WARNING: Do not do this without first carefully reviewing the code of this PR to satisfy yourself it is safe.

curl -fsSL https://raw.githubusercontent.com/microsoft/aspire/main/eng/scripts/get-aspire-cli-pr.sh | bash -s -- 19760

Or

  • Run remotely in PowerShell:
iex "& { $(irm https://raw.githubusercontent.com/microsoft/aspire/main/eng/scripts/get-aspire-cli-pr.ps1) } 19760"

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Makes Linux Azure Functions E2E assertion failures advisory while preserving blocking behavior for infrastructure and cleanup failures.

Changes:

  • Adds issue #19639 to the Azure Functions shard’s advisory configuration.
  • Updates the explicit advisory-shard allowlist test.

Reviewed changes

Copilot reviewed 2 out of 2 changed files in this pull request and generated no comments.

File Description
.github/workflows/extension-e2e-tests.yml Marks the Linux Azure Functions shard advisory.
extension/src/test/e2eShardMatrix.test.ts Tracks the advisory shard and issue explicitly.

💡 Add a code-review agent skill for context-aware, tailored reviews. Learn more in the docs.

@github-actions

github-actions Bot commented Sep 1, 2026

Copy link
Copy Markdown
Contributor

🔍 CI Failure Analysis: Transient Infrastructure Failure

The CI build failed due to transient infrastructure issues.

Failed jobs:

  • Tests / Microsoft.Data.SqlClient / Microsoft.Data.SqlClient (windows-latest) — Process exit code -1073741502 (0xC0000142 STATUS_DLL_INIT_FAILED) occurred in post-test steps (hang dump check, upload logs/results, generate summary) after tests completed, on windows-latest runner. Known recurring transient Windows runner process-init failure, unrelated to PR changes which only touch VS Code extension e2e workflow files. (transient-infra)
  • Tests / Hosting.Azure.Kubernetes / Hosting.Azure.Kubernetes (windows-latest) — 'Build test project' step failed with generic exit code 1; job logs unavailable ('Failed to fetch logs for job'). PR only modifies a VS Code extension e2e test workflow/matrix file and does not touch Hosting.Azure.Kubernetes code. Fails simultaneously with 4 other unrelated 'Build test project' jobs, indicating a widespread transient build/infra issue rather than a PR code issue. (transient-infra)
  • Tests / Hosting.Azure / Hosting.Azure (ubuntu-latest) — 'Build test project' step failed with generic exit code 1; job logs unavailable. PR does not modify Hosting.Azure code; fails alongside other unrelated Build test project jobs simultaneously, indicating shared transient infra/build issue. (transient-infra)
  • Tests / Hosting.Azure / Hosting.Azure (windows-latest) — 'Build test project' step failed with generic exit code 1; job logs unavailable. PR does not modify Hosting.Azure code; fails alongside other unrelated Build test project jobs simultaneously, indicating shared transient infra/build issue. (transient-infra)
  • Tests / Hosting.Azure.Kubernetes / Hosting.Azure.Kubernetes (ubuntu-latest) — 'Build test project' step failed with generic exit code 1; job logs unavailable. PR does not modify Hosting.Azure.Kubernetes code; fails alongside other unrelated Build test project jobs simultaneously, indicating shared transient infra/build issue. (transient-infra)
  • Tests / Playground / Playground (ubuntu-latest) — 'Build test project' step failed with generic exit code 1; job logs unavailable. PR does not modify Playground code; fails alongside other unrelated Build test project jobs simultaneously, indicating shared transient infra/build issue. (transient-infra)

If a rerun was not already requested automatically, visit the workflow run page to rerun the failed jobs manually.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area-engineering-systems infrastructure helix infra engineering repo stuff area-vscode-extension

3 participants