Repository navigation
Failing test: Workflow access dialog - lets an executor test a saved workflow with enabled=false #294772
Description
Activity
- addedfailed-testA test failure on a tracked branch, potentially flaky-testA test failure on a tracked branch, potentially flaky-testscout-playwrightScout (Playwright) related issues and PRsScout (Playwright) related issues and PRs
on Oct 1, 2026 - addedTeam:One WorkflowTeam label for One Workflow (Workflow automation)Team label for One Workflow (Workflow automation)
on Oct 1, 2026 github-actions commented
on Oct 1, 2026 on Oct 1, 2026 – with GitHub Actions · Hidden as outdatedshow commentMore actions- addedfailure:ai-fixableFailed test investigator: a fix is available and a PR can be openedFailed test investigator: a fix is available and a PR can be openedfailure:test-needs-updateFailed test investigator: failure lives in the test codeFailed test investigator: failure lives in the test code
on Oct 1, 2026 New failure for "cloud-stateful-classic" target: appex-qa-stateful-kibana-scout-tests - main
Error message matches a failure already reported on this issue.
- addedai:fix-flakyFlags this flaky test for an AI agent to fixFlags this flaky test for an AI agent to fix
on Oct 2, 2026 ✅ Flaky Test Fixer completed successfully!
Generated by Flaky Test Fixer for #294772
➡️ A fix PR is ready for review: #294917
The access-control spec now resolves each participant's display name and username from
/internal/security/meat runtime instead of hard-coding the local-only SAML identities, which never exist on Cloud.Generated by Flaky Test Fixer for #294772 · claude · opus · 356.9 AIC · ⌖ 61.8 AIC · ⊞ 15K · ◷
- removedai:fix-flakyFlags this flaky test for an AI agent to fixFlags this flaky test for an AI agent to fix
on Oct 2, 2026 New failure for "cloud-stateful-classic" target: appex-qa-stateful-kibana-scout-tests - main
Error message matches a failure already reported on this issue.
New failure for "cloud-stateful-classic" target: appex-qa-stateful-kibana-scout-tests - main
Error message matches a failure already reported on this issue.
9 remaining items
github-actions commented
on Oct 5, 2026 on Oct 5, 2026 – with GitHub Actions · Hidden as outdatedshow commentMore actions- addedfailure:ci-environmentFailed test investigator: failure outside test + app (CI agent, deps, network)Failed test investigator: failure outside test + app (CI agent, deps, network)
on Oct 5, 2026 - removedfailure:test-needs-updateFailed test investigator: failure lives in the test codeFailed test investigator: failure lives in the test codefailure:ai-fixableFailed test investigator: a fix is available and a PR can be openedFailed test investigator: a fix is available and a PR can be opened
on Oct 5, 2026 github-actions commented
on Oct 5, 2026 on Oct 5, 2026 – with GitHub Actions · Hidden as outdatedshow commentMore actionsNew failure for "cloud-stateful-classic" target: appex-qa-stateful-kibana-scout-tests - main
Error message matches a failure already reported on this issue.
CI environment issue — the failing build again predates the merged fix
Build 561 ran Kibana
e99c7c7(5 Oct 10:36 UTC), which is 16 commits behind the fixa0c6268(5 Oct 12:06 UTC), soaddAccessUser('test editor')still timed out on a literal that no longer exists onmain.Details
Proposed fix
No change for this test — #294917 already fixed it and the Cloud image simply hasn't picked it up yet.
One follow-up is still needed, though, and it is not covered by that PR:
workflow_access_control_admin.spec.ts#L69-L70still hard-codesaddAccessUser('test admin')/setAccessRole('elastic_admin', 'executor'). Lift theresolveUserhelper fromworkflow_access_control.spec.ts#L18-L21into a shared module and use it for theadminrole there too. Unlike this issue's test, that one will keep failing on Cloud after the image catches up — same Design tests with a cloud-first mindset rule.Root cause & evidence
- The build does not contain the fix.
GET /repos/elastic/kibana/compare/a0c6268...e99c7c7returnsstatus: "behind",behind_by: 16, andmerge_base_commit.sha == e99c7c7— i.e. the checkout is an ancestor of the fix. The job log confirms the pin:Build hash: e99c7c795f342e2a221499dc752e166a43e41ae4in theDeployment informationblock, thenChecking out commit 'e99c7c79...'for/root/.qaf/data/git/kibana, the directory every failing stack frame is rooted in. - The signature is byte-for-byte pre-fix, including the old line numbers:
saves private and public access through the shared formfails atspec.ts:69:10ongetByText('test editor', { exact: true }), and both executor cases atspec.ts:119:13ongetByRole('option', { name: 'test editor' }). Post-fix those literals are gone — the only surviving match fortest editorin the spec is the explanatory comment aboveresolveUser. - Not
failure:fix-did-not-hold: the fix was merged 5 Oct 12:06 UTC and this build's checkout is from 5 Oct 10:36 UTC — 90 minutes earlier. The fix has still never been exercised on this pipeline. - Correction to the previous verdict: it claimed
main"no longer contains any of the local-only identities". That is true for this spec but not for the sibling admin spec, which failed in the same job ongetByRole('option', { name: 'test admin' })(workflow_access_control_admin.spec.ts:56:5) and is genuinely unfixed onmain. No open PR addresses it.
Additional context
- Ruled out: a new or different flake — all three cases of this spec fail on the pre-fix hard-coded strings at pre-fix line offsets, and the two browser
404s logged at12:50:21Z/12:50:33Zbracket the click window but are incidental (the_suggest_user_profilescall succeeded, as the previous investigation established). - Verification: for the next reported failure, resolve the run's
Build hashfrom theDeployment informationblock and rungh api repos/elastic/kibana/compare/a0c626839bd5456a8a8ae33b8913858716f4aff5...<build-hash> --jq '.status'—ahead/identicalmeans the fix was genuinely exercised and the failure counts.
Note
Closing this issue: the failing run used Kibana
e99c7c7, which predates the fix commita0c6268by 90 minutes, so it ran pre-fix code rather than a recurrence. It will reopen automatically if the test fails again. The sibling admin-spec gap noted above needs its own fix and is not tracked by this issue.Generated by Failed Test Investigator for #294772 · claude · opus · 256.3 AIC · ⌖ 55 AIC · ⊞ 14.1K · ◷
- The build does not contain the fix.
Closing: the failing run (build 561) used Kibana
e99c7c795f342e2a221499dc752e166a43e41ae4(5 Oct 10:36 UTC), which is 16 commits behind the fix commita0c626839bd5456a8a8ae33b8913858716f4aff5(5 Oct 12:06 UTC), so it ran pre-fix code — propagation lag, not a recurrence. See the investigation comment above. This will reopen automatically if the test fails again.Note: the sibling
workflow_access_control_admin.spec.tshas the same local-only SAML identities still hard-coded onmainand needs a separate fix; that is not tracked by this issue.Generated by Failed Test Investigator for #294772 · claude · opus · 256.3 AIC · ⌖ 55 AIC · ⊞ 14.1K
New failure for "cloud-stateful-classic" target: appex-qa-stateful-kibana-scout-tests - main
Error message matches a failure already reported on this issue.
Closing: build 562 ran Kibana
e99c7c795f342e2a221499dc752e166a43e41ae4— the same pre-fix checkout as build 561 — so it ran pre-fix code. Propagation lag, not a recurrence. Verdict and root cause are unchanged from the previous investigation, so no new analysis comment.Confirmed directly from the source at that commit rather than by date arithmetic:
workflow_access_control.spec.ts@e99c7c7still hard-codesgetByText('test editor', { exact: true })(L75),addAccessUser('test editor'),'test viewer','elastic_viewer'and'elastic_editor'— all removed by #294917 (merged 5 Oct 12:42 UTC), whichmainnow carries viaresolveUser/samlAuth.session.getUserData. The job's code frame matches that checkout line-for-line (67 saveWorkflow→69 if (!workflowId ...)), confirming the pin; theDeployment informationblock reportsBuild hash: e99c7c79...and the run then checks that commit out into/root/.qaf/data/git/kibana, the directory every failing stack frame is rooted in.Two notes for whoever sees this next:
- The Cloud image has not advanced in ~2 days. Builds 561 (6 Oct) and 562 (7 Oct) both pinned
e99c7c79(5 Oct 10:36 UTC), ~38 h behind the fix merge. Expect this issue to reopen and re-close on each nightly run until the image moves pasta0c6268; that is image-promotion lag, not a test problem. The fix has still never been exercised on this pipeline. - The sibling admin spec is genuinely unfixed on
mainand failed in the same job:workflow_access_control_admin.spec.ts#L69-L70still hard-codesaddAccessUser('test admin')/setAccessRole('elastic_admin', 'executor'). Unlike this issue's spec it will keep failing on Cloud after the image catches up. No open PR addresses it, and it is not tracked here — it needs its own issue.
To check the next reported failure: resolve the run's
Build hashfrom theDeployment informationblock and rungh api repos/elastic/kibana/compare/a0c626839bd5456a8a8ae33b8913858716f4aff5...<build-hash> --jq '.status'—ahead/identicalmeans the fix was genuinely exercised and the failure counts. This will reopen automatically if the test fails again.Generated by Failed Test Investigator for #294772 · claude · opus · 222.4 AIC · ⌖ 39.5 AIC · ⊞ 14.1K
- The Cloud image has not advanced in ~2 days. Builds 561 (6 Oct) and 562 (7 Oct) both pinned


A test failed on a tracked branch
Scout Test Details:
First failure: appex-qa-stateful-kibana-scout-tests - main
Failure screenshots are available in the Buildkite HTML report and artifacts.