e2e-flakiness-detector #343
Annotations
9 errors and 2 notices
chat-input.test.ts:197:3 › chat model selector:
vscode\test\e2e\chat-input.test.ts#L1
1) chat-input.test.ts:197:3 › chat model selector ────────────────────────────────────────────────
Test timeout of 30000ms exceeded.
|
chat-input.test.ts:197:3 › chat model selector:
vscode\test\e2e\chat-input.test.ts#L215
1) chat-input.test.ts:197:3 › chat model selector ────────────────────────────────────────────────
Error: locator.click: Target page, context or browser has been closed
Call log:
- waiting for frameLocator('iframe.webview:first-child:last-child').frameLocator('iframe').getByRole('combobox', { name: 'Select a model' }).last()
- locator resolved to <button type="button" role="combobox" data-state="closed" aria-expanded="false" aria-haspopup="dialog" aria-controls="radix-:rk:" data-testid="chat-model-selector" aria-label="Select a model or an agent" class="tw-border-none tw-flex tw-items-center focus-visible:tw-outline-none tw-justify-between tw-mr-1 _button_1wufw_5 _button--secondary_1wufw_60 _button--no-icon-start_1wufw_51">…</button>
- attempting click action
- waiting for element to be visible, enabled and stable
- element is visible, enabled and stable
- scrolling into view if needed
- done scrolling
- <div class="tw-flex tw-flex-col tw-justify-center tw-w-full tw-gap-2 tw-py-1">…</div> intercepts pointer events
- retrying click action, attempt #1
- waiting for element to be visible, enabled and stable
- element is visible, enabled and stable
- scrolling into view if needed
- done scrolling
- <p dir="ltr" class="_theme-paragraph_s4gjm_29">…</p> from <div class="_editor_pujow_6 _editor_1eiqs_17 _seamless_pujow_16">…</div> subtree intercepts pointer events
- retrying click action, attempt #2
- waiting 20ms
- waiting for element to be visible, enabled and stable
- element is visible, enabled and stable
- scrolling into view if needed
- done scrolling
- <div class="tw-flex tw-flex-col tw-justify-center tw-w-full tw-gap-2 tw-py-1">…</div> intercepts pointer events
- retrying click action, attempt #3
- waiting 100ms
- waiting for element to be visible, enabled and stable
- element is visible, enabled and stable
- scrolling into view if needed
- done scrolling
- <span class="tw-flex tw-items-baseline">…</span> from <div class="tw-flex tw-flex-col tw-justify-center tw-w-full tw-gap-2 tw-py-1">…</div> subtree intercepts pointer events
- retrying click action, attempt #4
- waiting 100ms
- waiting for element to be visible, enabled and stable
- element is visible, enabled and stable
- scrolling into view if needed
- done scrolling
- <header class="tw-flex tw-gap-4 tw-items-center [&_>_*]:tw-flex-shrink-0">…</header> from <div class="tw-flex tw-flex-col tw-justify-center tw-w-full tw-gap-2 tw-py-1">…</div> subtree intercepts pointer events
- retrying click action, attempt #5
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is visible, enabled and stable
- scrolling into view if needed
- done scrolling
- <p dir="ltr" class="_theme-paragraph_s4gjm_29">…</p> from <div class="_editor_pujow_6 _editor_1eiqs_17 _seamless_pujow_16">…</div> subtree intercepts pointer events
- retrying click action, attempt #6
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is visible, enabled and stable
- scrolling into view if needed
- done scrolling
- <div class="tw-flex tw-flex-col tw-justify-center tw-w-full tw-gap-2 tw-py-1">…</div> intercepts pointer events
- retrying click action, attempt #7
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is visible, enabled and stable
- scrolling into view if needed
- done scrolling
- <header class="tw-flex tw-gap-4 tw-items-center [&_>_*]:tw-flex-shrink-0">…</header> from <div class="tw-flex tw-flex-col tw-justify-center tw-w-full tw-gap-2 tw-py-1">…</div> subtree intercepts pointer events
- retrying click action, attempt #8
- waiting 500ms
- waiting for element
|
command-edit.test.ts:145:1 › edit (fixup) input - model selection:
vscode\test\e2e\command-edit.test.ts#L161
2) command-edit.test.ts:145:1 › edit (fixup) input - model selection ─────────────────────────────
Error: expect(locator).toBeVisible()
Locator: getByLabel('$(anthropic-logo) Claude 3.5 Sonnet').locator('a')
Expected: visible
Received: hidden
Call log:
- expect.toBeVisible with timeout 5000ms
- waiting for getByLabel('$(anthropic-logo) Claude 3.5 Sonnet').locator('a')
- locator resolved to <a class="label-name">…</a>
- unexpected value "hidden"
- locator resolved to <a class="label-name">…</a>
- unexpected value "hidden"
- locator resolved to <a class="label-name">…</a>
- unexpected value "hidden"
159 | const modelItem = page.getByLabel('$(anthropic-logo) Claude 3.5 Sonnet').locator('a')
160 | await nap()
> 161 | expect(modelItem).toBeVisible()
| ^
162 |
163 | // Open the model input and check it has the correct item selected
164 | await modelItem.click()
at D:\a\cody\cody\vscode\test\e2e\command-edit.test.ts:161:23
|
command-edit.test.ts:145:1 › edit (fixup) input - model selection:
vscode\test\e2e\command-edit.test.ts#L161
3) command-edit.test.ts:145:1 › edit (fixup) input - model selection ─────────────────────────────
Error: expect(locator).toBeVisible()
Locator: getByLabel('$(anthropic-logo) Claude 3.5 Sonnet').locator('a')
Expected: visible
Received: hidden
Call log:
- expect.toBeVisible with timeout 5000ms
- waiting for getByLabel('$(anthropic-logo) Claude 3.5 Sonnet').locator('a')
- locator resolved to <a class="label-name">…</a>
- unexpected value "hidden"
- locator resolved to <a class="label-name">…</a>
- unexpected value "hidden"
- locator resolved to <a class="label-name">…</a>
- unexpected value "hidden"
159 | const modelItem = page.getByLabel('$(anthropic-logo) Claude 3.5 Sonnet').locator('a')
160 | await nap()
> 161 | expect(modelItem).toBeVisible()
| ^
162 |
163 | // Open the model input and check it has the correct item selected
164 | await modelItem.click()
at D:\a\cody\cody\vscode\test\e2e\command-edit.test.ts:161:23
|
test-e2e (windows)
Process completed with exit code 1.
|
chat-atFile.test.ts:49:7 › @-mention file in chat:
vscode/test/e2e/chat-atFile.test.ts#L104
1) chat-atFile.test.ts:49:7 › @-mention file in chat ─────────────────────────────────────────────
Error: Timed out 5000ms waiting for expect(locator).toBeVisible()
Locator: frameLocator('.simple-find-part-wrapper + iframe.webview').last().frameLocator('iframe').getByRole('option', { name: 'Main.java' })
Expected: visible
Received: <element(s) not found>
Call log:
- expect.toBeVisible with timeout 5000ms
- waiting for frameLocator('.simple-find-part-wrapper + iframe.webview').last().frameLocator('iframe').getByRole('option', { name: 'Main.java' })
102 | await chatInput.fill('')
103 | await chatInput.pressSequentially('@mj', { delay: 350 })
> 104 | await expect(chatPanelFrame.getByRole('option', { name: 'Main.java' })).toBeVisible()
| ^
105 | await chatInput.fill('clear')
106 |
107 | // Searching and clicking
at /home/runner/work/cody/cody/vscode/test/e2e/chat-atFile.test.ts:104:77
|
command-edit.test.ts:145:1 › edit (fixup) input - model selection:
vscode/test/e2e/command-edit.test.ts#L161
2) command-edit.test.ts:145:1 › edit (fixup) input - model selection ─────────────────────────────
Error: expect(locator).toBeVisible()
Locator: getByLabel('$(anthropic-logo) Claude 3.5 Sonnet').locator('a')
Expected: visible
Received: hidden
Call log:
- expect.toBeVisible with timeout 5000ms
- waiting for getByLabel('$(anthropic-logo) Claude 3.5 Sonnet').locator('a')
- locator resolved to <a class="label-name">…</a>
- unexpected value "hidden"
- locator resolved to <a class="label-name">…</a>
- unexpected value "hidden"
- locator resolved to <a class="label-name">…</a>
- unexpected value "hidden"
- locator resolved to <a class="label-name">…</a>
- unexpected value "hidden"
159 | const modelItem = page.getByLabel('$(anthropic-logo) Claude 3.5 Sonnet').locator('a')
160 | await nap()
> 161 | expect(modelItem).toBeVisible()
| ^
162 |
163 | // Open the model input and check it has the correct item selected
164 | await modelItem.click()
at /home/runner/work/cody/cody/vscode/test/e2e/command-edit.test.ts:161:23
|
enterprise-cody-ignore.test.ts:44:7 › using actively invoked commands and autocomplete shows a error:
vscode/test/e2e/enterprise-cody-ignore.test.ts#L78
3) enterprise-cody-ignore.test.ts:44:7 › using actively invoked commands and autocomplete shows a error
Error: Timed out 5000ms waiting for expect(locator).toBeVisible()
Locator: getByText('Cody is disabled in this file')
Expected: visible
Received: hidden
Call log:
- expect.toBeVisible with timeout 5000ms
- waiting for getByText('Cody is disabled in this file')
- locator resolved to <span class="monaco-highlighted-label">…</span>
- unexpected value "hidden"
- locator resolved to <span class="monaco-highlighted-label">…</span>
- unexpected value "hidden"
- locator resolved to <span class="monaco-highlighted-label">…</span>
- unexpected value "hidden"
- locator resolved to <span class="monaco-highlighted-label">…</span>
- unexpected value "hidden"
- locator resolved to <span class="monaco-highlighted-label">…</span>
- unexpected value "hidden"
- locator resolved to <span class="monaco-highlighted-label">…</span>
- unexpected value "hidden"
- locator resolved to <span class="monaco-highlighted-label">…</span>
- unexpected value "hidden"
- locator resolved to <span class="monaco-highlighted-label">…</span>
- unexpected value "hidden"
76 | // Clicking on the Cody icon shows a message
77 | await statusBarButton.click()
> 78 | await expect(page.getByText('Cody is disabled in this file')).toBeVisible()
| ^
79 | await page.keyboard.press('Escape')
80 |
81 | // Manually invoking autocomplete should show an error
at /home/runner/work/cody/cody/vscode/test/e2e/enterprise-cody-ignore.test.ts:78:71
|
test-e2e (ubuntu)
Process completed with exit code 1.
|
🎭 Playwright Run Summary
3 failed
chat-input.test.ts:197:3 › chat model selector ─────────────────────────────────────────────────
command-edit.test.ts:145:1 › edit (fixup) input - model selection ──────────────────────────────
command-edit.test.ts:145:1 › edit (fixup) input - model selection ──────────────────────────────
64 skipped
165 passed (48.0m)
|
🎭 Playwright Run Summary
3 failed
chat-atFile.test.ts:49:7 › @-mention file in chat ──────────────────────────────────────────────
command-edit.test.ts:145:1 › edit (fixup) input - model selection ──────────────────────────────
enterprise-cody-ignore.test.ts:44:7 › using actively invoked commands and autocomplete shows a error
160 skipped
417 passed (1.7h)
|
Artifacts
Produced during runtime
Name | Size | |
---|---|---|
playwright-recordings ubuntu
|
1.33 MB |
|
playwright-recordings windows
|
535 KB |
|