Skip to content

Use QJazz in tests#5168

Open
dmarteau wants to merge 1 commit intomasterfrom
qjazz-test
Open

Use QJazz in tests#5168
dmarteau wants to merge 1 commit intomasterfrom
qjazz-test

Conversation

@dmarteau
Copy link
Copy Markdown
Member

@dmarteau dmarteau commented Jan 8, 2025

QJazz QGIS server in tests.

@dmarteau dmarteau requested a review from Gustry January 8, 2025 15:59
@github-actions github-actions Bot added this to the 3.10.0 milestone Jan 8, 2025
Copy link
Copy Markdown
Contributor

@Gustry Gustry left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I tried it locally, it works.
Still an issue on CI for now.

Will tags such as 3.34, 3.40 will be available on Docker hubs later ?

Comment thread tests/Makefile Outdated
Comment thread tests/docker-conf/qgis-server.toml Outdated
@dmarteau dmarteau force-pushed the qjazz-test branch 2 times, most recently from 23d1e4b to ca13211 Compare January 13, 2025 12:40
Copy link
Copy Markdown
Contributor

@Gustry Gustry left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

  • Needed QGIS Server plugins are not installed in the current state of this PR. That's why the CI is not working. It was working locally, because my plugins were already existing before.
  • Can you remove the script tests/add_server_plugins.sh ?
  • In tests/add_server_plugins.sh, we need to use to the custom repository for QGIS plugins. Please do the change
  • Will tags such as 3.34, 3.40 will be available on Docker hubs ? https://hub.docker.com/r/3liz/qjazz/tags

@Gustry
Copy link
Copy Markdown
Contributor

Gustry commented Jan 13, 2025

Is-it not missing the mount for QGIS plugins in map container ? But it doesn't seem to be enough to have QGIS server plugins installed, even when rebuilding/starting containers.

@Gustry
Copy link
Copy Markdown
Contributor

Gustry commented Jan 13, 2025

For testing purpose, I have pressed the rebased button, to have latest commits from master.

@dmarteau
Copy link
Copy Markdown
Member Author

dmarteau commented Jan 13, 2025

Is-it not missing the mount for QGIS plugins in map container ? But it doesn't seem to be enough to have QGIS server plugins installed, even when rebuilding/starting containers.

Rules for plugins are the following:

  1. Plugins locations should be mounted somewhere and declared in config (or QGIS_PLUGINPATH).
  2. Wether or not plugin are installed at startup depends on configuration settings ('auto' vs 'external').
  3. Allowed plugins must be explicitely declared in configuration settings (see tests/docker-conf/qgis-server.toml)

@dmarteau
Copy link
Copy Markdown
Member Author

  • Will tags such as 3.34, 3.40 will be available on Docker hubs ?

On release.

@Gustry Gustry force-pushed the qjazz-test branch 2 times, most recently from 00fba5e to 42aefa7 Compare January 13, 2025 17:00
@dmarteau
Copy link
Copy Markdown
Member Author

There is tests checking OnlineResource: they seems to be wrong to me.

The qjazz proxy handle standard Forwarded headers as defined in RFC 7239 and legacy X-Forwarded-Host and X-Forwarded-Proto.

The path returned in the service response may be changed with the appropriate X-Qgis-Service-Url header (See the documentation for the QGIS_SERVER_SERVICE_URL environment variable.

@dmarteau
Copy link
Copy Markdown
Member Author

dmarteau commented Jan 13, 2025

Found that QGIS does not stick to standard and handle headers in case sensitive way, at least for 'X-Qgis-*' headers.

@dmarteau
Copy link
Copy Markdown
Member Author

I cannot check what's wrong on failed test, i need at least the request that failed if this is is a request to the QGIS service.

@dmarteau
Copy link
Copy Markdown
Member Author

@Gustry : please check the timeout error on Playwright test, with proper rights there is no issue locally with the url I can guess from the details.

@Gustry Gustry force-pushed the qjazz-test branch 4 times, most recently from 4bbaab3 to 51d7be8 Compare January 15, 2025 10:01
@Gustry
Copy link
Copy Markdown
Contributor

Gustry commented Jan 15, 2025

Something is very slow in this PR.
At the end of the CI, there will be some artifacts generated : https://github.com/3liz/lizmap-web-client/actions/runs/12785872522?pr=5168, especially all QGIS servers logs, from the container lizmapBRANCH_test_qgis.
Should we also save logs from lizmapBRANCH_test_qgis_rpc container ?

@dmarteau dmarteau force-pushed the qjazz-test branch 2 times, most recently from e4ff4e1 to f34b6f4 Compare May 7, 2025 13:50
@dmarteau
Copy link
Copy Markdown
Member Author

dmarteau commented May 7, 2025

@Gustry BLEEDING EDGE tests are completely failing because the plugin source url is invalid:

2025-05-07T13:52:42.475Z»   [32]»   INFO»   Installing plugins in /srv/qgis-server-plugins
Downloading https://packages.3liz.org/pub/server-plugins-repository/unstable/plugins.3.42.xml…
    HTTP Error 404: Not Found
2025-05-07T13:52:44.278Z»   [32]»   ERROR»  Cannot update plugins index, cancelling installation...
...

And thus the lizmap server plugin is not installed....

AMHA tests should not run at all if the Lizmap server plugin is not installed.

@Gustry Gustry modified the milestones: 3.10.0, 3.11.0 Jun 23, 2025
@dmarteau dmarteau self-assigned this Aug 25, 2025
@dmarteau dmarteau force-pushed the qjazz-test branch 2 times, most recently from eab23c8 to 5c9f29c Compare August 25, 2025 10:29
@dmarteau dmarteau marked this pull request as ready for review August 25, 2025 10:35
@dmarteau dmarteau force-pushed the qjazz-test branch 6 times, most recently from e8669bb to 34e369f Compare August 25, 2025 22:22
@3liz 3liz deleted a comment from 3liz-bot Aug 28, 2025
@github-actions
Copy link
Copy Markdown

The Lizmap project highly values your contribution and would love to see this work merged! Unfortunately this PR has not had any activity in the last 2 months and is being automatically marked as "stale".
If there is no further activity on this pull request, it will be closed in two weeks.

@github-actions github-actions Bot added the stale This ticket might be closed soon label Oct 27, 2025
@3liz-bot
Copy link
Copy Markdown
Contributor

3liz-bot commented Oct 27, 2025

All Playwright tests BLEEDING_EDGE

Summary

Tests 📝 Passed ✅ Failed ❌ Skipped ⏭️ Other ❓ Flaky 🍂 Duration ⏱️
346 344 0 2 0 1 11m 54s

Flaky Tests

Flaky Tests 🍂 Retries
Build permalink, reload and apply one 1

Flaky Rate

Flaky Rate 0.29% ( ➖ 0.00%)
Test 📝 Attempts 🎯 Passed ✅ Failed ❌ Flaky Rate 📈
Build permalink, reload and apply one 2 1 1 50.00

🎉 No failed tests in this run.

Github Test Reporter by CTRF 💚


All Playwright tests LEGACY

Summary

Tests 📝 Passed ✅ Failed ❌ Skipped ⏭️ Other ❓ Flaky 🍂 Duration ⏱️
346 344 0 2 0 1 11m 50s

Flaky Tests

Flaky Tests 🍂 Retries
Build permalink, reload and apply one 1

Flaky Rate

Flaky Rate 0.29% ( ➖ 0.00%)
Test 📝 Attempts 🎯 Passed ✅ Failed ❌ Flaky Rate 📈
Build permalink, reload and apply one 2 1 1 50.00

🎉 No failed tests in this run.

Github Test Reporter by CTRF 💚


All Playwright tests LEGACY

Summary

Tests 📝 Passed ✅ Failed ❌ Skipped ⏭️ Other ❓ Flaky 🍂 Duration ⏱️
5 0 5 0 0 0 6.3s

Failed Tests

Failed Tests ❌ Fail Message
❌ authenticate as user_in_group_a Error: browserType.launch: Executable doesn't exist at /home/runner/.cache/ms-playwright/chromium_headless_shell-1200/chrome-headless-shell-linux64/chrome-headless-shell
╔═════════════════════════════════════════════════════════════════════════╗
║ Looks like Playwright Test or Playwright was just installed or updated. ║
║ Please run the following command to download new browsers: ║
║ ║
║ npx playwright install ║
║ ║
║ <3 Playwright Team ║
╚═════════════════════════════════════════════════════════════════════════╝
❌ authenticate as admin Error: browserType.launch: Executable doesn't exist at /home/runner/.cache/ms-playwright/chromium_headless_shell-1200/chrome-headless-shell-linux64/chrome-headless-shell
╔═════════════════════════════════════════════════════════════════════════╗
║ Looks like Playwright Test or Playwright was just installed or updated. ║
║ Please run the following command to download new browsers: ║
║ ║
║ npx playwright install ║
║ ║
║ <3 Playwright Team ║
╚═════════════════════════════════════════════════════════════════════════╝
❌ authenticate as publisher Error: browserType.launch: Executable doesn't exist at /home/runner/.cache/ms-playwright/chromium_headless_shell-1200/chrome-headless-shell-linux64/chrome-headless-shell
╔═════════════════════════════════════════════════════════════════════════╗
║ Looks like Playwright Test or Playwright was just installed or updated. ║
║ Please run the following command to download new browsers: ║
║ ║
║ npx playwright install ║
║ ║
║ <3 Playwright Team ║
╚═════════════════════════════════════════════════════════════════════════╝
❌ authenticate as user_in_group_b Error: browserType.launch: Executable doesn't exist at /home/runner/.cache/ms-playwright/chromium_headless_shell-1200/chrome-headless-shell-linux64/chrome-headless-shell
╔═════════════════════════════════════════════════════════════════════════╗
║ Looks like Playwright Test or Playwright was just installed or updated. ║
║ Please run the following command to download new browsers: ║
║ ║
║ npx playwright install ║
║ ║
║ <3 Playwright Team ║
╚═════════════════════════════════════════════════════════════════════════╝
❌ authenticate as read only Error: browserType.launch: Executable doesn't exist at /home/runner/.cache/ms-playwright/chromium_headless_shell-1200/chrome-headless-shell-linux64/chrome-headless-shell
╔═════════════════════════════════════════════════════════════════════════╗
║ Looks like Playwright Test or Playwright was just installed or updated. ║
║ Please run the following command to download new browsers: ║
║ ║
║ npx playwright install ║
║ ║
║ <3 Playwright Team ║
╚═════════════════════════════════════════════════════════════════════════╝

🍂 No flaky tests in this run.

Github Test Reporter by CTRF 💚


All Playwright tests BLEEDING_EDGE

Summary

Tests 📝 Passed ✅ Failed ❌ Skipped ⏭️ Other ❓ Flaky 🍂 Duration ⏱️
5 0 5 0 0 0 6.1s

Failed Tests

Failed Tests ❌ Fail Message
❌ authenticate as user_in_group_a Error: browserType.launch: Executable doesn't exist at /home/runner/.cache/ms-playwright/chromium_headless_shell-1200/chrome-headless-shell-linux64/chrome-headless-shell
╔═════════════════════════════════════════════════════════════════════════╗
║ Looks like Playwright Test or Playwright was just installed or updated. ║
║ Please run the following command to download new browsers: ║
║ ║
║ npx playwright install ║
║ ║
║ <3 Playwright Team ║
╚═════════════════════════════════════════════════════════════════════════╝
❌ authenticate as admin Error: browserType.launch: Executable doesn't exist at /home/runner/.cache/ms-playwright/chromium_headless_shell-1200/chrome-headless-shell-linux64/chrome-headless-shell
╔═════════════════════════════════════════════════════════════════════════╗
║ Looks like Playwright Test or Playwright was just installed or updated. ║
║ Please run the following command to download new browsers: ║
║ ║
║ npx playwright install ║
║ ║
║ <3 Playwright Team ║
╚═════════════════════════════════════════════════════════════════════════╝
❌ authenticate as publisher Error: browserType.launch: Executable doesn't exist at /home/runner/.cache/ms-playwright/chromium_headless_shell-1200/chrome-headless-shell-linux64/chrome-headless-shell
╔═════════════════════════════════════════════════════════════════════════╗
║ Looks like Playwright Test or Playwright was just installed or updated. ║
║ Please run the following command to download new browsers: ║
║ ║
║ npx playwright install ║
║ ║
║ <3 Playwright Team ║
╚═════════════════════════════════════════════════════════════════════════╝
❌ authenticate as user_in_group_b Error: browserType.launch: Executable doesn't exist at /home/runner/.cache/ms-playwright/chromium_headless_shell-1200/chrome-headless-shell-linux64/chrome-headless-shell
╔═════════════════════════════════════════════════════════════════════════╗
║ Looks like Playwright Test or Playwright was just installed or updated. ║
║ Please run the following command to download new browsers: ║
║ ║
║ npx playwright install ║
║ ║
║ <3 Playwright Team ║
╚═════════════════════════════════════════════════════════════════════════╝
❌ authenticate as read only Error: browserType.launch: Executable doesn't exist at /home/runner/.cache/ms-playwright/chromium_headless_shell-1200/chrome-headless-shell-linux64/chrome-headless-shell
╔═════════════════════════════════════════════════════════════════════════╗
║ Looks like Playwright Test or Playwright was just installed or updated. ║
║ Please run the following command to download new browsers: ║
║ ║
║ npx playwright install ║
║ ║
║ <3 Playwright Team ║
╚═════════════════════════════════════════════════════════════════════════╝

🍂 No flaky tests in this run.

Github Test Reporter by CTRF 💚


All Playwright tests LEGACY

Summary

Tests 📝 Passed ✅ Failed ❌ Skipped ⏭️ Other ❓ Flaky 🍂 Duration ⏱️
465 462 1 2 0 3 13m 28s

Failed Tests

Failed Tests ❌ Fail Message

Flaky Tests

Flaky Tests 🍂 Retries
Should select / filter / refresh with map interaction 1
Switcher from map to map 1
Build permalink, reload and apply one 1

Flaky Rate

Overall Flakiness 0.64%    ±0
Test 📝 Flaky Attempts 🍂 Total Attempts 🎯 Flaky Rate (%) 📈
Should select / filter / refresh with map interaction 1 2 50.00    ↑50.00
Switcher from map to map 1 2 50.00    ↑50.00
Build permalink, reload and apply one 1 2 50.00    ↑50.00

Github Test Reporter by CTRF 💚


All Playwright tests BLEEDING_EDGE

Summary

Tests 📝 Passed ✅ Failed ❌ Skipped ⏭️ Other ❓ Flaky 🍂 Duration ⏱️
465 462 1 2 0 3 13m 35s

Failed Tests

Failed Tests ❌ Fail Message

Flaky Tests

Flaky Tests 🍂 Retries
Catch GetLegendGraphic requests and timeout on GetLegendGraphic with multi layers 1
Switcher from map to map 1
Build permalink, reload and apply one 1

Flaky Rate

Overall Flakiness 0.64%    ±0
Test 📝 Flaky Attempts 🍂 Total Attempts 🎯 Flaky Rate (%) 📈
Catch GetLegendGraphic requests and timeout on GetLegendGraphic with multi layers 1 2 50.00    ↑50.00
Switcher from map to map 1 2 50.00    ↑50.00
Build permalink, reload and apply one 1 2 50.00    ↑50.00

Github Test Reporter by CTRF 💚


All Playwright tests LEGACY

Summary

Tests 📝 Passed ✅ Failed ❌ Skipped ⏭️ Other ❓ Flaky 🍂 Duration ⏱️
5 0 5 0 0 0 11.3s

Failed Tests

Failed Tests ❌ Fail Message
❌ authenticate as user_in_group_a Error: browserType.launch: Executable doesn't exist at /home/runner/.cache/ms-playwright/chromium_headless_shell-1208/chrome-headless-shell-linux64/chrome-headless-shell
╔═════════════════════════════════════════════════════════════════════════╗
║ Looks like Playwright Test or Playwright was just installed or updated. ║
║ Please run the following command to download new browsers: ║
║ ║
║ npx playwright install ║
║ ║
║ <3 Playwright Team ║
╚═════════════════════════════════════════════════════════════════════════╝
❌ authenticate as admin Error: browserType.launch: Executable doesn't exist at /home/runner/.cache/ms-playwright/chromium_headless_shell-1208/chrome-headless-shell-linux64/chrome-headless-shell
╔═════════════════════════════════════════════════════════════════════════╗
║ Looks like Playwright Test or Playwright was just installed or updated. ║
║ Please run the following command to download new browsers: ║
║ ║
║ npx playwright install ║
║ ║
║ <3 Playwright Team ║
╚═════════════════════════════════════════════════════════════════════════╝
❌ authenticate as publisher Error: browserType.launch: Executable doesn't exist at /home/runner/.cache/ms-playwright/chromium_headless_shell-1208/chrome-headless-shell-linux64/chrome-headless-shell
╔═════════════════════════════════════════════════════════════════════════╗
║ Looks like Playwright Test or Playwright was just installed or updated. ║
║ Please run the following command to download new browsers: ║
║ ║
║ npx playwright install ║
║ ║
║ <3 Playwright Team ║
╚═════════════════════════════════════════════════════════════════════════╝
❌ authenticate as user_in_group_b Error: browserType.launch: Executable doesn't exist at /home/runner/.cache/ms-playwright/chromium_headless_shell-1208/chrome-headless-shell-linux64/chrome-headless-shell
╔═════════════════════════════════════════════════════════════════════════╗
║ Looks like Playwright Test or Playwright was just installed or updated. ║
║ Please run the following command to download new browsers: ║
║ ║
║ npx playwright install ║
║ ║
║ <3 Playwright Team ║
╚═════════════════════════════════════════════════════════════════════════╝
❌ authenticate as read only Error: browserType.launch: Executable doesn't exist at /home/runner/.cache/ms-playwright/chromium_headless_shell-1208/chrome-headless-shell-linux64/chrome-headless-shell
╔═════════════════════════════════════════════════════════════════════════╗
║ Looks like Playwright Test or Playwright was just installed or updated. ║
║ Please run the following command to download new browsers: ║
║ ║
║ npx playwright install ║
║ ║
║ <3 Playwright Team ║
╚═════════════════════════════════════════════════════════════════════════╝

🍂 No flaky tests in this run.

Github Test Reporter by CTRF 💚


All Playwright tests BLEEDING_EDGE

Summary

Tests 📝 Passed ✅ Failed ❌ Skipped ⏭️ Other ❓ Flaky 🍂 Duration ⏱️
5 0 5 0 0 0 11.1s

Failed Tests

Failed Tests ❌ Fail Message
❌ authenticate as user_in_group_a Error: browserType.launch: Executable doesn't exist at /home/runner/.cache/ms-playwright/chromium_headless_shell-1208/chrome-headless-shell-linux64/chrome-headless-shell
╔═════════════════════════════════════════════════════════════════════════╗
║ Looks like Playwright Test or Playwright was just installed or updated. ║
║ Please run the following command to download new browsers: ║
║ ║
║ npx playwright install ║
║ ║
║ <3 Playwright Team ║
╚═════════════════════════════════════════════════════════════════════════╝
❌ authenticate as admin Error: browserType.launch: Executable doesn't exist at /home/runner/.cache/ms-playwright/chromium_headless_shell-1208/chrome-headless-shell-linux64/chrome-headless-shell
╔═════════════════════════════════════════════════════════════════════════╗
║ Looks like Playwright Test or Playwright was just installed or updated. ║
║ Please run the following command to download new browsers: ║
║ ║
║ npx playwright install ║
║ ║
║ <3 Playwright Team ║
╚═════════════════════════════════════════════════════════════════════════╝
❌ authenticate as publisher Error: browserType.launch: Executable doesn't exist at /home/runner/.cache/ms-playwright/chromium_headless_shell-1208/chrome-headless-shell-linux64/chrome-headless-shell
╔═════════════════════════════════════════════════════════════════════════╗
║ Looks like Playwright Test or Playwright was just installed or updated. ║
║ Please run the following command to download new browsers: ║
║ ║
║ npx playwright install ║
║ ║
║ <3 Playwright Team ║
╚═════════════════════════════════════════════════════════════════════════╝
❌ authenticate as user_in_group_b Error: browserType.launch: Executable doesn't exist at /home/runner/.cache/ms-playwright/chromium_headless_shell-1208/chrome-headless-shell-linux64/chrome-headless-shell
╔═════════════════════════════════════════════════════════════════════════╗
║ Looks like Playwright Test or Playwright was just installed or updated. ║
║ Please run the following command to download new browsers: ║
║ ║
║ npx playwright install ║
║ ║
║ <3 Playwright Team ║
╚═════════════════════════════════════════════════════════════════════════╝
❌ authenticate as read only Error: browserType.launch: Executable doesn't exist at /home/runner/.cache/ms-playwright/chromium_headless_shell-1208/chrome-headless-shell-linux64/chrome-headless-shell
╔═════════════════════════════════════════════════════════════════════════╗
║ Looks like Playwright Test or Playwright was just installed or updated. ║
║ Please run the following command to download new browsers: ║
║ ║
║ npx playwright install ║
║ ║
║ <3 Playwright Team ║
╚═════════════════════════════════════════════════════════════════════════╝

🍂 No flaky tests in this run.

Github Test Reporter by CTRF 💚


All Playwright tests LEGACY

Summary

Tests 📝 Passed ✅ Failed ❌ Skipped ⏭️ Other ❓ Flaky 🍂 Duration ⏱️
5 0 5 0 0 0 10.7s

Failed Tests

Failed Tests ❌ Fail Message
❌ authenticate as user_in_group_a Error: browserType.launch: Executable doesn't exist at /home/runner/.cache/ms-playwright/chromium_headless_shell-1208/chrome-headless-shell-linux64/chrome-headless-shell
╔═════════════════════════════════════════════════════════════════════════╗
║ Looks like Playwright Test or Playwright was just installed or updated. ║
║ Please run the following command to download new browsers: ║
║ ║
║ npx playwright install ║
║ ║
║ <3 Playwright Team ║
╚═════════════════════════════════════════════════════════════════════════╝
❌ authenticate as admin Error: browserType.launch: Executable doesn't exist at /home/runner/.cache/ms-playwright/chromium_headless_shell-1208/chrome-headless-shell-linux64/chrome-headless-shell
╔═════════════════════════════════════════════════════════════════════════╗
║ Looks like Playwright Test or Playwright was just installed or updated. ║
║ Please run the following command to download new browsers: ║
║ ║
║ npx playwright install ║
║ ║
║ <3 Playwright Team ║
╚═════════════════════════════════════════════════════════════════════════╝
❌ authenticate as publisher Error: browserType.launch: Executable doesn't exist at /home/runner/.cache/ms-playwright/chromium_headless_shell-1208/chrome-headless-shell-linux64/chrome-headless-shell
╔═════════════════════════════════════════════════════════════════════════╗
║ Looks like Playwright Test or Playwright was just installed or updated. ║
║ Please run the following command to download new browsers: ║
║ ║
║ npx playwright install ║
║ ║
║ <3 Playwright Team ║
╚═════════════════════════════════════════════════════════════════════════╝
❌ authenticate as user_in_group_b Error: browserType.launch: Executable doesn't exist at /home/runner/.cache/ms-playwright/chromium_headless_shell-1208/chrome-headless-shell-linux64/chrome-headless-shell
╔═════════════════════════════════════════════════════════════════════════╗
║ Looks like Playwright Test or Playwright was just installed or updated. ║
║ Please run the following command to download new browsers: ║
║ ║
║ npx playwright install ║
║ ║
║ <3 Playwright Team ║
╚═════════════════════════════════════════════════════════════════════════╝
❌ authenticate as read only Error: browserType.launch: Executable doesn't exist at /home/runner/.cache/ms-playwright/chromium_headless_shell-1208/chrome-headless-shell-linux64/chrome-headless-shell
╔═════════════════════════════════════════════════════════════════════════╗
║ Looks like Playwright Test or Playwright was just installed or updated. ║
║ Please run the following command to download new browsers: ║
║ ║
║ npx playwright install ║
║ ║
║ <3 Playwright Team ║
╚═════════════════════════════════════════════════════════════════════════╝

🍂 No flaky tests in this run.

Github Test Reporter by CTRF 💚


All Playwright tests BLEEDING_EDGE

Summary

Tests 📝 Passed ✅ Failed ❌ Skipped ⏭️ Other ❓ Flaky 🍂 Duration ⏱️
5 0 5 0 0 0 11.2s

Failed Tests

Failed Tests ❌ Fail Message
❌ authenticate as user_in_group_a Error: browserType.launch: Executable doesn't exist at /home/runner/.cache/ms-playwright/chromium_headless_shell-1208/chrome-headless-shell-linux64/chrome-headless-shell
╔═════════════════════════════════════════════════════════════════════════╗
║ Looks like Playwright Test or Playwright was just installed or updated. ║
║ Please run the following command to download new browsers: ║
║ ║
║ npx playwright install ║
║ ║
║ <3 Playwright Team ║
╚═════════════════════════════════════════════════════════════════════════╝
❌ authenticate as admin Error: browserType.launch: Executable doesn't exist at /home/runner/.cache/ms-playwright/chromium_headless_shell-1208/chrome-headless-shell-linux64/chrome-headless-shell
╔═════════════════════════════════════════════════════════════════════════╗
║ Looks like Playwright Test or Playwright was just installed or updated. ║
║ Please run the following command to download new browsers: ║
║ ║
║ npx playwright install ║
║ ║
║ <3 Playwright Team ║
╚═════════════════════════════════════════════════════════════════════════╝
❌ authenticate as publisher Error: browserType.launch: Executable doesn't exist at /home/runner/.cache/ms-playwright/chromium_headless_shell-1208/chrome-headless-shell-linux64/chrome-headless-shell
╔═════════════════════════════════════════════════════════════════════════╗
║ Looks like Playwright Test or Playwright was just installed or updated. ║
║ Please run the following command to download new browsers: ║
║ ║
║ npx playwright install ║
║ ║
║ <3 Playwright Team ║
╚═════════════════════════════════════════════════════════════════════════╝
❌ authenticate as user_in_group_b Error: browserType.launch: Executable doesn't exist at /home/runner/.cache/ms-playwright/chromium_headless_shell-1208/chrome-headless-shell-linux64/chrome-headless-shell
╔═════════════════════════════════════════════════════════════════════════╗
║ Looks like Playwright Test or Playwright was just installed or updated. ║
║ Please run the following command to download new browsers: ║
║ ║
║ npx playwright install ║
║ ║
║ <3 Playwright Team ║
╚═════════════════════════════════════════════════════════════════════════╝
❌ authenticate as read only Error: browserType.launch: Executable doesn't exist at /home/runner/.cache/ms-playwright/chromium_headless_shell-1208/chrome-headless-shell-linux64/chrome-headless-shell
╔═════════════════════════════════════════════════════════════════════════╗
║ Looks like Playwright Test or Playwright was just installed or updated. ║
║ Please run the following command to download new browsers: ║
║ ║
║ npx playwright install ║
║ ║
║ <3 Playwright Team ║
╚═════════════════════════════════════════════════════════════════════════╝

🍂 No flaky tests in this run.

Github Test Reporter by CTRF 💚


All Playwright tests LEGACY

Summary

Tests 📝 Passed ✅ Failed ❌ Skipped ⏭️ Other ❓ Flaky 🍂 Duration ⏱️
5 0 5 0 0 0 10.8s

Failed Tests

Failed Tests ❌ Fail Message
❌ authenticate as user_in_group_a Error: browserType.launch: Executable doesn't exist at /home/runner/.cache/ms-playwright/chromium_headless_shell-1208/chrome-headless-shell-linux64/chrome-headless-shell
╔═════════════════════════════════════════════════════════════════════════╗
║ Looks like Playwright Test or Playwright was just installed or updated. ║
║ Please run the following command to download new browsers: ║
║ ║
║ npx playwright install ║
║ ║
║ <3 Playwright Team ║
╚═════════════════════════════════════════════════════════════════════════╝
❌ authenticate as admin Error: browserType.launch: Executable doesn't exist at /home/runner/.cache/ms-playwright/chromium_headless_shell-1208/chrome-headless-shell-linux64/chrome-headless-shell
╔═════════════════════════════════════════════════════════════════════════╗
║ Looks like Playwright Test or Playwright was just installed or updated. ║
║ Please run the following command to download new browsers: ║
║ ║
║ npx playwright install ║
║ ║
║ <3 Playwright Team ║
╚═════════════════════════════════════════════════════════════════════════╝
❌ authenticate as publisher Error: browserType.launch: Executable doesn't exist at /home/runner/.cache/ms-playwright/chromium_headless_shell-1208/chrome-headless-shell-linux64/chrome-headless-shell
╔═════════════════════════════════════════════════════════════════════════╗
║ Looks like Playwright Test or Playwright was just installed or updated. ║
║ Please run the following command to download new browsers: ║
║ ║
║ npx playwright install ║
║ ║
║ <3 Playwright Team ║
╚═════════════════════════════════════════════════════════════════════════╝
❌ authenticate as user_in_group_b Error: browserType.launch: Executable doesn't exist at /home/runner/.cache/ms-playwright/chromium_headless_shell-1208/chrome-headless-shell-linux64/chrome-headless-shell
╔═════════════════════════════════════════════════════════════════════════╗
║ Looks like Playwright Test or Playwright was just installed or updated. ║
║ Please run the following command to download new browsers: ║
║ ║
║ npx playwright install ║
║ ║
║ <3 Playwright Team ║
╚═════════════════════════════════════════════════════════════════════════╝
❌ authenticate as read only Error: browserType.launch: Executable doesn't exist at /home/runner/.cache/ms-playwright/chromium_headless_shell-1208/chrome-headless-shell-linux64/chrome-headless-shell
╔═════════════════════════════════════════════════════════════════════════╗
║ Looks like Playwright Test or Playwright was just installed or updated. ║
║ Please run the following command to download new browsers: ║
║ ║
║ npx playwright install ║
║ ║
║ <3 Playwright Team ║
╚═════════════════════════════════════════════════════════════════════════╝

🍂 No flaky tests in this run.

Github Test Reporter by CTRF 💚


All Playwright tests LEGACY

Summary

Tests 📝 Passed ✅ Failed ❌ Skipped ⏭️ Other ❓ Flaky 🍂 Duration ⏱️
5 0 5 0 0 0 10.7s

Failed Tests

Failed Tests ❌ Fail Message
❌ authenticate as user_in_group_a Error: browserType.launch: Executable doesn't exist at /home/runner/.cache/ms-playwright/chromium_headless_shell-1208/chrome-headless-shell-linux64/chrome-headless-shell
╔═════════════════════════════════════════════════════════════════════════╗
║ Looks like Playwright Test or Playwright was just installed or updated. ║
║ Please run the following command to download new browsers: ║
║ ║
║ npx playwright install ║
║ ║
║ <3 Playwright Team ║
╚═════════════════════════════════════════════════════════════════════════╝
❌ authenticate as admin Error: browserType.launch: Executable doesn't exist at /home/runner/.cache/ms-playwright/chromium_headless_shell-1208/chrome-headless-shell-linux64/chrome-headless-shell
╔═════════════════════════════════════════════════════════════════════════╗
║ Looks like Playwright Test or Playwright was just installed or updated. ║
║ Please run the following command to download new browsers: ║
║ ║
║ npx playwright install ║
║ ║
║ <3 Playwright Team ║
╚═════════════════════════════════════════════════════════════════════════╝
❌ authenticate as publisher Error: browserType.launch: Executable doesn't exist at /home/runner/.cache/ms-playwright/chromium_headless_shell-1208/chrome-headless-shell-linux64/chrome-headless-shell
╔═════════════════════════════════════════════════════════════════════════╗
║ Looks like Playwright Test or Playwright was just installed or updated. ║
║ Please run the following command to download new browsers: ║
║ ║
║ npx playwright install ║
║ ║
║ <3 Playwright Team ║
╚═════════════════════════════════════════════════════════════════════════╝
❌ authenticate as user_in_group_b Error: browserType.launch: Executable doesn't exist at /home/runner/.cache/ms-playwright/chromium_headless_shell-1208/chrome-headless-shell-linux64/chrome-headless-shell
╔═════════════════════════════════════════════════════════════════════════╗
║ Looks like Playwright Test or Playwright was just installed or updated. ║
║ Please run the following command to download new browsers: ║
║ ║
║ npx playwright install ║
║ ║
║ <3 Playwright Team ║
╚═════════════════════════════════════════════════════════════════════════╝
❌ authenticate as read only Error: browserType.launch: Executable doesn't exist at /home/runner/.cache/ms-playwright/chromium_headless_shell-1208/chrome-headless-shell-linux64/chrome-headless-shell
╔═════════════════════════════════════════════════════════════════════════╗
║ Looks like Playwright Test or Playwright was just installed or updated. ║
║ Please run the following command to download new browsers: ║
║ ║
║ npx playwright install ║
║ ║
║ <3 Playwright Team ║
╚═════════════════════════════════════════════════════════════════════════╝

🍂 No flaky tests in this run.

Github Test Reporter by CTRF 💚


All Playwright tests BLEEDING_EDGE

Summary

Tests 📝 Passed ✅ Failed ❌ Skipped ⏭️ Other ❓ Flaky 🍂 Duration ⏱️
5 0 5 0 0 0 10.4s

Failed Tests

Failed Tests ❌ Fail Message
❌ authenticate as user_in_group_a Error: browserType.launch: Executable doesn't exist at /home/runner/.cache/ms-playwright/chromium_headless_shell-1208/chrome-headless-shell-linux64/chrome-headless-shell
╔═════════════════════════════════════════════════════════════════════════╗
║ Looks like Playwright Test or Playwright was just installed or updated. ║
║ Please run the following command to download new browsers: ║
║ ║
║ npx playwright install ║
║ ║
║ <3 Playwright Team ║
╚═════════════════════════════════════════════════════════════════════════╝
❌ authenticate as admin Error: browserType.launch: Executable doesn't exist at /home/runner/.cache/ms-playwright/chromium_headless_shell-1208/chrome-headless-shell-linux64/chrome-headless-shell
╔═════════════════════════════════════════════════════════════════════════╗
║ Looks like Playwright Test or Playwright was just installed or updated. ║
║ Please run the following command to download new browsers: ║
║ ║
║ npx playwright install ║
║ ║
║ <3 Playwright Team ║
╚═════════════════════════════════════════════════════════════════════════╝
❌ authenticate as publisher Error: browserType.launch: Executable doesn't exist at /home/runner/.cache/ms-playwright/chromium_headless_shell-1208/chrome-headless-shell-linux64/chrome-headless-shell
╔═════════════════════════════════════════════════════════════════════════╗
║ Looks like Playwright Test or Playwright was just installed or updated. ║
║ Please run the following command to download new browsers: ║
║ ║
║ npx playwright install ║
║ ║
║ <3 Playwright Team ║
╚═════════════════════════════════════════════════════════════════════════╝
❌ authenticate as user_in_group_b Error: browserType.launch: Executable doesn't exist at /home/runner/.cache/ms-playwright/chromium_headless_shell-1208/chrome-headless-shell-linux64/chrome-headless-shell
╔═════════════════════════════════════════════════════════════════════════╗
║ Looks like Playwright Test or Playwright was just installed or updated. ║
║ Please run the following command to download new browsers: ║
║ ║
║ npx playwright install ║
║ ║
║ <3 Playwright Team ║
╚═════════════════════════════════════════════════════════════════════════╝
❌ authenticate as read only Error: browserType.launch: Executable doesn't exist at /home/runner/.cache/ms-playwright/chromium_headless_shell-1208/chrome-headless-shell-linux64/chrome-headless-shell
╔═════════════════════════════════════════════════════════════════════════╗
║ Looks like Playwright Test or Playwright was just installed or updated. ║
║ Please run the following command to download new browsers: ║
║ ║
║ npx playwright install ║
║ ║
║ <3 Playwright Team ║
╚═════════════════════════════════════════════════════════════════════════╝

🍂 No flaky tests in this run.

Github Test Reporter by CTRF 💚


All Playwright tests LEGACY

Summary

Tests 📝 Passed ✅ Failed ❌ Skipped ⏭️ Other ❓ Flaky 🍂 Duration ⏱️
526 523 1 2 0 3 15m 53s

Failed Tests

Failed Tests ❌ Fail Message

Flaky Tests

Flaky Tests 🍂 Retries
Manual play 2
Switcher from map to map 1
Build permalink, reload and apply one 1

Flaky Rate

Overall Flakiness 0.75%    ±0
Test 📝 Flaky Attempts 🍂 Total Attempts 🎯 Flaky Rate (%) 📈
Manual play 2 3 66.67    ↑66.67
Switcher from map to map 1 2 50.00    ↑50.00
Build permalink, reload and apply one 1 2 50.00    ↑50.00

Github Test Reporter by CTRF 💚


All Playwright tests BLEEDING_EDGE

Summary

Tests 📝 Passed ✅ Failed ❌ Skipped ⏭️ Other ❓ Flaky 🍂 Duration ⏱️
526 523 1 2 0 4 15m 16s

Failed Tests

Failed Tests ❌ Fail Message

Flaky Tests

Flaky Tests 🍂 Retries
File preview with path as config 1
Only IGN 1
Switcher from map to map 1
Build permalink, reload and apply one 1

Flaky Rate

Overall Flakiness 0.75%    ±0
Test 📝 Flaky Attempts 🍂 Total Attempts 🎯 Flaky Rate (%) 📈
File preview with path as config 1 2 50.00    ↑50.00
Only IGN 1 2 50.00    ↑50.00
Switcher from map to map 1 2 50.00    ↑50.00
Build permalink, reload and apply one 1 2 50.00    ↑50.00

Github Test Reporter by CTRF 💚


All Playwright tests LEGACY

Summary

Tests 📝 Passed ✅ Failed ❌ Skipped ⏭️ Other ❓ Flaky 🍂 Duration ⏱️
526 523 1 2 0 2 14m 48s

Failed Tests

Failed Tests ❌ Fail Message

Flaky Tests

Flaky Tests 🍂 Retries
Switcher from map to map 1
Build permalink, reload and apply one 1

Flaky Rate

Overall Flakiness 0.38%    ±0
Test 📝 Flaky Attempts 🍂 Total Attempts 🎯 Flaky Rate (%) 📈
Switcher from map to map 1 2 50.00    ↑50.00
Build permalink, reload and apply one 1 2 50.00    ↑50.00

Github Test Reporter by CTRF 💚


All Playwright tests BLEEDING_EDGE

Summary

Tests 📝 Passed ✅ Failed ❌ Skipped ⏭️ Other ❓ Flaky 🍂 Duration ⏱️
526 523 1 2 0 3 15m 6s

Failed Tests

Failed Tests ❌ Fail Message

Flaky Tests

Flaky Tests 🍂 Retries
Catch GetLegendGraphic requests and timeout on GetLegendGraphic with multi layers 1
Switcher from map to map 1
Build permalink, reload and apply one 1

Flaky Rate

Overall Flakiness 0.57%    ±0
Test 📝 Flaky Attempts 🍂 Total Attempts 🎯 Flaky Rate (%) 📈
Catch GetLegendGraphic requests and timeout on GetLegendGraphic with multi layers 1 2 50.00    ↑50.00
Switcher from map to map 1 2 50.00    ↑50.00
Build permalink, reload and apply one 1 2 50.00    ↑50.00

Github Test Reporter by CTRF 💚


All Playwright tests LEGACY

Summary

Tests 📝 Passed ✅ Failed ❌ Skipped ⏭️ Other ❓ Flaky 🍂 Duration ⏱️
539 536 1 2 0 6 15m 30s

Failed Tests

Failed Tests ❌ Fail Message

Flaky Tests

Flaky Tests 🍂 Retries
Should select / filter / refresh with map interaction 1
File preview with path as config 1
With selection tool 1
Switcher from map to map 1
Build permalink, reload and apply one 1
Print requests with redlining 1

Flaky Rate

Overall Flakiness 1.10%    ±0
Test 📝 Flaky Attempts 🍂 Total Attempts 🎯 Flaky Rate (%) 📈
Should select / filter / refresh with map interaction 1 2 50.00    ↑50.00
File preview with path as config 1 2 50.00    ↑50.00
With selection tool 1 2 50.00    ↑50.00
Switcher from map to map 1 2 50.00    ↑50.00
Build permalink, reload and apply one 1 2 50.00    ↑50.00
Print requests with redlining 1 2 50.00    ↑50.00

Github Test Reporter by CTRF 💚


All Playwright tests BLEEDING_EDGE

Summary

Tests 📝 Passed ✅ Failed ❌ Skipped ⏭️ Other ❓ Flaky 🍂 Duration ⏱️
539 536 1 2 0 8 16m 55s

Failed Tests

Failed Tests ❌ Fail Message

Flaky Tests

Flaky Tests 🍂 Retries
Check attribute table editable features - anonymous 1
File preview with path as config 1
#0 Layer export with __anonymous user logged in 1
#3 Layer export with user_in_group_a user logged in 1
Catch GetLegendGraphic requests and timeout on GetLegendGraphic with multi layers 1
Switcher from map to map 1
Build permalink, reload and apply one 1
Children are placed in the correct div container 1

Flaky Rate

Overall Flakiness 1.46%    ±0
Test 📝 Flaky Attempts 🍂 Total Attempts 🎯 Flaky Rate (%) 📈
Check attribute table editable features - anonymous 1 2 50.00    ↑50.00
File preview with path as config 1 2 50.00    ↑50.00
Catch GetLegendGraphic requests and timeout on GetLegendGraphic with multi layers 1 2 50.00    ↑50.00
Switcher from map to map 1 2 50.00    ↑50.00
Build permalink, reload and apply one 1 2 50.00    ↑50.00
Children are placed in the correct div container 1 2 50.00    ↑50.00
#0 Layer export with __anonymous user logged in 1 3 33.33    ↑33.33
#3 Layer export with user_in_group_a user logged in 1 3 33.33    ↑33.33
#0 Layer export with __anonymous user logged in 1 3 33.33    ↑33.33
#3 Layer export with user_in_group_a user logged in 1 3 33.33    ↑33.33

Github Test Reporter by CTRF 💚

@github-actions
Copy link
Copy Markdown

github-actions Bot commented Mar 9, 2026

The Lizmap project highly values your contribution and would love to see this work merged! Unfortunately this PR has not had any activity in the last 2 months and is being automatically marked as "stale".
If there is no further activity on this pull request, it will be closed in two weeks.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

QGIS Server tests unit tests and docker configuration for tests

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants