Use QJazz in tests

[dmarteau]

QJazz QGIS server in tests.

[Gustry]

I tried it locally, it works.
Still an issue on CI for now.

Will tags such as 3.34, 3.40 will be available on Docker hubs later ?

[Gustry]

• Needed QGIS Server plugins are not installed in the current state of this PR. That's why the CI is not working. It was working locally, because my plugins were already existing before.
• Can you remove the script tests/add_server_plugins.sh ?
• In tests/add_server_plugins.sh, we need to use to the custom repository for QGIS plugins. Please do the change
• Will tags such as 3.34, 3.40 will be available on Docker hubs ? https://hub.docker.com/r/3liz/qjazz/tags

[Gustry]

Is-it not missing the mount for QGIS plugins in map container ? But it doesn't seem to be enough to have QGIS server plugins installed, even when rebuilding/starting containers.

[Gustry]

For testing purpose, I have pressed the rebased button, to have latest commits from master.

[dmarteau]

Is-it not missing the mount for QGIS plugins in map container ? But it doesn't seem to be enough to have QGIS server plugins installed, even when rebuilding/starting containers.

Rules for plugins are the following:

1. Plugins locations should be mounted somewhere and declared in config (or QGIS_PLUGINPATH).
2. Wether or not plugin are installed at startup depends on configuration settings ('auto' vs 'external').
3. Allowed plugins must be explicitely declared in configuration settings (see tests/docker-conf/qgis-server.toml)

[dmarteau]

• Will tags such as 3.34, 3.40 will be available on Docker hubs ?

On release.

[dmarteau]

There is tests checking OnlineResource: they seems to be wrong to me.

The qjazz proxy handle standard Forwarded headers as defined in RFC 7239 and legacy X-Forwarded-Host and X-Forwarded-Proto.

The path returned in the service response may be changed with the appropriate X-Qgis-Service-Url header (See the documentation for the QGIS_SERVER_SERVICE_URL environment variable.

[dmarteau]

Found that QGIS does not stick to standard and handle headers in case sensitive way, at least for 'X-Qgis-*' headers.

[dmarteau]

I cannot check what's wrong on failed test, i need at least the request that failed if this is is a request to the QGIS service.

[dmarteau]

@Gustry : please check the timeout error on Playwright test, with proper rights there is no issue locally with the url I can guess from the details.

[Gustry]

Something is very slow in this PR.
At the end of the CI, there will be some artifacts generated : https://github.com/3liz/lizmap-web-client/actions/runs/12785872522?pr=5168, especially all QGIS servers logs, from the container lizmapBRANCH_test_qgis.
Should we also save logs from lizmapBRANCH_test_qgis_rpc container ?

[Gustry]

Is-it a typo ?

[dmarteau]

Something is very slow in this PR. At the end of the CI, there will be some artifacts generated : https://github.com/3liz/lizmap-web-client/actions/runs/12785872522?pr=5168, especially all QGIS servers logs, from the container lizmapBRANCH_test_qgis. Should we also save logs from lizmapBRANCH_test_qgis_rpc container ?

Yes, this where we log QGIS opérations.

[dmarteau]

Where can I find logs related to failed tests ?

[Gustry]

Can you rebase on top of master, I have merged #5203

All logs are in the artifacts, for example, for the last run, after 194 minutes :(, artifacts are on the page summary https://github.com/3liz/lizmap-web-client/actions/runs/12785872522?pr=5168 at the bottom, direct link to ZIP :

https://github.com/3liz/lizmap-web-client/actions/runs/12785872522/artifacts/2434513285

The timestamp in the QGIS Server logs are very slow.

Yes, this where we log QGIS opérations.

So can you add in your PR .github/workflows/e2e_tests.yml L220:

docker logs lizmap${{ env.LZMBRANCH }}_test_qgis_rpc &> /tmp/e2e/docker/qgis-server-rpc.log | true

[dmarteau]

So can you add in your PR .github/workflows/e2e_tests.yml L220:

docker logs lizmap${{ env.LZMBRANCH }}_test_qgis_rpc &> /tmp/e2e/docker/qgis-server-rpc.log | true

I don't understand where I should exacty set this line: shouldn't it be in a job ? It seems wrong to me jush to add the line add the end of the file.

[Gustry]

Thanks, tests are finally passing.
Last thing to change is the plugin repository to change.

Will tags such as 3.34, 3.40 will be available on Docker hubs ? https://hub.docker.com/r/3liz/qjazz/tags

So you mean when a git tag will be made on qjazz repository, it will be available on docker hub ?

[Gustry]

@dmarteau Discussion we got with @rldhont and @mdouchin :

Do you think it's possible to add your work in another docker-compose file ? with inheritance ?
We would need to keep the tests/add_server_plugins.sh, make a copy of tests/docker-conf/phpfpm/lizmapConfig.ini.php and would be nearly able to run both stacks Py-QGIS-Server and QJazz ?

[dmarteau]

Do you think it's possible to add your work in another docker-compose file ? with inheritance ? We would need to keep the tests/add_server_plugins.sh, make a copy of tests/docker-conf/phpfpm/lizmapConfig.ini.php and would be nearly able to run both stacks Py-QGIS-Server and QJazz ?

I don't see the benefit unless making things uneccessary complicated. Just keep that
branch to draft and sync with master until we officially move to QJazz as stable backend since the backend for the LWC tests has only to be an acceptable OWS/QGIS server proxy.