Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add to irrelevant_files list #217

Open
wants to merge 3 commits into
base: master
Choose a base branch
from
Open

Add to irrelevant_files list #217

wants to merge 3 commits into from

Conversation

ayefimov-1
Copy link
Contributor

Add to irrelevant_files list for graphing, logging and autoscaling jobs

Copy link

Zuul encountered a syntax error while parsing its
configuration in the repo infrawatch/feature-verification-tests on branch master. The
problem was:

while parsing a block mapping
in "infrawatch/feature-verification-tests/.zuul.yaml@master", line 48, column 5
did not find expected key
in "infrawatch/feature-verification-tests/.zuul.yaml@master", line 62, column 5

Copy link

Zuul encountered a syntax error while parsing its
configuration in the repo infrawatch/feature-verification-tests on branch master. The
problem was:

while parsing a block mapping
in "infrawatch/feature-verification-tests/.zuul.yaml@master", line 61, column 7
did not find expected key
in "infrawatch/feature-verification-tests/.zuul.yaml@master", line 62, column 7

1 similar comment
Copy link

Zuul encountered a syntax error while parsing its
configuration in the repo infrawatch/feature-verification-tests on branch master. The
problem was:

while parsing a block mapping
in "infrawatch/feature-verification-tests/.zuul.yaml@master", line 61, column 7
did not find expected key
in "infrawatch/feature-verification-tests/.zuul.yaml@master", line 62, column 7

Copy link

Zuul encountered a syntax error while parsing its
configuration in the repo infrawatch/feature-verification-tests on branch master. The
problem was:

mapping values are not allowed in this context
in "infrawatch/feature-verification-tests/.zuul.yaml@master", line 60, column 25

Copy link

Zuul encountered a syntax error while parsing its
configuration in the repo infrawatch/feature-verification-tests on branch master. The
problem was:

while constructing a mapping
in "infrawatch/feature-verification-tests/.zuul.yaml@master", line 61, column 9
expected a mapping for merging, but found scalar
in "infrawatch/feature-verification-tests/.zuul.yaml@master", line 32, column 9

Copy link

Zuul encountered a syntax error while parsing its
configuration in the repo infrawatch/feature-verification-tests on branch master. The
problem was:

expected a dictionary @ data['irrelevant-files'][0]

The problem appears in the the "functional-logging-tests-osp18" job stanza:

job:
name: functional-logging-tests-osp18
parent: telemetry-operator-multinode-logging
description: |
Run the logging functional tests on osp18
vars:
cifmw_extras:
- "@{{ ansible_user_dir }}/{{ zuul.projects['github.com/openstack-k8s-operators/ci-framework'].src_dir }}/scenarios/centos-9/multinode-ci.yml"
- "@{{ ansible_user_dir }}/{{ zuul.projects['github.com/openstack-k8s-operators/telemetry-operator'].src_dir }}/ci/vars-logging.yml"
...

in "infrawatch/feature-verification-tests/.zuul.yaml@master", line 47

Copy link

Zuul encountered a syntax error while parsing its
configuration in the repo infrawatch/feature-verification-tests on branch master. The
problem was:

while constructing a mapping
in "infrawatch/feature-verification-tests/.zuul.yaml@master", line 61, column 9
expected a mapping for merging, but found scalar
in "infrawatch/feature-verification-tests/.zuul.yaml@master", line 32, column 9

Copy link

Zuul encountered a syntax error while parsing its
configuration in the repo infrawatch/feature-verification-tests on branch master. The
problem was:

while parsing a block mapping
in "infrawatch/feature-verification-tests/.zuul.yaml@master", line 61, column 7
did not find expected key
in "infrawatch/feature-verification-tests/.zuul.yaml@master", line 62, column 7

Copy link

Zuul encountered a syntax error while parsing its
configuration in the repo infrawatch/feature-verification-tests on branch master. The
problem was:

while constructing a mapping
in "infrawatch/feature-verification-tests/.zuul.yaml@master", line 61, column 9
expected a mapping for merging, but found scalar
in "infrawatch/feature-verification-tests/.zuul.yaml@master", line 32, column 9

Copy link

Zuul encountered a syntax error while parsing its
configuration in the repo infrawatch/feature-verification-tests on branch master. The
problem was:

expected a dictionary @ data['irrelevant-files'][0]

The problem appears in the the "functional-logging-tests-osp18" job stanza:

job:
name: functional-logging-tests-osp18
parent: telemetry-operator-multinode-logging
description: |
Run the logging functional tests on osp18
vars:
cifmw_extras:
- "@{{ ansible_user_dir }}/{{ zuul.projects['github.com/openstack-k8s-operators/ci-framework'].src_dir }}/scenarios/centos-9/multinode-ci.yml"
- "@{{ ansible_user_dir }}/{{ zuul.projects['github.com/openstack-k8s-operators/telemetry-operator'].src_dir }}/ci/vars-logging.yml"
...

in "infrawatch/feature-verification-tests/.zuul.yaml@master", line 47

Copy link

Zuul encountered a syntax error while parsing its
configuration in the repo infrawatch/feature-verification-tests on branch master. The
problem was:

while parsing a block mapping
in "infrawatch/feature-verification-tests/.zuul.yaml@master", line 48, column 5
did not find expected key
in "infrawatch/feature-verification-tests/.zuul.yaml@master", line 62, column 7

Copy link

Zuul encountered a syntax error while parsing its
configuration in the repo infrawatch/feature-verification-tests on branch master. The
problem was:

while parsing a block mapping
in "infrawatch/feature-verification-tests/.zuul.yaml@master", line 48, column 5
did not find expected key
in "infrawatch/feature-verification-tests/.zuul.yaml@master", line 61, column 7

Copy link

Zuul encountered a syntax error while parsing its
configuration in the repo infrawatch/feature-verification-tests on branch master. The
problem was:

while parsing a block mapping
in "infrawatch/feature-verification-tests/.zuul.yaml@master", line 2, column 1
did not find expected key
in "infrawatch/feature-verification-tests/.zuul.yaml@master", line 18, column 1

Copy link

Zuul encountered a syntax error while parsing its
configuration in the repo infrawatch/feature-verification-tests on branch master. The
problem was:

while parsing a block mapping
in "infrawatch/feature-verification-tests/.zuul.yaml@master", line 49, column 5
did not find expected key
in "infrawatch/feature-verification-tests/.zuul.yaml@master", line 62, column 7

@@ -58,7 +58,26 @@
roles:
- zuul: github.com/openstack-k8s-operators/ci-framework
required-projects: *required_projects
irrelevant-files: *irrelevant_files
irrelevant-files:
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This looks less than ideal. Can a combination of file and irrelevant-files be used?

Or perhaps a yaml anchor?
I looked at this article: https://medium.com/@kinghuang/docker-compose-anchors-aliases-extensions-a1e4105d70bd, I think something like this should work

irrelevant-files: &irrelevant_files 
    - the
    - list
    - of
    - files

### some other content

- irrelevant-files:
    - <<: *irrelevant_files
    - another
    - file

Copy link
Contributor Author

@ayefimov-1 ayefimov-1 Feb 4, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Tried the following with failure:

######################################
    irrelevant-files:
      <<: *irrelevant_files
      - roles/telemetry_graphing
      - roles/telemetry_autoscaling
      - roles/telemetry_verify_metrics
#   (LINT FAILURE)
######################################
    irrelevant-files:
      - <<: *irrelevant_files
      - roles/telemetry_graphing
      - roles/telemetry_autoscaling
      - roles/telemetry_verify_metrics
#   (Lint FAILURE)
######################################
    irrelevant-files:
      - *irrelevant_files
      - roles/telemetry_graphing
      - roles/telemetry_autoscaling
      - roles/telemetry_verify_metrics
#   (Build failure)  expected a dictionary @ data['irrelevant-files'][0]
#######################################
    irrelevant-files: *irrelevant_files
      - roles/telemetry_graphing
      - roles/telemetry_autoscaling
      - roles/telemetry_verify_metrics
#   ( LINT FAILURE )
########################################
    irrelevant-files:
      *irrelevant_files
      - roles/telemetry_graphing
      - roles/telemetry_autoscaling
      - roles/telemetry_verify_metrics
#   (Buuildset result ERROR)  expected a dictionary @ data['irrelevant-files'][0]

Copy link
Contributor Author

@ayefimov-1 ayefimov-1 Feb 4, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Per rhos-prodchain-support:

dr.shimi
:meow_puffy-terrified:  [Yesterday at 18:45](https://redhat-internal.slack.com/archives/C0836QJNBF1/p1738626346118159?thread_ts=1738168284.356889&cid=C0836QJNBF1)
so this is problem with YAML parsers...

dr.shimi
:meow_puffy-terrified:  [Yesterday at 18:46](https://redhat-internal.slack.com/archives/C0836QJNBF1/p1738626367158379?thread_ts=1738168284.356889&cid=C0836QJNBF1)
I cannot tell much, but AFAIK it works well with mappings/dictionaries, but not with lists

dr.shimi
:meow_puffy-terrified:  [Yesterday at 18:46](https://redhat-internal.slack.com/archives/C0836QJNBF1/p1738626403827689?thread_ts=1738168284.356889&cid=C0836QJNBF1)
I mean, the anchors stuff and extending the defintions

dr.shimi
:meow_puffy-terrified:  [Yesterday at 18:47](https://redhat-internal.slack.com/archives/C0836QJNBF1/p1738626471739599?thread_ts=1738168284.356889&cid=C0836QJNBF1)
you can sort of workaround it by defining it as dictionary in helper variable and then reusing that variable with list jinja filter, but that's ugly...

dr.shimi
:meow_puffy-terrified:  [Yesterday at 18:48](https://redhat-internal.slack.com/archives/C0836QJNBF1/p1738626492350889?thread_ts=1738168284.356889&cid=C0836QJNBF1)
TL;DR no nice solution as far as I know

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Boo! (not directed at anyone)
This is annoying, but since it works and the alternatives were unsuccessful, then it'll have to do.
Thank you for looking at this and testing the alternatives.

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think that the irrelevant-files should support matching on regular expressions. It could make the list look tidier, and prevent issues later when new roles get added

Please try that out if it's not a huge effort (perhaps as a follow-up PR once this is done)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Development

Successfully merging this pull request may close these issues.

2 participants