Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[New Feature]: DIST-S1 PGE Engineering Release 2.0 Integration #1104

Closed
15 tasks done
collinss-jpl opened this issue Mar 10, 2025 · 0 comments · Fixed by #1108
Closed
15 tasks done

[New Feature]: DIST-S1 PGE Engineering Release 2.0 Integration #1104

collinss-jpl opened this issue Mar 10, 2025 · 0 comments · Fixed by #1108
Assignees
Labels
enhancement New feature or request needs triage Issue that requires triage

Comments

@collinss-jpl
Copy link
Collaborator

collinss-jpl commented Mar 10, 2025

Checked for duplicates

Yes - I've already checked

Alternatives considered

Yes - and alternatives don't suffice

Related problems

Task to integrate DIST-S1 PGE v6.0.0-er.2.0 with OPERA PCM. Sub-tasks should include:

  • Update the DIST-S1 version in the following terraform modules under cluster_provisioning
    • dev-e2e/variables.tf
    • dev-int/override.tf
    • dev/variables.tf`
    • ebs-snapshot/variables.tf
    • modules/common/variables.tf
  • Update regular expressions for DIST-S1 as-needed in the following files:
    • conf/settings.yaml
    • conf/pge_outputs.yaml
    • conf/sds/files/datasets.json
    • conf/sds/files/datasets.json.tmpl.asg
  • Update conf/schema/RunConfig_schema.L3_DIST_S1.yaml with any changes to the SAS schema
  • Update conf/RunConfig.yaml.L3_DIST_S1.jinja2.tmpl to account for any updates to the SAS schema
  • Update the entry for DIST-S1 in conf/sds/rules/user_rules-cnm.json.tmpl to ensure the following
    • staged_data_types["browse"] includes a *.png entry
    • staged_data_types["metadata"] includes a *.iso.xml entry
  • Update the DIST-S1 version in docker/job-spec.json.SCIFLO_L3_DIST_S1
  • Add an entry for DIST-S1 to the dependency_images section of docker/job-spec.json.pge_smoke_test
  • Update opera_chimera/configs/pge_configs/PGE_L3_DIST_S1.yaml to account for any changes made to conf/RunConfig.yaml.L3_DIST_S1.jinja2.tmpl
  • Update opera_chimera/precondition_functions.py as needed
  • Update util/pge_util.get_dist_s1_simulated_output_filenames() to account for any changes to the expected file name conventions
  • Revisit wrapper/pge_functions.dist_s1_lineage_metadata() and wrapper/pge_functions.update_dist_s1_runconfig() to see if any updates are required based on any of the other changes made
  • Deploy dev cluster and test the following
    • DIST-S1 in simulation mode
    • DIST-S1 in real mode
    • PGE on-demand smoke test for DIST-S1

Describe the feature request

I need or want [...]

@collinss-jpl collinss-jpl added enhancement New feature or request needs triage Issue that requires triage labels Mar 10, 2025
@RKuttruff RKuttruff linked a pull request Mar 11, 2025 that will close this issue
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request needs triage Issue that requires triage
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants