What's Changed
- add workflow run status count api by @raylrui in #558
- Update Python service skel by @reisingerf in #557
- Feat (metadata-manager): Update model by @williamputraintan in #535
- fix(filemanager): swap docker hub images for AWS public ECR by @mmalenic in #565
- Feat (MM): Custom CSV Importer for MM by @williamputraintan in #566
- refactor(filemanager): match AWS behaviour for delete markers by @mmalenic in #568
- Bug fixes for 0.2.1 by @alexiswl in #573
- Feat (MM): State Change Event by @williamputraintan in #569
- Fix
orcabus_id
filter (w/ prefixes) by @williamputraintan in #582 - Feat(MM): API Serializer Expansion by @williamputraintan in #583
- Fix error when checking source uris have been transferred by @alexiswl in #588
- Add OrcaBus ID by @reisingerf in #579
- feat(filemanager): ingest_id tagging and object move tracking by @mmalenic in #585
- fix(filemanager): version_id for S3 API calls by @mmalenic in #587
- Add RESOLVED state as supported WorkflowRun state by @reisingerf in #594
- feat(filemanager): accept multiple keys in API by @mmalenic in #596
- Friday changes: by @alexiswl in #589
- Fix: Drop incomplete record before metadata processing by @williamputraintan in #598
- feat(filemanager): docker caching and current state default by @mmalenic in #601
- Feature/analysis journey by @reisingerf in #599
- Feat (MM): History API for Models by @williamputraintan in #606
- wfm update for ui fix by @raylrui in #608
- cttsov2 job checker requires permissions to list executions by @alexiswl in #603
- Add fastqc / sequali stats to fastq list row events for first 1 million reads by @alexiswl in #602
- Pieriandx needs 'SUCCEEDED' status as positive terminal status not 'COMPLETE' by @alexiswl in #604
- Handle orcabus_id with prefix when saving model objects by @reisingerf in #612
- feat: filemanager partitions by @mmalenic in #615
- fix(filemanager): resetting current state should include old verisons by @mmalenic in #616
- wfr/ feat-comments-resolved-status-mutation-module by @raylrui in #613
- Oncoanalyser / Sash stack and glue services by @alexiswl in #610
- Feat: Add Authoriser Based on User Pool Group by @williamputraintan in #617
- Bumped dependencies by @victorskl in #620
- Remove unused stacky tables by @alexiswl in #619
- feat(event-source): ignore cache directories by @mmalenic in #621
- Updated json paths for portal run id and workflow run name by @alexiswl in #623
- feat(event-source): add archive bucket as event source by @mmalenic in #625
- Fix library lookup with prefixed orcabusId by @reisingerf in #626
- Fixed roket get-individual-id step by @alexiswl in #630
- Retry lambdas with delay of 60 seconds by @alexiswl in #631
- Allow samplesheet overwrite by @alexiswl in #632
- Need to collect camelCase orcabus Id when retrieving object from metadata manager by @alexiswl in #635
- Feat(MM): Add Sync Metadata Endpoint by @williamputraintan in #627
- Feat/analysis run api update by @raylrui in #628
- Delete partial files before retrying copy job by @alexiswl in #636
- Added ora file decompression fastq pair component by @alexiswl in #624
- Upgrade memory for pieriandx glue lambdas by @alexiswl in #634
- CodeBuild doesn't support git-lfs by @alexiswl in #642
- [skip ci]: Added ora pipeline and reference path to staging and production envs by @alexiswl in #639
- Only save payload if present by @reisingerf in #646
- Add analysis size option per microservice by @alexiswl in #638
- Manually transfer files that are smaller than 8 MiB or dont have an etag by @alexiswl in #643
- Need to set 'keep_flowcell_layout' to true for wrapica collection of runinfo xml by @alexiswl in #648
- Fix (MM): Allow nullable description for sync by @williamputraintan in #649
- Fix WRSC not having a payload by @reisingerf in #650
- Set cttsov2 icav2 storage configuration to LARGE by @alexiswl in #652
- Pull the snomed databases from github if they're not on the local system by @alexiswl in #654
- fix-ora-compression-manager by @alexiswl in #656
- Prevent the ntc samples running through cttsov2 by @alexiswl in #658
- PierianDx Production Fixes by @alexiswl in #659
- HotFix(authorization-manager): Sanitize Authorization Header by @williamputraintan in #661
- Update dragen somatic pipeline id by @alexiswl in #665
- feat(fmannotator): add DLQ for fmannotator function by @mmalenic in #664
- Fixed oncoanalyser Batch trigger initial status SUBMITTED by @victorskl in #667
- Wrong typescript boolean logic which meant there was no event rule by @alexiswl in #671
- Fix literal placeholders in nf step functions by @alexiswl in #674
- hotfix(filemanager): add permissions that allow API/inventory functions to access
pipeline-*-cache
buckets by @mmalenic in #670 - Sanitise subject id for oncoanalyser / sash / nf workflows by @alexiswl in #680
- Update v2 samplesheet maker version by @alexiswl in #678
- Fix status for non-terminal by @alexiswl in #682
- Fix Rnasum dataset input parameter by @alexiswl in #684
- Setup to rearrange the outputs for the ora compression manager by @alexiswl in #666
- Chore(mm): Miscellaneous Update by @williamputraintan in #686
- Update rnasum pipeline version to 1.1.5 by @alexiswl in #685
- fix(filemanager): longer presigned URLs by @mmalenic in #688
- Fix(mm): Broken Comparison on Update by @williamputraintan in #691
- Added lambda layer for workflows API endpoint + RNASum Lambda by @alexiswl in #692
- Fix rnasum rerun lambda by @alexiswl in #702
- feat(filemanager): add fastq bucket to ingester event source by @mmalenic in #700
- add distinct to remove duplicate results by @raylrui in #706
- Add holmes glue by @alexiswl in #708
- Allow validation only for ora decompression by @alexiswl in #703
- Retry 5 mins when capacity is limited by @alexiswl in #712
- Feat(wfm):
rnasum
rerun api by @williamputraintan in #713 - Few lambda fixes by @alexiswl in #715
- Feat(pipeline): Disable Dev Automatic Deployment by @williamputraintan in #714
- Fix(MM): Add reason on history for
add
in m2m relationship by @williamputraintan in #716 - Rate limit ora compression workflow by @alexiswl in #720
- feat: dump postgres records by @mmalenic in #709
- Feat(mm): Allow Library Filtered by Project by @williamputraintan in #723
- feat(data-migrate): data mover task by @mmalenic in #726
- Don't extend portal run id to sequencer run, by @alexiswl in #731
- Set sample type to ctDNA for cttsov2 triggers by @alexiswl in #730
- Sleep command should then loop to list-executions by @alexiswl in #733
- fix(data-migrate): set arch as ARM64 by @mmalenic in #735
- ORA Compression fixes for too large sfns, single indexed libraries by @alexiswl in #736
- Use hash for cache uri by @alexiswl in #737
- Bugfix, fix compression outputs for single indexed samples by @alexiswl in #738
- Set list tasks to 1 more than rate limit command by @alexiswl in #739
- Swap max items for max results by @alexiswl in #740
- Max results can't be more than 100 by @alexiswl in #742
- Run a partition over the rgid first and then run merge fastq list csv by @alexiswl in #743
- Update holmes glue wrappers to match new input syntax by @alexiswl in #741
- Bugfix, add extact arn to map step by @alexiswl in #744
- Fix map output size limit by @alexiswl in #746
- Catch the Ecs Rate Exceeded exception by @alexiswl in #747
- fix(data-migrate): fix stdout capture and failed step functions by @mmalenic in #749
- Add result path to holmes map by @alexiswl in #750
- Feat(SRM) models refatcor by @raylrui in #753
- fix(data-migrate): add structured output to step functions by @mmalenic in #754
- Fix(SRM) SRM api issue by @raylrui in #755
- Fix/add delete for api allow methods by @raylrui in #756
- Feat (wfm): add workflow stats viewsets by @raylrui in #725
- Add ora reference for tn workflows by @alexiswl in #761
- Add ora compression to cttsov2 workflow by @alexiswl in #763
- feat(htsget): add htsget support by @mmalenic in #759
- feat: filemanager multiple same-key queries by @mmalenic in #762
- Updated aurora automated backup retention by @victorskl in #767
- Feat(MM): Additional MM Endpoint and Library Filter by @williamputraintan in #765
- Added readme for launching the tumor normal pipeline by @alexiswl in #769
- Implemented OrcaBus database tier-2 backup retention by @victorskl in #768
- build(fmannotator): update deps by @mmalenic in #771
- Feat(wfr) api add "DEPRECATED" state by @raylrui in #770
- Decompress ora files prior to running if gzip files are also present by @alexiswl in #774
- Fix validationOnly json path, should be constant 'false' by @alexiswl in #776
- Resolve division by zero error by @alexiswl in #777
- fix(pg-dd): python version and environment variables by @mmalenic in #783
- Chore: Refactor Django
orcabus_id
by @williamputraintan in #784 - Remove null inputs from inputs payload by @alexiswl in #778
- Fix step functions where next attribute for Merge Boolean Skipped new step by @alexiswl in #787
- fix(filemanager): add permissions for analysis and fastq archive buckets by @mmalenic in #791
- feat(filemanager): update ingest id by @mmalenic in #793
- Bumped dependencies by @victorskl in #794
Full Changelog: 0.2.3...0.3.0