You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
1. Non-Atomic Resource Management During Deployment
The current process upserts application metadata, policy files, and test resource files before executing the deployment pipeline. If the pipeline fails, applications may end up with out-of-sync resources in storage.
Possible solutions
Revert storage resources automatically if the deployment pipeline fails.
Delay storage updates until the pipeline completes successfully (might be the issue if the apps loads the resources on startup).
2. Non-Transactional Deployment Flow
The deployment workflow involves three sequential steps:
Triggering the Azure DevOps pipeline
Creating a database record based on the initial response
Scheduling a polling job that updates the state in our db.
If the studio container terminates between these steps, it may result in:
A succeeded pipeline with no corresponding database record
A stalled deployment state if polling fails to initialize
Proposed Solution
Introduce a pre-queued state for deployments before pipeline execution, or possibly more states and
implement a background reconciliation job to detect and resolve inconsistent states (e.g., completed pipelines without database updates).
The text was updated successfully, but these errors were encountered:
Current Flaws in the Deployment Flow
1. Non-Atomic Resource Management During Deployment
The current process upserts application metadata, policy files, and test resource files before executing the deployment pipeline. If the pipeline fails, applications may end up with out-of-sync resources in storage.
Possible solutions
2. Non-Transactional Deployment Flow
The deployment workflow involves three sequential steps:
If the studio container terminates between these steps, it may result in:
A succeeded pipeline with no corresponding database record
A stalled deployment state if polling fails to initialize
Proposed Solution
Introduce a
pre-queued
state for deployments before pipeline execution, or possibly more states andimplement a background reconciliation job to detect and resolve inconsistent states (e.g., completed pipelines without database updates).
The text was updated successfully, but these errors were encountered: