Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Troubleshoot backport failures #329

Open
wants to merge 1 commit into
base: main
Choose a base branch
from
Open

Conversation

zmb3
Copy link
Contributor

@zmb3 zmb3 commented Feb 10, 2025

Lately we see a lot of backport workflows fail. The pattern always seems to be that the first backport (to branch/v17) succeeds, but subsequent backports (to v15 and v16) almost always fail.

The failure looks to be a GitHub-specific failure, not a generic git failure:

remote: fatal error in commit_refs
  To https://github.com/gravitational/teleport
  ! [remote rejected]       bot/backport-51989-branch/v15 > bot/backport-51989-branch/v15 (failure)
error: failed to push some refs to https://github.com/gravitational/teleport

To aid in troubleshooting we:

  1. Temporarily reverse the order of branches. This will tell us if it's always the first branch that succeeds, or if it's always branch/v17 that succeeds.
  2. Add the --verbose flag to the git push command in case we get any more debug info.

Lately we see a lot of backport workflows fail. The pattern always
seems to be that the first backport (to branch/v17) succeeds, but
subsequent backports (to v15 and v16) almost always fail.

The failure looks to be a GitHub-specific failure, not a generic git
failure:

    remote: fatal error in commit_refs
      To https://github.com/gravitational/teleport
      ! [remote rejected]       bot/backport-51989-branch/v15 > bot/backport-51989-branch/v15 (failure)
    error: failed to push some refs to https://github.com/gravitational/teleport

To aid in troubleshooting we:
1. Temporarily reverse the order of branches. This will tell us if it's
   always the first branch that succeeds, or if it's always branch/v17
   that succeeds.
2. Add the --verbose flag to the git push command in case we get any
   more debug info.
@zmb3 zmb3 requested a review from a team as a code owner February 10, 2025 23:02
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants