Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Multi-Attach error for volume XXX Volume is already used by pod(s) RUNNER POD #166

Open
aladdin-atypon opened this issue Jun 10, 2024 · 2 comments

Comments

@aladdin-atypon
Copy link

github runner in kubernetes mode expects kubernetesModeWorkVolumeClaim, the default is accessModes: ["ReadWriteOnce"], and in most of the doc it's always accessModes: ["ReadWriteOnce"].

However, in kubernetes mode, the runner container hook is expected to create new pod, get the volume from the runner pod and use it there, but it does't work since the ReadWriteOnce allows just 1 pod to be mounting the pvc, which is the runner pod, I've seen a lot of examples where aws gp3 storage class is used and no one has complained about the issue I'm facing!

I've tried to use EFS, it works fine, but the point is it's X15 slower than ebs, regardless, how the default is ReadWriteOnce and you expect it to work fine although, by definition, ReadWriteOnce doesn't work with more than one pod but the hook actually uses the same PVC of the runner in

@mazzy89
Copy link

mazzy89 commented Jul 4, 2024

I have started lately to experience this issue as well. It is not clear why it has just started recently to appear. Before I was not present.

@mazzy89
Copy link

mazzy89 commented Jul 4, 2024

The way to solve this is to make sure that the pods spun by the k8s job (in kube mode) are co-located in the same k8s node where the pod running the main workflow gh job exists. in this case the issue is gone because ReadWriteOnce mode set on the PVC will work.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants