Skip to content
This repository has been archived by the owner on Sep 22, 2020. It is now read-only.

Flex Volume failed to attach volume on Google Container Engine #434

Open
azhuo-va opened this issue Dec 13, 2016 · 2 comments
Open

Flex Volume failed to attach volume on Google Container Engine #434

azhuo-va opened this issue Dec 13, 2016 · 2 comments

Comments

@azhuo-va
Copy link

azhuo-va commented Dec 13, 2016

Torus version: torus_v0.1.2_darwin_amd64

I want to try torus on Google Container Engine, so I followed the instruction here to set up everything. I was able to create torus volume, but I got stuck at step 6.
I thought that was because torus's deriver wasn't installed on my kubernetes nodes. So I ssh into each node and ran these commands:

mkdir -p /usr/libexec/kubernetes/kubelet-plugins/volume/exec/coreos.com~torus/
wget https://github.com/coreos/torus/releases/download/v0.1.2/torus_v0.1.2_darwin_amd64.zip
unzip torus_v0.1.2_darwin_amd64.zip
cp torus_v0.1.2_darwin_amd64/torusblk /usr/libexec/kubernetes/kubelet-plugins/volume/exec/coreos.com~torus/torus
sudo /etc/init.d/kubelet restart
modprobe nbd nbds_max=32

Then I was told that dbus was missing, so I ran:

sudo apt-get update
sudo apt-get install dbus
sudo /etc/init.d/dbus restart

Then I re-tried step 6 but it failed again with the following reason:

I1213 22:26:12.879596   19183 kubelet.go:2534] SyncLoop (ADD, "api"): "postgres-torus-1327974524-gchf1_default(277bb2b1-c183-11e6-af49-42010a800003)"
I1213 22:26:12.947717   19183 reconciler.go:253] MountVolume operation started for volume "kubernetes.io/secret/default-token-w62uh" (spec.Name: "default-token-w62uh") to pod "277bb2b1-c183-11e6-af49-42010a800003" (UID: "277bb2b1-c183-11e6-af49-42010a800003"). 
I1213 22:26:12.947777   19183 reconciler.go:179] VerifyControllerAttachedVolume operation started for volume "coreos.com/torus/coreos.com/torus" (spec.Name: "data") pod "277bb2b1-c183-11e6-af49-42010a800003" (UID: "277bb2b1-c183-11e6-af49-42010a800003")
I1213 22:26:12.953321   19183 operation_executor.go:720] MountVolume.SetUp succeeded for volume "kubernetes.io/secret/default-token-w62uh" (spec.Name: "default-token-w62uh") pod "277bb2b1-c183-11e6-af49-42010a800003" (UID: "277bb2b1-c183-11e6-af49-42010a800003").
I1213 22:26:13.047988   19183 reconciler.go:253] MountVolume operation started for volume "coreos.com/torus/coreos.com/torus" (spec.Name: "data") to pod "277bb2b1-c183-11e6-af49-42010a800003" (UID: "277bb2b1-c183-11e6-af49-42010a800003"). 
E1213 22:26:13.066458   19183 goroutinemap.go:155] Operation for "coreos.com/torus/coreos.com/torus" failed. No retries permitted until 2016-12-13 22:26:13.566453387 +0000 UTC (durationBeforeRetry 500ms). error: MountVolume.SetUp failed for volume "coreos.com/torus/coreos.com/torus" (spec.Name: "data") pod "277bb2b1-c183-11e6-af49-42010a800003" (UID: "277bb2b1-c183-11e6-af49-42010a800003") with: attach command failed, status: Failure, reason: The name org.freedesktop.systemd1 was not provided by any .service files
I1213 22:26:13.649516   19183 reconciler.go:253] MountVolume operation started for volume "coreos.com/torus/coreos.com/torus" (spec.Name: "data") to pod "277bb2b1-c183-11e6-af49-42010a800003" (UID: "277bb2b1-c183-11e6-af49-42010a800003"). 
E1213 22:26:13.664908   19183 goroutinemap.go:155] Operation for "coreos.com/torus/coreos.com/torus" failed. No retries permitted until 2016-12-13 22:26:14.664901883 +0000 UTC (durationBeforeRetry 1s). error: MountVolume.SetUp failed for volume "coreos.com/torus/coreos.com/torus" (spec.Name: "data") pod "277bb2b1-c183-11e6-af49-42010a800003" (UID: "277bb2b1-c183-11e6-af49-42010a800003") with: attach command failed, status: Failure, reason: The name org.freedesktop.systemd1 was not provided by any .service files
I1213 22:26:14.756027   19183 reconciler.go:253] MountVolume operation started for volume "coreos.com/torus/coreos.com/torus" (spec.Name: "data") to pod "277bb2b1-c183-11e6-af49-42
010a800003" (UID: "277bb2b1-c183-11e6-af49-42010a800003"). 
E1213 22:26:14.771306   19183 goroutinemap.go:155] Operation for "coreos.com/torus/coreos.com/torus" failed. No retries permitted until 2016-12-13 22:26:16.771300335 +0000 UTC (dur
ationBeforeRetry 2s). error: MountVolume.SetUp failed for volume "coreos.com/torus/coreos.com/torus" (spec.Name: "data") pod "277bb2b1-c183-11e6-af49-42010a800003" (UID: "277bb2b1-
c183-11e6-af49-42010a800003") with: attach command failed, status: Failure, reason: The name org.freedesktop.systemd1 was not provided by any .service files
I1213 22:26:16.774367   19183 reconciler.go:253] MountVolume operation started for volume "coreos.com/torus/coreos.com/torus" (spec.Name: "data") to pod "277bb2b1-c183-11e6-af49-42
010a800003" (UID: "277bb2b1-c183-11e6-af49-42010a800003"). 
E1213 22:26:16.790067   19183 goroutinemap.go:155] Operation for "coreos.com/torus/coreos.com/torus" failed. No retries permitted until 2016-12-13 22:26:20.790061044 +0000 UTC (dur
ationBeforeRetry 4s). error: MountVolume.SetUp failed for volume "coreos.com/torus/coreos.com/torus" (spec.Name: "data") pod "277bb2b1-c183-11e6-af49-42010a800003" (UID: "277bb2b1-
c183-11e6-af49-42010a800003") with: attach command failed, status: Failure, reason: The name org.freedesktop.systemd1 was not provided by any .service files
I1213 22:26:20.889834   19183 reconciler.go:253] MountVolume operation started for volume "coreos.com/torus/coreos.com/torus" (spec.Name: "data") to pod "277bb2b1-c183-11e6-af49-42
010a800003" (UID: "277bb2b1-c183-11e6-af49-42010a800003"). 
E1213 22:26:20.905328   19183 goroutinemap.go:155] Operation for "coreos.com/torus/coreos.com/torus" failed. No retries permitted until 2016-12-13 22:26:28.905321172 +0000 UTC (dur
ationBeforeRetry 8s). error: MountVolume.SetUp failed for volume "coreos.com/torus/coreos.com/torus" (spec.Name: "data") pod "277bb2b1-c183-11e6-af49-42010a800003" (UID: "277bb2b1-
c183-11e6-af49-42010a800003") with: attach command failed, status: Failure, reason: The name org.freedesktop.systemd1 was not provided by any .service files
I1213 22:26:28.911182   19183 reconciler.go:253] MountVolume operation started for volume "coreos.com/torus/coreos.com/torus" (spec.Name: "data") to pod "277bb2b1-c183-11e6-af49-42
010a800003" (UID: "277bb2b1-c183-11e6-af49-42010a800003"). 
E1213 22:26:28.926574   19183 goroutinemap.go:155] Operation for "coreos.com/torus/coreos.com/torus" failed. No retries permitted until 2016-12-13 22:26:44.926567371 +0000 UTC (dur
ationBeforeRetry 16s). error: MountVolume.SetUp failed for volume "coreos.com/torus/coreos.com/torus" (spec.Name: "data") pod "277bb2b1-c183-11e6-af49-42010a800003" (UID: "277bb2b1
-c183-11e6-af49-42010a800003") with: attach command failed, status: Failure, reason: The name org.freedesktop.systemd1 was not provided by any .service files
I1213 22:26:44.956309   19183 reconciler.go:253] MountVolume operation started for volume "coreos.com/torus/coreos.com/torus" (spec.Name: "data") to pod "277bb2b1-c183-11e6-af49-42
010a800003" (UID: "277bb2b1-c183-11e6-af49-42010a800003"). 
E1213 22:26:44.971656   19183 goroutinemap.go:155] Operation for "coreos.com/torus/coreos.com/torus" failed. No retries permitted until 2016-12-13 22:27:16.971650496 +0000 UTC (dur
ationBeforeRetry 32s). error: MountVolume.SetUp failed for volume "coreos.com/torus/coreos.com/torus" (spec.Name: "data") pod "277bb2b1-c183-11e6-af49-42010a800003" (UID: "277bb2b1
-c183-11e6-af49-42010a800003") with: attach command failed, status: Failure, reason: The name org.freedesktop.systemd1 was not provided by any .service files
I1213 22:27:17.044740   19183 reconciler.go:253] MountVolume operation started for volume "coreos.com/torus/coreos.com/torus" (spec.Name: "data") to pod "277bb2b1-c183-11e6-af49-42
010a800003" (UID: "277bb2b1-c183-11e6-af49-42010a800003"). 
E1213 22:27:17.061294   19183 goroutinemap.go:155] Operation for "coreos.com/torus/coreos.com/torus" failed. No retries permitted until 2016-12-13 22:28:21.06128704 +0000 UTC (dura
tionBeforeRetry 1m4s). error: MountVolume.SetUp failed for volume "coreos.com/torus/coreos.com/torus" (spec.Name: "data") pod "277bb2b1-c183-11e6-af49-42010a800003" (UID: "277bb2b1
-c183-11e6-af49-42010a800003") with: attach command failed, status: Failure, reason: The name org.freedesktop.systemd1 was not provided by any .service files
E1213 22:28:12.880494   19183 kubelet.go:1930] Unable to mount volumes for pod "postgres-torus-1327974524-gchf1_default(277bb2b1-c183-11e6-af49-42010a800003)": timeout expired wait
ing for volumes to attach/mount for pod "postgres-torus-1327974524-gchf1"/"default". list of unattached/unmounted volumes=[data]; skipping pod
E1213 22:28:12.880566   19183 pod_workers.go:183] Error syncing pod 277bb2b1-c183-11e6-af49-42010a800003, skipping: timeout expired waiting for volumes to attach/mount for pod "pos
tgres-torus-1327974524-gchf1"/"default". list of unattached/unmounted volumes=[data]
I1213 22:28:21.129527   19183 reconciler.go:253] MountVolume operation started for volume "coreos.com/torus/coreos.com/torus" (spec.Name: "data") to pod "277bb2b1-c183-11e6-af49-42
010a800003" (UID: "277bb2b1-c183-11e6-af49-42010a800003"). 
E1213 22:28:21.144134   19183 goroutinemap.go:155] Operation for "coreos.com/torus/coreos.com/torus" failed. No retries permitted until 2016-12-13 22:30:21.144128534 +0000 UTC (dur
ationBeforeRetry 2m0s). error: MountVolume.SetUp failed for volume "coreos.com/torus/coreos.com/torus" (spec.Name: "data") pod "277bb2b1-c183-11e6-af49-42010a800003" (UID: "277bb2b
1-c183-11e6-af49-42010a800003") with: attach command failed, status: Failure, reason: The name org.freedesktop.systemd1 was not provided by any .service files
I1213 22:28:25.543083   19183 reconciler.go:253] MountVolume operation started for volume "kubernetes.io/secret/default-token-w62uh" (spec.Name: "default-token-w62uh") to pod "277b
b2b1-c183-11e6-af49-42010a800003" (UID: "277bb2b1-c183-11e6-af49-42010a800003"). Volume is already mounted to pod, but remount was requested.
I1213 22:28:25.546560   19183 operation_executor.go:720] MountVolume.SetUp succeeded for volume "kubernetes.io/secret/default-token-w62uh" (spec.Name: "default-token-w62uh") pod "2
77bb2b1-c183-11e6-af49-42010a800003" (UID: "277bb2b1-c183-11e6-af49-42010a800003").
@azhuo-va azhuo-va changed the title Flex Volume fails to attach volume on Google Container Engine Flex Volume failed to attach volume on Google Container Engine Dec 13, 2016
@nak3
Copy link
Contributor

nak3 commented Dec 14, 2016

This host is running on systemd? FlexVolume doesn't support non-systemd system as below:

https://github.com/coreos/torus/tree/master/contrib/kubernetes#1-install-torustorusblk-in-kubelet-volume-plugin-directory

NOTICE: The FlexVolume functionality currently uses systemd to manage its lifecycle. Running as a FlexVolume on non-systemd systems is TBD

@amitgilad3
Copy link

is torus going to work on google container engine any time soon???

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants