Timeout on bootstrap

[alex529]

Hello,
I am trying to setup flux on 3 rpi microk8s cluster. I didn't get far and got stuck on the bootstrap step. Did some googling and i thought i found my solution here, it seems the same kind of issue, but the solution there didn't solve it.

I'm trying to set it up with ssh, but i got desperate and tried the github token as well and got the same outcome. Doing a git clone works.

when i tried the flux bootstrap github ... i've deleted the flux-system before trying the new flow.

flux check --pre
► checking prerequisites
✔ Kubernetes 1.31.6 >=1.30.0-0
✔ prerequisites checks passed

flux bootstrap git --cluster-domain cluster.local --url=ssh://[email protected]/alex529/hive --branch=master --private-key-file=/home/xyz/.ssh/id_rsa --path=gitOps

► cloning branch "master" from Git repository "ssh://[email protected]/alex529/hive"
✔ cloned repository
► generating component manifests
✔ generated component manifests
✔ component manifests are up to date
► installing components in "flux-system" namespace
✔ installed components
✔ reconciled components
► determining if source secret "flux-system/flux-system" exists
► generating source secret
✔ public key: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC7PEYgAepbXr2KFND1OId6eQuEURIS0LQ6KWMAshJVtuWq4+lRRYvxgvrFYvvCa8rv2/keGpO9XyoArjMw6VhCri6cSRhzhAIDz8ycWrBp/32fjzNs4MarwvixaIcFeFn9BFCMs84WY2RfF9oqTlyjkPVk26EGEN77gqDLItDR/smmg45EeNsRSKddRigL0OnmsjmW4cUrkRjh4KWoLQJP9qrn7+LtIa8QxvkU6/KWo3SZx7wesKJasJnRmRnMdu6Cujh8DsMuxZrxl0qsaQclUGSTFwLdh4pFGX+v62Y5+gLur+DyhFfhxDpM3yvQNDgUJhKyZYn96F0JBvhkifn9TyxGUjjxN0L+t5p6MBbV2Y0lhWQwX+OjEY7HgLaHgtHyTELz5lWQLMvWnApI0RQvnoePQQjdRLwnck6b2J1P6fRYuE9KqoRCnW+eJVU2MlXHvMKdsshFfqSW1HQdVVeC9VOd/DthuaRnl+rsK4SyruaCDDwFljc8S5qXPUA6UqAM6jETXGTbBfMuHqeFjpxLEGRnXEQUFdSUWdpcLqEJ3O/Exg0sYCCsjyUc4RpFsnQpJdUikPXQLTHitRtJe3UCvDo1IoJD9/YE1a3FcXORxK9sgiRtOJNjL+NcJMjwM7Bo1DEx0KJ2+b10i4x8jE2a5qetF8IVVj/31xUxoCn7yw==
? Please give the key access to your repository? [y/N] y█
► applying source secret "flux-system/flux-system"
✔ reconciled source secret
► generating sync manifests
✔ generated sync manifests
✔ sync manifests are up to date
► applying sync manifests
✔ reconciled sync configuration
◎ waiting for GitRepository "flux-system/flux-system" to be reconciled
✗ gitrepository 'flux-system/flux-system' not ready: 'failed to checkout and determine revision: unable to clone 'ssh://[email protected]/alex529/hive': dial tcp: lookup github.com on 10.152.183.10:53: read udp 10.1.82.198:47975->10.152.183.10:53: i/o timeout'
◎ waiting for Kustomization "flux-system/flux-system" to be reconciled
✗ client rate limiter Wait returned an error: context deadline exceeded
► confirming components are healthy
✔ helm-controller: deployment ready
✔ kustomize-controller: deployment ready
✔ notification-controller: deployment ready
✔ source-controller: deployment ready
✔ all components are healthy
✗ bootstrap failed with 2 health check failure(s): [error while waiting for GitRepository to be ready: 'gitrepository 'flux-system/flux-system' not ready: 'failed to checkout and determine revision: unable to clone 'ssh://[email protected]/alex529/hive': dial tcp: lookup github.com on 10.152.183.10:53: read udp 10.1.82.198:47975->10.152.183.

initially i tried without the --cluster-domain cluster.local parameter, afterwards i add it as it was mentioned the the other issue, the outcome stayed the same

flux check

► checking prerequisites
✔ Kubernetes 1.31.6 >=1.30.0-0
► checking version in cluster
✔ distribution: flux-v2.5.1
✔ bootstrapped: false
► checking controllers
✔ helm-controller: deployment ready
► ghcr.io/fluxcd/helm-controller:v1.2.0
✔ kustomize-controller: deployment ready
► ghcr.io/fluxcd/kustomize-controller:v1.5.1
✔ notification-controller: deployment ready
► ghcr.io/fluxcd/notification-controller:v1.5.0
✔ source-controller: deployment ready
► ghcr.io/fluxcd/source-controller:v1.5.0
► checking crds
✔ alerts.notification.toolkit.fluxcd.io/v1beta3
✔ buckets.source.toolkit.fluxcd.io/v1
✔ gitrepositories.source.toolkit.fluxcd.io/v1
✔ helmcharts.source.toolkit.fluxcd.io/v1
✔ helmreleases.helm.toolkit.fluxcd.io/v2
✔ helmrepositories.source.toolkit.fluxcd.io/v1
✔ kustomizations.kustomize.toolkit.fluxcd.io/v1
✔ ocirepositories.source.toolkit.fluxcd.io/v1beta2
✔ providers.notification.toolkit.fluxcd.io/v1beta3
✔ receivers.notification.toolkit.fluxcd.io/v1
✔ all checks passed

the weird thing is that i can see 3 commits by flux on the repository

i can see that flux created the necessary scaffolding and everything is running(but nothing works :|)

microk8s.kubectl get all -n flux-system 
NAME                                          READY   STATUS    RESTARTS       AGE
pod/helm-controller-5c66d5b6fd-db4fr          1/1     Running   12 (25h ago)   2d
pod/kustomize-controller-69cd587c5b-6fj8p     1/1     Running   4 (25h ago)    46h
pod/notification-controller-f9dc675b9-hxwtn   1/1     Running   3 (25h ago)    2d
pod/source-controller-86ccd85b75-vwh5f        1/1     Running   6 (25h ago)    46h

NAME                              TYPE        CLUSTER-IP       EXTERNAL-IP   PORT(S)   AGE
service/notification-controller   ClusterIP   10.152.183.245   <none>        80/TCP    2d
service/source-controller         ClusterIP   10.152.183.243   <none>        80/TCP    2d
service/webhook-receiver          ClusterIP   10.152.183.112   <none>        80/TCP    2d

NAME                                      READY   UP-TO-DATE   AVAILABLE   AGE
deployment.apps/helm-controller           1/1     1            1           2d
deployment.apps/kustomize-controller      1/1     1            1           2d
deployment.apps/notification-controller   1/1     1            1           2d
deployment.apps/source-controller         1/1     1            1           2d

NAME                                                DESIRED   CURRENT   READY   AGE
replicaset.apps/helm-controller-5c66d5b6fd          1         1         1       2d
replicaset.apps/kustomize-controller-69cd587c5b     1         1         1       2d
replicaset.apps/notification-controller-f9dc675b9   1         1         1       2d
replicaset.apps/source-controller-86ccd85b75        1         1         1       2d

checking the logs for the source controller i can see a lot for logs like this

microk8s.kubectl logs source-controller-86ccd85b75-vwh5f -n flux-system

{
    "level": "error",
    "ts": "2025-03-11T22:22:57.450Z",
    "msg": "Reconciler error",
    "controller": "gitrepository",
    "controllerGroup": "source.toolkit.fluxcd.io",
    "controllerKind": "GitRepository",
    "GitRepository": {
        "name": "flux-system",
        "namespace": "flux-system"
    },
    "namespace": "flux-system",
    "name": "flux-system",
    "reconcileID": "6199ea52-121f-4b65-a8c7-1e2eefd64ffc",
    "error": "failed to checkout and determine revision: unable to clone 'ssh://[email protected]/alex529/hive': dial tcp: lookup github.com on 10.152.183.10:53: read udp 10.1.82.198:54838->10.152.183.10:53: i/o timeout"
}

any idea what can this be?