Trouble scaling up standalone cluster – new nodes stuck on PXE boot

[max18557]

Hello, I am testing EKS Anywhere as a potential container orchestration platform and I'm at the stage where i'm trying to understand maintenance operations like scaling up and performing updates.
However, I'm struggling to scale up my standalone cluster.
When I attempt to add a worker node, the new VM hangs on PXE boot and never proceeds into HookOS. I suspect I'm misunderstanding the scaling process, or doing something incorrectly.

Expected Behavior

The new node should successfully PXE boot, load HookOS, write the OS image and join the cluster as a worker node.
Actual Behavior
The node repeatedly hangs at PXE boot.
It never transitions into HookOS.
After each failed attempt, the cluster is left in a degraded state expecting the missing worker node to join.

Steps to Reproduce:

Create a standalone cluster (1 control plane, 1 worker).
Verify new hardware is visible via:
$kubectl get hardware -n eksa-system --show-labels
(the extra node shows up here).

Update the cluster spec to set the worker node count from 1 → 2.
Run the cluster upgrade command from the admin machine.
Power on the new VM and set it to PXE boot.
Restart the VM every couple of minutes while watching PXE attempts.

Questions

Am I following the correct procedure to scale up a standalone cluster?
What is the recommended way to recover a cluster after a failed scale-up attempt, without recreating it from scratch or restoring from backup?

Environment

eksctl version: 0.214.0
kubectl version: v1.34.0
eksctl anywhere version: v0.23.2
Kubernetes version: v1.31.11-eks-7b6cd08
Node OS: Rocky Linux 9
Admin machine OS: Ubuntu 22.04
Infrastructure: VMs (bare metal install flow – unsupported hypervisor)

Network:
Proxy allows access to all documented EKS-A URLs
/24 subnet
No internet access
No DHCP server

Thank you for you time :)

[rahulbabu95]

Hey @max18557, thanks for your query.

1. For pxe booting to work, admin machine/and all nodes must be in the same L2 network. can you confirm that is the case with your admin machine?
2. For EKS-A to work in an airgapped environment, you must have the airgapped configuration setup on your cluster along with a local registry mirror. Do you have a local registry mirror setup? Refer airgapped setup docs: https://anywhere.eks.amazonaws.com/docs/getting-started/airgapped/
3. What do you see when the vm attempts to pxe boot on the console? Does it receive the boot files from the smee pod running on your management cluster? Do you see the dhcp request making it through to the smee pod in your cluster: k logs -n eksa-system <smee-pod-name> -f or do you see any errors there?
4. Ideally you need not be doing the setting up pxe boot/powering the vm on manually as the tinkerbell workflows should take care of it. Can you check the status of k get wf -n eksa-system <workflow-name> -o yaml, k get jobs.bmc -n eksa-system <netboot-job-name> -o yaml, k get tasks.bmc -n eksa-system <netboot-job-name> -o yaml
5. While when cluster is in a broken state you would need to follow the etcd back and restore steps mentioned in our docs: https://anywhere.eks.amazonaws.com/docs/clustermgmt/cluster-backup-restore/restore-cluster/, in your case since only the new node is error out and not the entire cluster is broken, you can just edit k edit clusters.anywhere <eksa-cluster-name> and reset the count of your worker nodes.

[max18557]

Hello @rahulbabu95, I'll address your questions one by one.

1. Yes all the vms used are in their own /24 network without any DHCP servers
2. I believe my setup is not airgapped because the machines have internet access but it's via a proxy.
3. Here is a screenshot of the worker node i'm trying to add:

As you can see it doesn't get very far. k logs -n eksa-system -f gives me this:

Click to expand logs

{"time":"2025-09-24T09:40:11.841985005Z","level":"INFO","source":{"function":"main.main","file":"cmd/smee/main.go","line":157},"msg":"starting","version":"0b77c7d"} {"time":"2025-09-24T09:40:11.842625335Z","level":"INFO","source":{"function":"main.main","file":"cmd/smee/main.go","line":179},"msg":"starting syslog server","bind_addr":"0.0.0.0:514"} {"time":"2025-09-24T09:40:11.842747358Z","level":"INFO","source":{"function":"main.main","file":"cmd/smee/main.go","line":209},"msg":"starting tftp server","bind_addr":"0.0.0.0:69"} {"time":"2025-09-24T09:40:11.844374151Z","level":"INFO","source":{"function":"github.com/tinkerbell/ipxedust.(*Server).listenAndServeTFTP","file":"tinkerbell/ipxedust@v0.0.0-20241209190914-3b26a5502f13/ipxedust.go","line":201},"msg":"serving iPXE binaries via TFTP","service":"github.co m/tinkerbell/smee","logger":"github.com/tinkerbell/ipxedust","addr":"0.0.0.0:69","blocksize":512,"timeout":5000000000,"singlePortEnabled":true} {"time":"2025-09-24T09:40:11.856440008Z","level":"INFO","source":{"function":"main.main","file":"cmd/smee/main.go","line":291},"msg":"serving http","addr":"0.0.0.0:7171","trusted_proxies":["192.168.0.0/16"]} {"time":"2025-09-24T09:40:11.880558868Z","level":"INFO","source":{"function":"main.main","file":"cmd/smee/main.go","line":304},"msg":"starting dhcp server","bind_addr":"0.0.0.0:67"} {"time":"2025-09-24T09:40:11.880903354Z","level":"INFO","source":{"function":"internal/dhcp/server.(*DHCP).Serve","file":"dhcp/server/dhcp.go","line":35},"msg":"Server listening on","addr":{"IP":"0.0.0.0","Port":67,"Zone":""}} {"time":"2025-09-24T12:47:54.766561055Z","level":"INFO","source":{"function":"dhcp/handler/reservation.(*Handler).Handle","file":"handler/reservation/handler.go","line":92},"msg":"received DHCP packet","mac":"56:6f:31:0c:00:60","xid":"0x11f60317","interface":"eth0","type":"DISCOVER"} {"time":"2025-09-24T12:47:54.766897921Z","level":"INFO","source":{"function":"dhcp/handler/reservation.(*Handler).Handle","file":"handler/reservation/handler.go","line":153},"msg":"sent DHCP response","mac":"56:6f:31:0c:00:60","xid":"0x11f60317","interface":"eth0","type":"OFFER","bootF ileName":"ipxe.efi","nextServer":"adm_ip","ipAddress":"wk02_ip","destination":"192.168.1.242:67"} {"time":"2025-09-24T12:47:58.498319916Z","level":"INFO","source":{"function":"dhcp/handler/reservation.(*Handler).Handle","file":"handler/reservation/handler.go","line":92},"msg":"received DHCP packet","mac":"56:6f:31:0c:00:60","xid":"0x11f60317","interface":"eth0","type":"DISCOVER"} {"time":"2025-09-24T12:47:58.498621278Z","level":"INFO","source":{"function":"dhcp/handler/reservation.(*Handler).Handle","file":"handler/reservation/handler.go","line":153},"msg":"sent DHCP response","mac":"56:6f:31:0c:00:60","xid":"0x11f60317","interface":"eth0","type":"OFFER","bootF ileName":"ipxe.efi","nextServer":"adm_ip","ipAddress":"wk02_ip","destination":"192.168.1.242:67"} {"time":"2025-09-24T12:48:06.498802076Z","level":"INFO","source":{"function":"dhcp/handler/reservation.(*Handler).Handle","file":"handler/reservation/handler.go","line":92},"msg":"received DHCP packet","mac":"56:6f:31:0c:00:60","xid":"0x11f60317","interface":"eth0","type":"DISCOVER"} {"time":"2025-09-24T12:48:06.498965659Z","level":"INFO","source":{"function":"dhcp/handler/reservation.(*Handler).Handle","file":"handler/reservation/handler.go","line":153},"msg":"sent DHCP response","mac":"56:6f:31:0c:00:60","xid":"0x11f60317","interface":"eth0","type":"OFFER","bootF ileName":"ipxe.efi","nextServer":"adm_ip","ipAddress":"wk02_ip","destination":"192.168.1.242:67"} {"time":"2025-09-24T12:48:22.499694756Z","level":"INFO","source":{"function":"dhcp/handler/reservation.(*Handler).Handle","file":"handler/reservation/handler.go","line":92},"msg":"received DHCP packet","mac":"56:6f:31:0c:00:60","xid":"0x11f60317","interface":"eth0","type":"DISCOVER"} {"time":"2025-09-24T12:48:22.500022052Z","level":"INFO","source":{"function":"dhcp/handler/reservation.(*Handler).Handle","file":"handler/reservation/handler.go","line":153},"msg":"sent DHCP response","mac":"56:6f:31:0c:00:60","xid":"0x11f60317","interface":"eth0","type":"OFFER","bootF ileName":"ipxe.efi","nextServer":"adm_ip","ipAddress":"wk02_ip","destination":"192.168.1.242:67"} {"time":"2025-09-24T12:49:57.576786615Z","level":"INFO","source":{"function":"dhcp/handler/reservation.(*Handler).Handle","file":"handler/reservation/handler.go","line":92},"msg":"received DHCP packet","mac":"56:6f:31:0c:00:60","xid":"0x11f6031a","interface":"eth0","type":"DISCOVER"} {"time":"2025-09-24T12:49:57.577303053Z","level":"INFO","source":{"function":"dhcp/handler/reservation.(*Handler).Handle","file":"handler/reservation/handler.go","line":153},"msg":"sent DHCP response","mac":"56:6f:31:0c:00:60","xid":"0x11f6031a","interface":"eth0","type":"OFFER","bootF ileName":"http://adm_ip:7171/ipxe/56:6f:31:0c:00:60/ipxe.efi","nextServer":"adm_ip","ipAddress":"wk02_ip","destination":"192.168.1.242:67"} {"time":"2025-09-24T12:50:01.525878342Z","level":"INFO","source":{"function":"dhcp/handler/reservation.(*Handler).Handle","file":"handler/reservation/handler.go","line":92},"msg":"received DHCP packet","mac":"56:6f:31:0c:00:60","xid":"0x11f6031a","interface":"eth0","type":"DISCOVER"} {"time":"2025-09-24T12:50:01.526495114Z","level":"INFO","source":{"function":"dhcp/handler/reservation.(*Handler).Handle","file":"handler/reservation/handler.go","line":153},"msg":"sent DHCP response","mac":"56:6f:31:0c:00:60","xid":"0x11f6031a","interface":"eth0","type":"OFFER","bootF ileName":"http://adm_ip:7171/ipxe/56:6f:31:0c:00:60/ipxe.efi","nextServer":"adm_ip","ipAddress":"wk02_ip","destination":"192.168.1.242:67"} {"time":"2025-09-24T12:50:09.52680892Z","level":"INFO","source":{"function":"dhcp/handler/reservation.(*Handler).Handle","file":"handler/reservation/handler.go","line":92},"msg":"received DHCP packet","mac":"56:6f:31:0c:00:60","xid":"0x11f6031a","interface":"eth0","type":"DISCOVER"} {"time":"2025-09-24T12:50:09.527244207Z","level":"INFO","source":{"function":"dhcp/handler/reservation.(*Handler).Handle","file":"handler/reservation/handler.go","line":153},"msg":"sent DHCP response","mac":"56:6f:31:0c:00:60","xid":"0x11f6031a","interface":"eth0","type":"OFFER","bootF ileName":"http://adm_ip:7171/ipxe/56:6f:31:0c:00:60/ipxe.efi","nextServer":"adm_ip","ipAddress":"wk02_ip","destination":"192.168.1.242:67"} {"time":"2025-09-24T12:50:25.52705707Z","level":"INFO","source":{"function":"dhcp/handler/reservation.(*Handler).Handle","file":"handler/reservation/handler.go","line":92},"msg":"received DHCP packet","mac":"56:6f:31:0c:00:60","xid":"0x11f6031a","interface":"eth0","type":"DISCOVER"} {"time":"2025-09-24T12:50:25.527205273Z","level":"INFO","source":{"function":"dhcp/handler/reservation.(*Handler).Handle","file":"handler/reservation/handler.go","line":153},"msg":"sent DHCP response","mac":"56:6f:31:0c:00:60","xid":"0x11f6031a","interface":"eth0","type":"OFFER","bootF ileName":"http://adm_ip:7171/ipxe/56:6f:31:0c:00:60/ipxe.efi","nextServer":"adm_ip","ipAddress":"wk02_ip","destination":"192.168.1.242:67"} {"time":"2025-09-24T12:52:26.816977354Z","level":"INFO","source":{"function":"dhcp/handler/reservation.(*Handler).Handle","file":"handler/reservation/handler.go","line":113},"msg":"received DHCP packet","mac":"56:6f:31:0c:00:60","xid":"0xcc6cb992","interface":"eth0","type":"REQUEST"} {"time":"2025-09-24T12:52:26.817605003Z","level":"INFO","source":{"function":"dhcp/handler/reservation.(*Handler).Handle","file":"handler/reservation/handler.go","line":153},"msg":"sent DHCP response","mac":"56:6f:31:0c:00:60","xid":"0xcc6cb992","interface":"eth0","type":"ACK","nextSer ver":"adm_ip","ipAddress":"wk02_ip","destination":"192.168.1.242:67"} {"time":"2025-09-24T12:52:28.816972805Z","level":"INFO","source":{"function":"dhcp/handler/reservation.(*Handler).Handle","file":"handler/reservation/handler.go","line":92},"msg":"received DHCP packet","mac":"56:6f:31:0c:00:60","xid":"0x2d605907","interface":"eth0","type":"DISCOVER"} {"time":"2025-09-24T12:52:28.817307012Z","level":"INFO","source":{"function":"dhcp/handler/reservation.(*Handler).Handle","file":"handler/reservation/handler.go","line":153},"msg":"sent DHCP response","mac":"56:6f:31:0c:00:60","xid":"0x2d605907","interface":"eth0","type":"OFFER","nextS erver":"adm_ip","ipAddress":"wk02_ip","destination":"192.168.1.242:67"} {"time":"2025-09-24T12:52:30.859725075Z","level":"INFO","source":{"function":"dhcp/handler/reservation.(*Handler).Handle","file":"handler/reservation/handler.go","line":92},"msg":"received DHCP packet","mac":"56:6f:31:0c:00:60","xid":"0xcd9aa73b","interface":"eth0","type":"DISCOVER"} {"time":"2025-09-24T12:52:30.860874891Z","level":"INFO","source":{"function":"dhcp/handler/reservation.(*Handler).Handle","file":"handler/reservation/handler.go","line":153},"msg":"sent DHCP response","mac":"56:6f:31:0c:00:60","xid":"0xcd9aa73b","interface":"eth0","type":"OFFER","nextS erver":"adm_ip","ipAddress":"wk02_ip","destination":"192.168.1.242:67"} {"time":"2025-09-24T12:52:35.618441238Z","level":"INFO","source":{"function":"dhcp/handler/reservation.(*Handler).Handle","file":"handler/reservation/handler.go","line":92},"msg":"received DHCP packet","mac":"56:6f:31:0c:00:60","xid":"0x0a1c8ba1","interface":"eth0","type":"DISCOVER"} {"time":"2025-09-24T12:52:35.618799128Z","level":"INFO","source":{"function":"dhcp/handler/reservation.(*Handler).Handle","file":"handler/reservation/handler.go","line":153},"msg":"sent DHCP response","mac":"56:6f:31:0c:00:60","xid":"0x0a1c8ba1","interface":"eth0","type":"OFFER","nextS erver":"adm_ip","ipAddress":"wk02_ip","destination":"192.168.1.242:67"} {"time":"2025-09-24T12:52:43.911436872Z","level":"INFO","source":{"function":"dhcp/handler/reservation.(*Handler).Handle","file":"handler/reservation/handler.go","line":92},"msg":"received DHCP packet","mac":"56:6f:31:0c:00:60","xid":"0x6336bd27","interface":"eth0","type":"DISCOVER"} {"time":"2025-09-24T12:52:43.912450093Z","level":"INFO","source":{"function":"dhcp/handler/reservation.(*Handler).Handle","file":"handler/reservation/handler.go","line":153},"msg":"sent DHCP response","mac":"56:6f:31:0c:00:60","xid":"0x6336bd27","interface":"eth0","type":"OFFER","nextS erver":"adm_ip","ipAddress":"wk02_ip","destination":"192.168.1.242:67"}

I don't see any error maybe the problem is after the DHCP part.
Do you know what logs I should look at next?

4. I know that it's not an idea scenario (no BMC, unsupported hypervisor - Ovirt) but it worked well enough to provision the cluster and working with VMs is less hassle while testing.

5. Worked like a charm thanks 👍

Thank you for your help!

[rahulbabu95]

The error on the screen shot looks like PXE boot request timed out. Are there multiple interfaces attached to the vm. IN that case, can you double check the mac address on the hardware csv matches from the interface that you want to boot from?

[max18557]

Yes I have double checked the that the MAC is correct.

However, there are some issues with my last comment, I've been doing more testing today and i'd like to try and clear things up a bit.
On the subject of the smee logs, i wrongly saw the ACK and concluded that it was working. This doesn't seem to be the case after further testing. I believe the ACK was sent once the VM ipxe boot timed out and it booted into a previous install of eks anywhere on that node and responded to the DHCP offer.

My logs actually look like this

Click to expand logs

{"time":"2025-09-30T12:23:30.934425883Z","level":"INFO","source":{"function":"dhcp/handler/reservation.(*Handler).Handle","file":"handler/reservation/handler.go","line":92},"msg":"received DHCP packet","mac":"56:6f:31:0c:00:60","xid":"0xd0e824a6","interface":"eth0","type":"DISCOVER"} {"time":"2025-09-30T12:23:30.934856073Z","level":"INFO","source":{"function":"dhcp/handler/reservation.(*Handler).Handle","file":"handler/reservation/handler.go","line":153},"msg":"sent DHCP response","mac":"56:6f:31:0c:00:60","xid":"0xd0e824a6","interface":"eth0","type":"OFFER","bootFileName":"ipxe.efi","nextServer":"tinkerbell_ip","ipAddress":"WK02_ip","destination":"192.168.1.46:67"} {"time":"2025-09-30T12:23:34.698550881Z","level":"INFO","source":{"function":"dhcp/handler/reservation.(*Handler).Handle","file":"handler/reservation/handler.go","line":92},"msg":"received DHCP packet","mac":"56:6f:31:0c:00:60","xid":"0xd0e824a6","interface":"eth0","type":"DISCOVER"} {"time":"2025-09-30T12:23:34.699050752Z","level":"INFO","source":{"function":"dhcp/handler/reservation.(*Handler).Handle","file":"handler/reservation/handler.go","line":153},"msg":"sent DHCP response","mac":"56:6f:31:0c:00:60","xid":"0xd0e824a6","interface":"eth0","type":"OFFER","bootFileName":"ipxe.efi","nextServer":"tinkerbell_ip","ipAddress":"WK02_ip","destination":"192.168.1.46:67"} {"time":"2025-09-30T12:23:42.699377622Z","level":"INFO","source":{"function":"dhcp/handler/reservation.(*Handler).Handle","file":"handler/reservation/handler.go","line":92},"msg":"received DHCP packet","mac":"56:6f:31:0c:00:60","xid":"0xd0e824a6","interface":"eth0","type":"DISCOVER"} {"time":"2025-09-30T12:23:42.701807431Z","level":"INFO","source":{"function":"dhcp/handler/reservation.(*Handler).Handle","file":"handler/reservation/handler.go","line":153},"msg":"sent DHCP response","mac":"56:6f:31:0c:00:60","xid":"0xd0e824a6","interface":"eth0","type":"OFFER","bootFileName":"ipxe.efi","nextServer":"tinkerbell_ip","ipAddress":"WK02_ip","destination":"192.168.1.46:67"} {"time":"2025-09-30T12:23:58.699254589Z","level":"INFO","source":{"function":"dhcp/handler/reservation.(*Handler).Handle","file":"handler/reservation/handler.go","line":92},"msg":"received DHCP packet","mac":"56:6f:31:0c:00:60","xid":"0xd0e824a6","interface":"eth0","type":"DISCOVER"} {"time":"2025-09-30T12:23:58.701070317Z","level":"INFO","source":{"function":"dhcp/handler/reservation.(*Handler).Handle","file":"handler/reservation/handler.go","line":153},"msg":"sent DHCP response","mac":"56:6f:31:0c:00:60","xid":"0xd0e824a6","interface":"eth0","type":"OFFER","bootFileName":"ipxe.efi","nextServer":"tinkerbell_ip","ipAddress":"WK02_ip","destination":"192.168.1.46:67"} {"time":"2025-09-30T12:25:33.753019537Z","level":"INFO","source":{"function":"dhcp/handler/reservation.(*Handler).Handle","file":"handler/reservation/handler.go","line":92},"msg":"received DHCP packet","mac":"56:6f:31:0c:00:60","xid":"0xd0e824a9","interface":"eth0","type":"DISCOVER"} {"time":"2025-09-30T12:25:33.753961467Z","level":"INFO","source":{"function":"dhcp/handler/reservation.(*Handler).Handle","file":"handler/reservation/handler.go","line":153},"msg":"sent DHCP response","mac":"56:6f:31:0c:00:60","xid":"0xd0e824a9","interface":"eth0","type":"OFFER","bootFileName":"http://tinkerbell_ip:7171/ipxe/56:6f:31:0c:00:60/ipxe.efi","nextServer":"tinkerbell_ip","ipAddress":"WK02_ip","destination":"192.168.1.46:67"} {"time":"2025-09-30T12:25:37.713975985Z","level":"INFO","source":{"function":"dhcp/handler/reservation.(*Handler).Handle","file":"handler/reservation/handler.go","line":92},"msg":"received DHCP packet","mac":"56:6f:31:0c:00:60","xid":"0xd0e824a9","interface":"eth0","type":"DISCOVER"} {"time":"2025-09-30T12:25:37.714253709Z","level":"INFO","source":{"function":"dhcp/handler/reservation.(*Handler).Handle","file":"handler/reservation/handler.go","line":153},"msg":"sent DHCP response","mac":"56:6f:31:0c:00:60","xid":"0xd0e824a9","interface":"eth0","type":"OFFER","bootFileName":"http://tinkerbell_ip:7171/ipxe/56:6f:31:0c:00:60/ipxe.efi","nextServer":"tinkerbell_ip","ipAddress":"WK02_ip","destination":"192.168.1.46:67"} {"time":"2025-09-30T12:25:45.711740278Z","level":"INFO","source":{"function":"dhcp/handler/reservation.(*Handler).Handle","file":"handler/reservation/handler.go","line":92},"msg":"received DHCP packet","mac":"56:6f:31:0c:00:60","xid":"0xd0e824a9","interface":"eth0","type":"DISCOVER"} {"time":"2025-09-30T12:25:45.71212462Z","level":"INFO","source":{"function":"dhcp/handler/reservation.(*Handler).Handle","file":"handler/reservation/handler.go","line":153},"msg":"sent DHCP response","mac":"56:6f:31:0c:00:60","xid":"0xd0e824a9","interface":"eth0","type":"OFFER","bootFileName":"http://tinkerbell_ip:7171/ipxe/56:6f:31:0c:00:60/ipxe.efi","nextServer":"tinkerbell_ip","ipAddress":"WK02_ip","destination":"192.168.1.46:67"} {"time":"2025-09-30T12:26:01.712243304Z","level":"INFO","source":{"function":"dhcp/handler/reservation.(*Handler).Handle","file":"handler/reservation/handler.go","line":92},"msg":"received DHCP packet","mac":"56:6f:31:0c:00:60","xid":"0xd0e824a9","interface":"eth0","type":"DISCOVER"} {"time":"2025-09-30T12:26:01.713844133Z","level":"INFO","source":{"function":"dhcp/handler/reservation.(*Handler).Handle","file":"handler/reservation/handler.go","line":153},"msg":"sent DHCP response","mac":"56:6f:31:0c:00:60","xid":"0xd0e824a9","interface":"eth0","type":"OFFER","bootFileName":"http://tinkerbell_ip:7171/ipxe/56:6f:31:0c:00:60/ipxe.efi","nextServer":"tinkerbell_ip","ipAddress":"WK02_ip","destination":"192.168.1.46:67"}

It just loops over DHCP discover and DHCP offer, the discover seems to be getting to my smee pod but the DHCP offer is not getting back to the new worker02 node

During the initial provisioning, the docker boots container successfully boots the nodes via ipxe:

Click to expand logs

{"time":"2025-09-30T10:28:17.942089691Z","level":"INFO","source":{"function":"dhcp/handler/reservation.(*Handler).Handle","file":"handler/reservation/handler.go","line":92},"msg":"received DHCP packet","mac":"56:6f:31:0c:00:5c","xid":"0x1d937146","interface":"enp1s0","type":"DISCOVER"} {"time":"2025-09-30T10:28:17.94668036Z","level":"INFO","source":{"function":"dhcp/handler/reservation.(*Handler).Handle","file":"handler/reservation/handler.go","line":153},"msg":"sent DHCP response","mac":"56:6f:31:0c:00:5c","xid":"0x1d937146","interface":"enp1s0","type":"OFFER","bootFileName":"ipxe.efi","nextServer":"adm_machine_ip","ipAddress":"WK01_ip","destination":"255.255.255.255:68"} {"time":"2025-09-30T10:28:21.691343821Z","level":"INFO","source":{"function":"dhcp/handler/reservation.(*Handler).Handle","file":"handler/reservation/handler.go","line":113},"msg":"received DHCP packet","mac":"56:6f:31:0c:00:5c","xid":"0x1d937146","interface":"enp1s0","type":"REQUEST"} {"time":"2025-09-30T10:28:21.69154491Z","level":"INFO","source":{"function":"dhcp/handler/reservation.(*Handler).Handle","file":"handler/reservation/handler.go","line":153},"msg":"sent DHCP response","mac":"56:6f:31:0c:00:5c","xid":"0x1d937146","interface":"enp1s0","type":"ACK","bootFileName":"ipxe.efi","nextServer":"adm_machine_ip","ipAddress":"WK01_ip","destination":"255.255.255.255:68"} {"time":"2025-09-30T10:28:21.700656811Z","level":"ERROR","source":{"function":"tinkerbell/ipxedust/itftp.Handler.HandleRead","file":"ipxedust@v0.0.0-20241209190914-3b26a5502f13/itftp/itftp.go","line":106},"msg":"file serve failed","service":"github.com/tinkerbell/smee","event":"get","filename":"ipxe.efi","uri":"ipxe.efi","client":{"IP":"WK01_ip","Port":1823,"Zone":""},"macFromURI":"","logger":"github.com/tinkerbell/ipxedust","err":"sending block 0: code=8, error: User aborted the transfer\u0000","b":0,"contentSize":1043968} {"time":"2025-09-30T10:28:22.511458539Z","level":"INFO","source":{"function":"tinkerbell/ipxedust/itftp.Handler.HandleRead","file":"ipxedust@v0.0.0-20241209190914-3b26a5502f13/itftp/itftp.go","line":111},"msg":"file served","service":"github.com/tinkerbell/smee","event":"get","filename":"ipxe.efi","uri":"ipxe.efi","client":{"IP":"WK01_ip","Port":1824,"Zone":""},"macFromURI":"","logger":"github.com/tinkerbell/ipxedust","bytesSent":1043968,"contentSize":1043968} {"time":"2025-09-30T10:28:22.519459541Z","level":"ERROR","source":{"function":"tinkerbell/ipxedust/itftp.Handler.HandleRead","file":"ipxedust@v0.0.0-20241209190914-3b26a5502f13/itftp/itftp.go","line":91},"msg":"file unknown","service":"github.com/tinkerbell/smee","event":"get","filename":"autoexec.ipxe","uri":"autoexec.ipxe","client":{"IP":"WK01_ip","Port":1825,"Zone":""},"macFromURI":"","logger":"github.com/tinkerbell/ipxedust","err":"file [autoexec.ipxe] unknown: file does not exist"} {"time":"2025-09-30T10:28:24.792277314Z","level":"INFO","source":{"function":"smee/internal/syslog.(*Receiver).runParser","file":"internal/syslog/receiver.go","line":160},"msg":"msg","msg":{"app-name":"eksa-cp01","facility":"kern","host":"WK01_ip","msg":" ipxe: [Link] Waiting on net0 (1/10)","severity":"INFO"}} {"time":"2025-09-30T10:28:24.792736121Z","level":"INFO","source":{"function":"smee/internal/syslog.(*Receiver).runParser","file":"internal/syslog/receiver.go","line":160},"msg":"msg","msg":{"app-name":"eksa-cp01","facility":"kern","host":"WK01_ip","msg":" ipxe: net0: 56:6f:31:0c:00:5c using virtio-net on 0000:01:00.0 (Ethernet) [open]","severity":"INFO"}}

Maybe the problem is something to do with the DHCP server when it's no longer in docker ?

Any thoughts?

[rahulbabu95]

@max18557 exactly. Thanks for clarifying. This was the reason for my earlier question.
You are right from your admin machine, DHCP packets are going out fine to the vms. But the DHCP offer from your vm (worker node where tinkerbell stack lives) to your new vm that is being booted up isn't going through. I suspect this could be some network configuration issue. Unless there is way to deterministically confirm all the vms are in same L2 network and are able to sent DHCP packets to each other, the upgrade flow for eks-a (any scale-up/k8s version upgrade) won't work.

[max18557]

I just found some kind of workaround.

If i set the smee pod to use host network (wk01's IP):
kubectl -n eksa-system patch deploy smee
--type='merge'
-p '{"spec":{"template":{"spec":{"hostNetwork":true,"dnsPolicy":"ClusterFirstWithHostNet"}}}}'

The IPXE boot works!

This confirms that something is going wrong with the DHCP when traversing the overlay network.
The question now is what is causing this problem in my environment? Why doesn't the default configuration work?

Here's the TCPDUMP with hostNetwork FALSE (default)

07:37:16.372637 enp1s0 B ifindex 2 56:6f:31:0c:00:60 ethertype IPv4 (0x0800), length 395: 0.0.0.0.68 > 255.255.255.255.67: BOOTP/DHCP, Request from 56:6f:31:0c:00:60, length 347 07:37:16.374508 lxc02012cab725a In ifindex 21 02:62:e2:f9:ac:ef ethertype IPv4 (0x0800), length 413: 192.168.1.46.67 > 10.105.113.139.67: BOOTP/DHCP, Request from 56:6f:31:0c:00:60, length 365 07:37:16.374683 lxc2e8374dd7f43 Out ifindex 36 4a:30:2c:32:8f:bd ethertype IPv4 (0x0800), length 413: 192.168.1.46.67 > 192.168.1.85.67: BOOTP/DHCP, Request from 56:6f:31:0c:00:60, length 365 07:37:16.378377 lxc2e8374dd7f43 In ifindex 36 1e:77:85:87:a1:ca ethertype IPv4 (0x0800), length 394: 192.168.1.85.67 > 192.168.1.46.67: BOOTP/DHCP, Reply, length 346 07:37:16.378458 lxc02012cab725a Out ifindex 21 da:0d:f1:10:4e:35 ethertype IPv4 (0x0800), length 394: 10.105.113.139.67 > 192.168.1.46.67: BOOTP/DHCP, Reply, length 346 07:37:20.115637 enp1s0 B ifindex 2 56:6f:31:0c:00:60 ethertype IPv4 (0x0800), length 395: 0.0.0.0.68 > 255.255.255.255.67: BOOTP/DHCP, Request from 56:6f:31:0c:00:60, length 347 07:37:20.115867 lxc02012cab725a In ifindex 21 02:62:e2:f9:ac:ef ethertype IPv4 (0x0800), length 413: 192.168.1.46.67 > 10.105.113.139.67: BOOTP/DHCP, Request from 56:6f:31:0c:00:60, length 365 07:37:20.115906 lxc2e8374dd7f43 Out ifindex 36 4a:30:2c:32:8f:bd ethertype IPv4 (0x0800), length 413: 192.168.1.46.67 > 192.168.1.85.67: BOOTP/DHCP, Request from 56:6f:31:0c:00:60, length 365 07:37:20.118809 lxc2e8374dd7f43 In ifindex 36 1e:77:85:87:a1:ca ethertype IPv4 (0x0800), length 394: 192.168.1.85.67 > 192.168.1.46.67: BOOTP/DHCP, Reply, length 346 07:37:20.118837 lxc02012cab725a Out ifindex 21 da:0d:f1:10:4e:35 ethertype IPv4 (0x0800), length 394: 10.105.113.139.67 > 192.168.1.46.67: BOOTP/DHCP, Reply, length 346 07:37:28.115952 enp1s0 B ifindex 2 56:6f:31:0c:00:60 ethertype IPv4 (0x0800), length 395: 0.0.0.0.68 > 255.255.255.255.67: BOOTP/DHCP, Request from 56:6f:31:0c:00:60, length 347 07:37:28.116416 lxc02012cab725a In ifindex 21 02:62:e2:f9:ac:ef ethertype IPv4 (0x0800), length 413: 192.168.1.46.67 > 10.105.113.139.67: BOOTP/DHCP, Request from 56:6f:31:0c:00:60, length 365 07:37:28.116445 lxc2e8374dd7f43 Out ifindex 36 4a:30:2c:32:8f:bd ethertype IPv4 (0x0800), length 413: 192.168.1.46.67 > 192.168.1.85.67: BOOTP/DHCP, Request from 56:6f:31:0c:00:60, length 365 07:37:28.118996 lxc2e8374dd7f43 In ifindex 36 1e:77:85:87:a1:ca ethertype IPv4 (0x0800), length 394: 192.168.1.85.67 > 192.168.1.46.67: BOOTP/DHCP, Reply, length 346 07:37:28.119019 lxc02012cab725a Out ifindex 21 da:0d:f1:10:4e:35 ethertype IPv4 (0x0800), length 394: 10.105.113.139.67 > 192.168.1.46.67: BOOTP/DHCP, Reply, length 346 07:37:44.116409 enp1s0 B ifindex 2 56:6f:31:0c:00:60 ethertype IPv4 (0x0800), length 395: 0.0.0.0.68 > 255.255.255.255.67: BOOTP/DHCP, Request from 56:6f:31:0c:00:60, length 347 07:37:44.116807 lxc02012cab725a In ifindex 21 02:62:e2:f9:ac:ef ethertype IPv4 (0x0800), length 413: 192.168.1.46.67 > 10.105.113.139.67: BOOTP/DHCP, Request from 56:6f:31:0c:00:60, length 365 07:37:44.116887 lxc2e8374dd7f43 Out ifindex 36 4a:30:2c:32:8f:bd ethertype IPv4 (0x0800), length 413: 192.168.1.46.67 > 192.168.1.85.67: BOOTP/DHCP, Request from 56:6f:31:0c:00:60, length 365 07:37:44.118612 lxc2e8374dd7f43 In ifindex 36 1e:77:85:87:a1:ca ethertype IPv4 (0x0800), length 394: 192.168.1.85.67 > 192.168.1.46.67: BOOTP/DHCP, Reply, length 346 07:37:44.118657 lxc02012cab725a Out ifindex 21 da:0d:f1:10:4e:35 ethertype IPv4 (0x0800), length 394: 10.105.113.139.67 > 192.168.1.46.67: BOOTP/DHCP, Reply, length 346 07:38:30.971029 enp1s0 B ifindex 2 56:6f:31:0c:00:60 ethertype IPv4 (0x0800), length 395: 0.0.0.0.68 > 255.255.255.255.67: BOOTP/DHCP, Request from 56:6f:31:0c:00:60, length 347 07:38:30.971713 lxc02012cab725a In ifindex 21 02:62:e2:f9:ac:ef ethertype IPv4 (0x0800), length 413: 192.168.1.46.67 > 10.105.113.139.67: BOOTP/DHCP, Request from 56:6f:31:0c:00:60, length 365 07:38:30.971792 lxc2e8374dd7f43 Out ifindex 36 4a:30:2c:32:8f:bd ethertype IPv4 (0x0800), length 413: 192.168.1.46.67 > 192.168.1.85.67: BOOTP/DHCP, Request from 56:6f:31:0c:00:60, length 365 07:38:30.975539 lxc2e8374dd7f43 In ifindex 36 1e:77:85:87:a1:ca ethertype IPv4 (0x0800), length 394: 192.168.1.85.67 > 192.168.1.46.67: BOOTP/DHCP, Reply, length 346 07:38:30.975587 lxc02012cab725a Out ifindex 21 da:0d:f1:10:4e:35 ethertype IPv4 (0x0800), length 394: 10.105.113.139.67 > 192.168.1.46.67: BOOTP/DHCP, Reply, length 346 07:38:34.861020 enp1s0 B ifindex 2 56:6f:31:0c:00:60 ethertype IPv4 (0x0800), length 395: 0.0.0.0.68 > 255.255.255.255.67: BOOTP/DHCP, Request from 56:6f:31:0c:00:60, length 347 07:38:34.861281 lxc02012cab725a In ifindex 21 02:62:e2:f9:ac:ef ethertype IPv4 (0x0800), length 413: 192.168.1.46.67 > 10.105.113.139.67: BOOTP/DHCP, Request from 56:6f:31:0c:00:60, length 365 07:38:34.861317 lxc2e8374dd7f43 Out ifindex 36 4a:30:2c:32:8f:bd ethertype IPv4 (0x0800), length 413: 192.168.1.46.67 > 192.168.1.85.67: BOOTP/DHCP, Request from 56:6f:31:0c:00:60, length 365 07:38:34.862432 lxc2e8374dd7f43 In ifindex 36 1e:77:85:87:a1:ca ethertype IPv4 (0x0800), length 394: 192.168.1.85.67 > 192.168.1.46.67: BOOTP/DHCP, Reply, length 346 07:38:34.862476 lxc02012cab725a Out ifindex 21 da:0d:f1:10:4e:35 ethertype IPv4 (0x0800), length 394: 10.105.113.139.67 > 192.168.1.46.67: BOOTP/DHCP, Reply, length 346 07:38:42.861418 enp1s0 B ifindex 2 56:6f:31:0c:00:60 ethertype IPv4 (0x0800), length 395: 0.0.0.0.68 > 255.255.255.255.67: BOOTP/DHCP, Request from 56:6f:31:0c:00:60, length 347 07:38:42.861714 lxc02012cab725a In ifindex 21 02:62:e2:f9:ac:ef ethertype IPv4 (0x0800), length 413: 192.168.1.46.67 > 10.105.113.139.67: BOOTP/DHCP, Request from 56:6f:31:0c:00:60, length 365 07:38:42.861750 lxc2e8374dd7f43 Out ifindex 36 4a:30:2c:32:8f:bd ethertype IPv4 (0x0800), length 413: 192.168.1.46.67 > 192.168.1.85.67: BOOTP/DHCP, Request from 56:6f:31:0c:00:60, length 365 07:38:42.862679 lxc2e8374dd7f43 In ifindex 36 1e:77:85:87:a1:ca ethertype IPv4 (0x0800), length 394: 192.168.1.85.67 > 192.168.1.46.67: BOOTP/DHCP, Reply, length 346 07:38:42.862695 lxc02012cab725a Out ifindex 21 da:0d:f1:10:4e:35 ethertype IPv4 (0x0800), length 394: 10.105.113.139.67 > 192.168.1.46.67: BOOTP/DHCP, Reply, length 346 07:38:58.862113 enp1s0 B ifindex 2 56:6f:31:0c:00:60 ethertype IPv4 (0x0800), length 395: 0.0.0.0.68 > 255.255.255.255.67: BOOTP/DHCP, Request from 56:6f:31:0c:00:60, length 347 07:38:58.862984 lxc02012cab725a In ifindex 21 02:62:e2:f9:ac:ef ethertype IPv4 (0x0800), length 413: 192.168.1.46.67 > 10.105.113.139.67: BOOTP/DHCP, Request from 56:6f:31:0c:00:60, length 365 07:38:58.863029 lxc2e8374dd7f43 Out ifindex 36 4a:30:2c:32:8f:bd ethertype IPv4 (0x0800), length 413: 192.168.1.46.67 > 192.168.1.85.67: BOOTP/DHCP, Request from 56:6f:31:0c:00:60, length 365 07:38:58.864356 lxc2e8374dd7f43 In ifindex 36 1e:77:85:87:a1:ca ethertype IPv4 (0x0800), length 394: 192.168.1.85.67 > 192.168.1.46.67: BOOTP/DHCP, Reply, length 346 07:38:58.864379 lxc02012cab725a Out ifindex 21 da:0d:f1:10:4e:35 ethertype IPv4 (0x0800), length 394: 10.105.113.139.67 > 192.168.1.46.67: BOOTP/DHCP, Reply, length 346 07:38:59.146244 enp1s0 B ifindex 2 56:6f:31:0b:00:82 ethertype IPv4 (0x0800), length 341: 0.0.0.0.68 > 255.255.255.255.67: BOOTP/DHCP, Request from 56:6f:31:0b:00:82, length 293 07:38:59.146625 lxc02012cab725a In ifindex 21 02:62:e2:f9:ac:ef ethertype IPv4 (0x0800), length 359: 192.168.1.46.67 > 10.105.113.139.67: BOOTP/DHCP, Request from 56:6f:31:0b:00:82, length 311 07:38:59.146665 lxc2e8374dd7f43 Out ifindex 36 4a:30:2c:32:8f:bd ethertype IPv4 (0x0800), length 359: 192.168.1.46.67 > 192.168.1.85.67: BOOTP/DHCP, Request from 56:6f:31:0b:00:82, length 311 07:39:01.145811 enp1s0 B ifindex 2 56:6f:31:0b:00:82 ethertype IPv4 (0x0800), length 341: 0.0.0.0.68 > 255.255.255.255.67: BOOTP/DHCP, Request from 56:6f:31:0b:00:82, length 293 07:39:01.146168 lxc02012cab725a In ifindex 21 02:62:e2:f9:ac:ef ethertype IPv4 (0x0800), length 359: 192.168.1.46.67 > 10.105.113.139.67: BOOTP/DHCP, Request from 56:6f:31:0b:00:82, length 311 07:39:01.146210 lxc2e8374dd7f43 Out ifindex 36 4a:30:2c:32:8f:bd ethertype IPv4 (0x0800), length 359: 192.168.1.46.67 > 192.168.1.85.67: BOOTP/DHCP, Request from 56:6f:31:0b:00:82, length 311 07:39:03.204903 enp1s0 B ifindex 2 56:6f:31:0b:00:82 ethertype IPv4 (0x0800), length 341: 0.0.0.0.68 > 255.255.255.255.67: BOOTP/DHCP, Request from 56:6f:31:0b:00:82, length 293 07:39:03.205182 lxc02012cab725a In ifindex 21 02:62:e2:f9:ac:ef ethertype IPv4 (0x0800), length 359: 192.168.1.46.67 > 10.105.113.139.67: BOOTP/DHCP, Request from 56:6f:31:0b:00:82, length 311 07:39:03.205217 lxc2e8374dd7f43 Out ifindex 36 4a:30:2c:32:8f:bd ethertype IPv4 (0x0800), length 359: 192.168.1.46.67 > 192.168.1.85.67: BOOTP/DHCP, Request from 56:6f:31:0b:00:82, length 311 07:39:07.394527 enp1s0 B ifindex 2 56:6f:31:0b:00:82 ethertype IPv4 (0x0800), length 341: 0.0.0.0.68 > 255.255.255.255.67: BOOTP/DHCP, Request from 56:6f:31:0b:00:82, length 293 07:39:07.395008 lxc02012cab725a In ifindex 21 02:62:e2:f9:ac:ef ethertype IPv4 (0x0800), length 359: 192.168.1.46.67 > 10.105.113.139.67: BOOTP/DHCP, Request from 56:6f:31:0b:00:82, length 311 07:39:07.395057 lxc2e8374dd7f43 Out ifindex 36 4a:30:2c:32:8f:bd ethertype IPv4 (0x0800), length 359: 192.168.1.46.67 > 192.168.1.85.67: BOOTP/DHCP, Request from 56:6f:31:0b:00:82, length 311 07:39:15.530808 enp1s0 B ifindex 2 56:6f:31:0b:00:82 ethertype IPv4 (0x0800), length 341: 0.0.0.0.68 > 255.255.255.255.67: BOOTP/DHCP, Request from 56:6f:31:0b:00:82, length 293 07:39:15.531035 lxc02012cab725a In ifindex 21 02:62:e2:f9:ac:ef ethertype IPv4 (0x0800), length 359: 192.168.1.46.67 > 10.105.113.139.67: BOOTP/DHCP, Request from 56:6f:31:0b:00:82, length 311 07:39:15.531065 lxc2e8374dd7f43 Out ifindex 36 4a:30:2c:32:8f:bd ethertype IPv4 (0x0800), length 359: 192.168.1.46.67 > 192.168.1.85.67: BOOTP/DHCP, Request from 56:6f:31:0b:00:82, length 311 07:39:17.825268 enp1s0 B ifindex 2 56:6f:31:0b:01:17 ethertype IPv4 (0x0800), length 341: 0.0.0.0.68 > 255.255.255.255.67: BOOTP/DHCP, Request from 56:6f:31:0b:01:17, length 293 07:39:17.826453 lxc02012cab725a In ifindex 21 02:62:e2:f9:ac:ef ethertype IPv4 (0x0800), length 359: 192.168.1.46.67 > 10.105.113.139.67: BOOTP/DHCP, Request from 56:6f:31:0b:01:17, length 311 07:39:17.826502 lxc2e8374dd7f43 Out ifindex 36 4a:30:2c:32:8f:bd ethertype IPv4 (0x0800), length 359: 192.168.1.46.67 > 192.168.1.85.67: BOOTP/DHCP, Request from 56:6f:31:0b:01:17, length 311 07:39:19.824700 enp1s0 B ifindex 2 56:6f:31:0b:01:17 ethertype IPv4 (0x0800), length 341: 0.0.0.0.68 > 255.255.255.255.67: BOOTP/DHCP, Request from 56:6f:31:0b:01:17, length 293 07:39:19.825337 lxc02012cab725a In ifindex 21 02:62:e2:f9:ac:ef ethertype IPv4 (0x0800), length 359: 192.168.1.46.67 > 10.105.113.139.67: BOOTP/DHCP, Request from 56:6f:31:0b:01:17, length 311 07:39:19.825368 lxc2e8374dd7f43 Out ifindex 36 4a:30:2c:32:8f:bd ethertype IPv4 (0x0800), length 359: 192.168.1.46.67 > 192.168.1.85.67: BOOTP/DHCP, Request from 56:6f:31:0b:01:17, length 311 07:39:22.288773 enp1s0 B ifindex 2 56:6f:31:0b:01:17 ethertype IPv4 (0x0800), length 341: 0.0.0.0.68 > 255.255.255.255.67: BOOTP/DHCP, Request from 56:6f:31:0b:01:17, length 293 07:39:22.289646 lxc02012cab725a In ifindex 21 02:62:e2:f9:ac:ef ethertype IPv4 (0x0800), length 359: 192.168.1.46.67 > 10.105.113.139.67: BOOTP/DHCP, Request from 56:6f:31:0b:01:17, length 311 07:39:22.289684 lxc2e8374dd7f43 Out ifindex 36 4a:30:2c:32:8f:bd ethertype IPv4 (0x0800), length 359: 192.168.1.46.67 > 192.168.1.85.67: BOOTP/DHCP, Request from 56:6f:31:0b:01:17, length 311 07:39:27.125331 enp1s0 B ifindex 2 56:6f:31:0b:01:17 ethertype IPv4 (0x0800), length 341: 0.0.0.0.68 > 255.255.255.255.67: BOOTP/DHCP, Request from 56:6f:31:0b:01:17, length 293 07:39:27.126645 lxc02012cab725a In ifindex 21 02:62:e2:f9:ac:ef ethertype IPv4 (0x0800), length 359: 192.168.1.46.67 > 10.105.113.139.67: BOOTP/DHCP, Request from 56:6f:31:0b:01:17, length 311 07:39:27.126678 lxc2e8374dd7f43 Out ifindex 36 4a:30:2c:32:8f:bd ethertype IPv4 (0x0800), length 359: 192.168.1.46.67 > 192.168.1.85.67: BOOTP/DHCP, Request from 56:6f:31

Here's the TCPDUMP with hostNetwork TRUE

08:39:51.240235 enp1s0 B ifindex 2 56:6f:31:0c:00:60 ethertype IPv4 (0x0800), length 395: 0.0.0.0.68 > 255.255.255.255.67: BOOTP/DHCP, Request from 56:6f:31:0c:00:60, length 347 08:39:51.241063 lxc02012cab725a In ifindex 21 02:62:e2:f9:ac:ef ethertype IPv4 (0x0800), length 413: 192.168.1.46.67 > 10.105.113.139.67: BOOTP/DHCP, Request from 56:6f:31:0c:00:60, length 365 08:39:51.248606 lxc02012cab725a Out ifindex 21 da:0d:f1:10:4e:35 ethertype IPv4 (0x0800), length 394: WK01_ip.67 > 192.168.1.46.67: BOOTP/DHCP, Reply, length 346 08:39:51.250752 enp1s0 Out ifindex 2 56:6f:31:0c:00:5f ethertype IPv4 (0x0800), length 376: WK01_ip.67 > 255.255.255.255.68: BOOTP/DHCP, Reply, length 328 08:39:54.989509 enp1s0 B ifindex 2 56:6f:31:0c:00:60 ethertype IPv4 (0x0800), length 407: 0.0.0.0.68 > 255.255.255.255.67: BOOTP/DHCP, Request from 56:6f:31:0c:00:60, length 359 08:39:54.989775 lxc02012cab725a In ifindex 21 02:62:e2:f9:ac:ef ethertype IPv4 (0x0800), length 425: 192.168.1.46.67 > 10.105.113.139.67: BOOTP/DHCP, Request from 56:6f:31:0c:00:60, length 377 08:39:54.992353 enp1s0 Out ifindex 2 56:6f:31:0c:00:5f ethertype IPv4 (0x0800), length 376: WK01_ip.67 > 255.255.255.255.68: BOOTP/DHCP, Reply, length 328 08:39:54.993620 lxc02012cab725a Out ifindex 21 da:0d:f1:10:4e:35 ethertype IPv4 (0x0800), length 394: WK01_ip.67 > 192.168.1.46.67: BOOTP/DHCP, Reply, length 346 08:40:02.964672 enp1s0 B ifindex 2 56:6f:31:0c:00:60 ethertype IPv4 (0x0800), length 443: 0.0.0.0.68 > 255.255.255.255.67: BOOTP/DHCP, Request from 56:6f:31:0c:00:60, length 395 08:40:02.964872 lxc02012cab725a In ifindex 21 02:62:e2:f9:ac:ef ethertype IPv4 (0x0800), length 461: 192.168.1.46.67 > 10.105.113.139.67: BOOTP/DHCP, Request from 56:6f:31:0c:00:60, length 413 08:40:02.967838 lxc02012cab725a Out ifindex 21 da:0d:f1:10:4e:35 ethertype IPv4 (0x0800), length 403: WK01_ip.67 > 192.168.1.46.67: BOOTP/DHCP, Reply, length 355 08:40:02.968050 enp1s0 Out ifindex 2 56:6f:31:0c:00:5f ethertype IPv4 (0x0800), length 385: WK01_ip.67 > 255.255.255.255.68: BOOTP/DHCP, Reply, length 337 08:40:03.959883 enp1s0 B ifindex 2 56:6f:31:0c:00:60 ethertype IPv4 (0x0800), length 443: 0.0.0.0.68 > 255.255.255.255.67: BOOTP/DHCP, Request from 56:6f:31:0c:00:60, length 395 08:40:03.960590 lxc02012cab725a In ifindex 21 02:62:e2:f9:ac:ef ethertype IPv4 (0x0800), length 461: 192.168.1.46.67 > 10.105.113.139.67: BOOTP/DHCP, Request from 56:6f:31:0c:00:60, length 413 08:40:03.962654 enp1s0 Out ifindex 2 56:6f:31:0c:00:5f ethertype IPv4 (0x0800), length 385: WK01_ip.67 > 255.255.255.255.68: BOOTP/DHCP, Reply, length 337 08:40:03.963806 lxc02012cab725a Out ifindex 21 da:0d:f1:10:4e:35 ethertype IPv4 (0x0800), length 403: WK01_ip.67 > 192.168.1.46.67: BOOTP/DHCP, Reply, length 355 08:40:05.961150 enp1s0 B ifindex 2 56:6f:31:0c:00:60 ethertype IPv4 (0x0800), length 455: 0.0.0.0.68 > 255.255.255.255.67: BOOTP/DHCP, Request from 56:6f:31:0c:00:60, length 407 08:40:05.961601 lxc02012cab725a In ifindex 21 02:62:e2:f9:ac:ef ethertype IPv4 (0x0800), length 473: 192.168.1.46.67 > 10.105.113.139.67: BOOTP/DHCP, Request from 56:6f:31:0c:00:60, length 425 08:40:05.967129 lxc02012cab725a Out ifindex 21 da:0d:f1:10:4e:35 ethertype IPv4 (0x0800), length 403: WK01_ip.67 > 192.168.1.46.67: BOOTP/DHCP, Reply, length 355 08:40:05.968955 enp1s0 Out ifindex 2 56:6f:31:0c:00:5f ethertype IPv4 (0x0800), length 385: WK01_ip.67 > 255.255.255.255.68: BOOTP/DHCP, Reply, length 337 08:40:06.878537 enp1s0 B ifindex 2 56:6f:31:0c:00:60 ethertype IPv4 (0x0800), length 443: 0.0.0.0.68 > 255.255.255.255.67: BOOTP/DHCP, Request from 56:6f:31:0c:00:60, length 395 08:40:06.878715 lxc02012cab725a In ifindex 21 02:62:e2:f9:ac:ef ethertype IPv4 (0x0800), length 461: 192.168.1.46.67 > 10.105.113.139.67: BOOTP/DHCP, Request from 56:6f:31:0c:00:60, length 413 08:40:06.880868 enp1s0 Out ifindex 2 56:6f:31:0c:00:5f ethertype IPv4 (0x0800), length 385: WK01_ip.67 > 255.255.255.255.68: BOOTP/DHCP, Reply, length 337 08:40:06.881508 lxc02012cab725a Out ifindex 21 da:0d:f1:1