Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

All Thread devices suddenly failed to setup with "Network is unreachable" #3889

Open
Mosher23 opened this issue Jan 13, 2025 · 11 comments
Open

All Thread devices suddenly failed to setup with "Network is unreachable" #3889

Mosher23 opened this issue Jan 13, 2025 · 11 comments
Labels
add-on: matter_server

Comments

@Mosher23
Copy link

Describe the issue you are experiencing

Hi,

so I have been using Matter server add-on for more than half a year with almost no issues.
But now both of my Aqara devices not updating in HA, even they continue perfectly working in Apple Home.
I use Homepod mini as Thread Boarder router.
Devices:

  1. Aqara door lock u200
  2. Aqara Door sensor P2

Please help me to find the root cause. I have a lot automation tied to the door.

Thanks

What type of installation are you running?

Home Assistant OS

Which operating system are you running on?

Home Assistant Operating System

Which add-on are you reporting an issue with?

Matter Server

What is the version of the add-on?

7.0.0

Steps to reproduce the issue

I have no idea how to reproduce it.

System Health information

System Information

version core-2025.1.2
installation_type Home Assistant OS
dev false
hassio true
docker true
user root
virtualenv false
python_version 3.13.1
os_name Linux
os_version 6.6.66-haos
arch x86_64
timezone Europe/Berlin
config_dir /config
Home Assistant Community Store
GitHub API ok
GitHub Content ok
GitHub Web ok
HACS Data ok
GitHub API Calls Remaining 4994
Installed Version 2.0.1
Stage running
Available Repositories 1565
Downloaded Repositories 61
Home Assistant Cloud
logged_in false
can_reach_cert_server ok
can_reach_cloud_auth ok
can_reach_cloud ok
Home Assistant Supervisor
host_os Home Assistant OS 14.1
update_channel stable
supervisor_version supervisor-2024.12.3
agent_version 1.6.0
docker_version 27.2.0
disk_total 97.7 GB
disk_used 25.1 GB
healthy true
supported true
host_connectivity true
supervisor_connectivity true
ntp_synchronized true
virtualization kvm
board ova
supervisor_api ok
version_api ok
installed_addons ESPHome Device Builder (2024.12.2), Mosquitto broker (6.4.1), Zigbee2MQTT (2.0.0-2), Studio Code Server (5.18.0), PS5 MQTT (1.4.0), Matter Server (7.0.0), Whisper (2.4.0), Piper (1.5.2), Samba share (12.3.2), Advanced SSH & Web Terminal (20.0.0), Wmbusmeters (W-MBus to MQTT) (1.18.0-RC1)
Dashboards
dashboards 1
resources 37
views 10
mode storage
Recorder
oldest_recorder_run January 2, 2025 at 07:53
current_recorder_run January 13, 2025 at 16:55
estimated_db_size 1849.29 MiB
database_engine sqlite
database_version 3.47.1

Anything in the Supervisor logs that might be useful for us?

No response

Anything in the add-on logs that might be useful for us?

2025-01-13 17:06:25.911 (MainThread) INFO [matter_server.server.device_controller] <Node:7> Retrying node setup in 60 seconds...
2025-01-13 17:07:25.613 (MainThread) INFO [matter_server.server.device_controller] <Node:4> Setting-up node...
2025-01-13 17:07:25.613 (MainThread) DEBUG [matter_server.server.sdk] <Node:4> Attempting to establish CASE session... (attempt 1 of 2)
2025-01-13 17:07:25.913 (MainThread) INFO [matter_server.server.device_controller] <Node:7> Setting-up node...
2025-01-13 17:07:25.913 (MainThread) DEBUG [matter_server.server.sdk] <Node:7> Attempting to establish CASE session... (attempt 1 of 2)
2025-01-13 17:07:25.931 (Dummy-2) CHIP_ERROR [chip.native.IN] SendMessage() to UDP:[fd65:caf0:c790:0:174a:669e:5fff:d49d]:5540 failed: src/inet/UDPEndPointImplSockets.cpp:421: OS Error 0x02000065: Network is unreachable
2025-01-13 17:07:25.931 (Dummy-2) CHIP_ERROR [chip.native.-] src/inet/UDPEndPointImplSockets.cpp:421: OS Error 0x02000065: Network is unreachable at src/app/OperationalSessionSetup.cpp:254
2025-01-13 17:07:26.119 (Dummy-2) CHIP_ERROR [chip.native.IN] SendMessage() to UDP:[fd65:caf0:c790:0:647d:b189:ec15:cb1d]:5540 failed: src/inet/UDPEndPointImplSockets.cpp:421: OS Error 0x02000065: Network is unreachable
2025-01-13 17:07:26.119 (Dummy-2) CHIP_ERROR [chip.native.-] src/inet/UDPEndPointImplSockets.cpp:421: OS Error 0x02000065: Network is unreachable at src/app/OperationalSessionSetup.cpp:254
2025-01-13 17:07:28.936 (MainThread) DEBUG [matter_server.server.sdk] <Node:4> Establishing CASE session took 3.3 seconds
2025-01-13 17:07:28.937 (MainThread) INFO [matter_server.server.sdk] <Node:4> Attempting to establish CASE session... (attempt 2 of 2)
2025-01-13 17:07:29.120 (MainThread) DEBUG [matter_server.server.sdk] <Node:7> Establishing CASE session took 3.2 seconds
2025-01-13 17:07:29.120 (MainThread) INFO [matter_server.server.sdk] <Node:7> Attempting to establish CASE session... (attempt 2 of 2)
2025-01-13 17:07:29.260 (Dummy-2) CHIP_ERROR [chip.native.IN] SendMessage() to UDP:[fd65:caf0:c790:0:174a:669e:5fff:d49d]:5540 failed: src/inet/UDPEndPointImplSockets.cpp:421: OS Error 0x02000065: Network is unreachable
2025-01-13 17:07:29.260 (Dummy-2) CHIP_ERROR [chip.native.-] src/inet/UDPEndPointImplSockets.cpp:421: OS Error 0x02000065: Network is unreachable at src/app/OperationalSessionSetup.cpp:254
2025-01-13 17:07:29.260 (MainThread) DEBUG [matter_server.server.sdk] <Node:4> Establishing CASE session took 0.3 seconds
2025-01-13 17:07:29.260 (MainThread) WARNING [matter_server.server.device_controller] <Node:4> Setup for node failed: Unable to establish CASE session with Node 4
Traceback (most recent call last):
  File "/usr/local/lib/python3.12/site-packages/matter_server/server/sdk.py", line 392, in find_or_establish_case_session
    return await self._chip_controller.GetConnectedDevice(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/chip/ChipDeviceCtrl.py", line 1090, in GetConnectedDevice
    await future
chip.exceptions.ChipStackError: src/inet/UDPEndPointImplSockets.cpp:421: OS Error 0x02000065: Network is unreachable
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.12/site-packages/matter_server/server/device_controller.py", line 1371, in _setup_node_try_once
    await self._chip_device_controller.find_or_establish_case_session(
  File "/usr/local/lib/python3.12/site-packages/matter_server/server/sdk.py", line 400, in find_or_establish_case_session
    raise NodeNotResolving(
matter_server.common.errors.NodeNotResolving: Unable to establish CASE session with Node 4
2025-01-13 17:07:29.261 (MainThread) INFO [matter_server.server.device_controller] <Node:4> Retrying node setup in 60 seconds...
2025-01-13 17:07:29.324 (Dummy-2) CHIP_ERROR [chip.native.IN] SendMessage() to UDP:[fd65:caf0:c790:0:647d:b189:ec15:cb1d]:5540 failed: src/inet/UDPEndPointImplSockets.cpp:421: OS Error 0x02000065: Network is unreachable
2025-01-13 17:07:29.324 (Dummy-2) CHIP_ERROR [chip.native.-] src/inet/UDPEndPointImplSockets.cpp:421: OS Error 0x02000065: Network is unreachable at src/app/OperationalSessionSetup.cpp:254
2025-01-13 17:07:29.325 (MainThread) DEBUG [matter_server.server.sdk] <Node:7> Establishing CASE session took 0.2 seconds
2025-01-13 17:07:29.325 (MainThread) WARNING [matter_server.server.device_controller] <Node:7> Setup for node failed: Unable to establish CASE session with Node 7
Traceback (most recent call last):
  File "/usr/local/lib/python3.12/site-packages/matter_server/server/sdk.py", line 392, in find_or_establish_case_session
    return await self._chip_controller.GetConnectedDevice(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/chip/ChipDeviceCtrl.py", line 1090, in GetConnectedDevice
    await future
chip.exceptions.ChipStackError: src/inet/UDPEndPointImplSockets.cpp:421: OS Error 0x02000065: Network is unreachable
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
  File "/usr/local/lib/python3.12/site-packages/matter_server/server/device_controller.py", line 1371, in _setup_node_try_once
    await self._chip_device_controller.find_or_establish_case_session(
  File "/usr/local/lib/python3.12/site-packages/matter_server/server/sdk.py", line 400, in find_or_establish_case_session
    raise NodeNotResolving(
matter_server.common.errors.NodeNotResolving: Unable to establish CASE session with Node 7

Additional information

No response
@ChristianForstner
Copy link

I can confirm, this behavior on my setup as well. I'm running HA Yellow with only Nanoleaf Downlights and Sense+ Switches and it's super unstable. Here is a log after restarting the Matter server:matter_log.txt

@parhedberg
Copy link

Same issue here to, using skyconnect. Guess it game with latest upgrade.

@drbroccoli
Copy link

Same issue. Latest update broke all my devices, I had to restore a backup.

@agners
Copy link
Member

agners commented Jan 17, 2025

@Mosher23

chip.exceptions.ChipStackError: src/inet/UDPEndPointImplSockets.cpp:421: OS Error 0x02000065: Network is unreachable

It seems that the Matter Server add-on no longer can communicate with the Thread devices on a IP(v6) level.

Do you have multiple HomePods? Did you introduce new HomePods recently? Can you maybe try restarting the one unit to see if that helps?

What hardware do you run Home Assistant on exactly? Do you have your Home Assistant installation connected through Ethernet?

@ChristianForstner Your case is definitely different, as there is no such line in the log.

@parhedberg @drbroccoli unless you have the same "Network is unreachable" error, it is likely a different root cause.

@ChristianForstner

This comment has been minimized.

Sign in to view
@agners agners mentioned this issue Jan 20, 2025
Open
@agners
Copy link
Member

agners commented Jan 20, 2025

@ChristianForstner as I wrote above, your case is different. Don't "me too" unless you see the same error message in the logs. I've moved your case in a new issue at #3900.

@velocityzen
Copy link

Same for me.

core_matter_server_2025-01-20T18-19-56.708Z.log

@agners
Copy link
Member

agners commented Jan 21, 2025

@velocityzen can you describe your whole setup a bit in more detail? Especially, what is your Home Assistant installation running on, what Thread border router do you use and how are the two connected (Ethernet/WiFi, brand of network equipment).

@agners agners changed the title All devices suddenly failed to setup All Thread devices suddenly failed to setup with "Network is unreachable" Jan 21, 2025
@velocityzen
Copy link

velocityzen commented Jan 22, 2025 •
edited
Loading

it is Raspberry Pi 4 with Home Assistant OS 2025.1.2

Networks:

  • Wifi
  • Z-Wave (Aeotec Z-Stick7)
  • Thread (Aeotec Zi-Stick with official Thread Firmware)

Z-Wave works as a clock.

Everything thread related seem to be working too, I can setup Thread as new network and join the Apple one. And all logs look clean. However matter part just doesn't see anything. I tried with Nanoleaf Essential Lightstrip and Essential Bulb, and Wemo Smart Plug. Everything works correctly via Home (Homekit) App.

My path for testing matter:

  1. Create new thread network
  2. Copy key to iPhone
  3. Full reset device and deleted it from HomeKit
  4. Try to add matter device with iPhone home assistant app
  5. Timeout, device not found.

I use Flame app to check mDNS and all devices and home assistant are correctly advertised.

@ovcrash
Copy link

ovcrash commented Feb 12, 2025

i have the same error. I only have one matter device and it worked before the upgrade, now even on the latest version i have the exact same error.

core_matter_server_2025-02-12T22-25-25.266Z.log

check the logs from the 2025-02-12 you see all the network unreachable

@seanob86
Copy link

seanob86 commented Feb 26, 2025 •
edited
Loading

EDIT: Ignore my report below. For me this was an Unraid issue with 7.0.1. Found a missing ipv6 static route between updates. Re-added and everything is ok

Unraid user here with both homeassistant and matter addon, both in docker containers.
Everything was working fine in Unraid 7.0.0, but with today's update to 7.0.0.1 the matter container is full of the same errors.

2025-02-26 18:36:42.785 (MainThread) INFO [matter_server.server.sdk] <Node:22> Attempting to establish CASE session... (attempt 2 of 2)
2025-02-26 18:36:42.987 (Dummy-2) CHIP_ERROR [chip.native.IN] SendMessage() to UDP:[fd76:9661:4901:0:7d24:5210:a2bf:6dcc]:5540 failed: src/inet/UDPEndPointImplSockets.cpp:421: OS Error 0x02000065: Network is unreachable
2025-02-26 18:36:42.987 (Dummy-2) CHIP_ERROR [chip.native.-] src/inet/UDPEndPointImplSockets.cpp:421: OS Error 0x02000065: Network is unreachable at src/app/OperationalSessionSetup.cpp:254
2025-02-26 18:36:42.988 (Dummy-2) CHIP_ERROR [chip.native.IN] SendMessage() to UDP:[fd76:9661:4901:0:7d24:5210:a2bf:6dcc]:5540 failed: src/inet/UDPEndPointImplSockets.cpp:421: OS Error 0x02000065: Network is unreachable
2025-02-26 18:36:42.989 (Dummy-2) CHIP_ERROR [chip.native.-] src/inet/UDPEndPointImplSockets.cpp:421: OS Error 0x02000065: Network is unreachable at src/app/OperationalSessionSetup.cpp:254
2025-02-26 18:36:42.990 (Dummy-2) CHIP_ERROR [chip.native.IN] SendMessage() to UDP:[fd76:9661:4901:0:7d24:5210:a2bf:6dcc]:5540 failed: src/inet/UDPEndPointImplSockets.cpp:421: OS Error 0x02000065: Network is unreachable
2025-02-26 18:36:42.990 (Dummy-2) CHIP_ERROR [chip.native.-] src/inet/UDPEndPointImplSockets.cpp:421: OS Error 0x02000065: Network is unreachable at src/app/OperationalSessionSetup.cpp:254
2025-02-26 18:36:42.992 (Dummy-2) CHIP_ERROR [chip.native.IN] SendMessage() to UDP:[fd76:9661:4901:0:7d24:5210:a2bf:6dcc]:5540 failed: src/inet/UDPEndPointImplSockets.cpp:421: OS Error 0x02000065: Network is unreachable
2025-02-26 18:36:42.992 (Dummy-2) CHIP_ERROR [chip.native.-] src/inet/UDPEndPointImplSockets.cpp:421: OS Error 0x02000065: Network is unreachable at src/app/OperationalSessionSetup.cpp:254
2025-02-26 18:36:42.993 (Dummy-2) CHIP_ERROR [chip.native.IN] SendMessage() to UDP:[fd76:9661:4901:0:7d24:5210:a2bf:6dcc]:5540 failed: src/inet/UDPEndPointImplSockets.cpp:421: OS Error 0x02000065: Network is unreachable
2025-02-26 18:36:42.993 (Dummy-2) CHIP_ERROR [chip.native.-] src/inet/UDPEndPointImplSockets.cpp:421: OS Error 0x02000065: Network is unreachable at src/app/OperationalSessionSetup.cpp:254
2025-02-26 18:36:42.994 (MainThread) WARNING [matter_server.server.device_controller] <Node:22> Setup for node failed: Unable to establish CASE session with Node 22
2025-02-26 18:36:42.994 (MainThread) INFO [matter_server.server.device_controller] <Node:22> Retrying node setup in 60 seconds...

Rolled back to unraid 7.0.0 and everything is ok. Rolled forward again, and errors come back.
Got both AppleTV and homepod that support TBR

@seanob86 seanob86 mentioned this issue Feb 26, 2025
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
add-on: matter_server
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
8 participants
@agners @velocityzen @drbroccoli @Mosher23 @parhedberg @ovcrash @seanob86 @ChristianForstner