Skip to content

Unreliable tests on macOS that sometimes fail unexplicably #122

@philippewarren

Description

@philippewarren

Describe the bug
Some of the tests on macOS are flaky (they sometimes work, and they sometimes fail unexplicably).
Frequently caused by sockets (socket.io) connections.
Also sometimes it is because of broken pipes (SIGPIPE).
Also sometimes, tests just fail.
This does not happen in GitHub's CI macOS runners, only on local machines.
There might be two different problems: websockets (socket.io) and datagrams (low-level libwebrtc).
The socket function fails inside of libwebrtc (here).

To Reproduce
Run tests on macOS multiple times.

Expected behavior
The tests always succeed.

Desktop (please complete the following information):

  • OS: macOS
  • Browser: N.A.
  • Version: N.A.

Additional context
This could be caused by a security feature of macOS 13, maybe. This is worth exploring.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions