Skip to content

[RFC] Restructure/update Release Specs #279

@jia200x

Description

@jia200x

Thanks to the tooling around, it is nowadays way easier to manage a Release than some years ago. Therefore, we should probably get the best out of the tooling available and update the tests a bit.

I would like to propose:

  1. Try to make the tests as generic as possible, i.e no board-specific tests such as Task #04 - ICMPv6 echo between iotlab-m3 and Internet host through Linux with 6LowPAN. We then try to run the tests on as many boards as possible and indicate such boards in the Release notes. We can keep the current bare-minimum (samr21-xpro, iotlab-m3), although IMO there are several boards that are widely used and are not covered by the Release Specs (e.g nrf52840). This would basically obsolete Task #04 - ICMPv6 echo between iotlab-m3 and Internet host through Linux with 6LowPAN, as we would always try to run the tests in as many devices as possible. It would probably reduce the number of specs as well, many of the ping tests are similar and only differ in the board.
  2. In tests such as Task #02 - Subset of tests on iotlab-m3, we should aim to run all tests nowadays, as the compile_and_test_for_board.py scripts takes care of everything.
  3. Extend/update interop tests. For example, we should use other UPLINK settings for the RIOT Border Router (e.g slip, cdc-ecm). On the other side, we should really deprecate the Contiki interop test (or at least update it to Contiki-NG), as this test ends up running in outdated hardware anyway and it's not user friendly.

Metadata

Metadata

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions