Skip to content

Releases: linux-test-project/ltp

LTP 20220121

21 Jan 20:03
Compare
Choose a tag to compare

Since the last release 269 patches by 32 authors were merged.

Patch review is what most of the projects struggle with and LTP is no
different. If you can spare some effort helping with the patch review is more
than welcomed.

NOTABLE CHANGES

  • New tests

    • quotactl{08,09} tests for quota info hidden in filesystem.
    • fanotify22 test for FAN_FS_ERROR events by intentionally corrupting a fs image
    • memcontrol02 test for cgroup memory.current and memory.stat
    • memcontrol01 test for cgroup subtree_control and memory controller
    • write06 test if write() works correctly with O_APPEND fd
    • statx08 statx test for the stx_attributes_mask
    • fanotify{20,21} tests for FAN_REPORT_PIDFD
    • irqbalance01 test that tries to assert that IRQ are spread between CPUs reasonably
    • dup207 tests that file offset is correct for both original and dup()ed fds
    • dup206 tests special case where oldfd == newfd
    • ima_conditionals.sh test uid, gid, fowner, and fgroup options added
      in kernel commit 40224c41661b ("ima: add gid support") from v5.16
  • Increased coverage

    • quotactl* tests added support for quotactl_fd and hidden quota files
    • quotaclt* tests also test with vfsv1 format
    • statx01 added check for stx_mnt_id
    • statx01 added check for nlink
    • stat01 added check for nlink
    • finit_module02 added ETXTBSY check
    • epoll_create added two test variants (libc wrapper and raw syscall)
    • creat09 runs on all filesystems now
    • dup202 added check that file mode is same after it has been changed on dup()ed fd
  • The test library process, that watches over timeouts and carries on with the
    test cleanup, now adjusts it's own OOM score so that it's more likely that it
    outlives the child process that runs the test

  • First half of the ltp-aiodio testcases was rewritten and cleaned up

    • the rewritten tests are free of runtest file hacks that were problematic for years
    • the second half should get fixed during the next development cycle
    • the rewritten tests so far are:
      • dio_truncate
      • dio_read (previously ltp-diorh)
      • dio_append
      • dio_sparse
      • aiodio_append
  • 39 tests were rewritten to the new library

  • 'make check' improvements

    • added check if test.tags is properly NULL terminated
    • added check if test global functions and variables are static
    • fixed not to report tst_ prefixed static inline functions
  • The test library gained support for 'known-fail' tag

    • to mark kernel bugs that are unfixed for a long time
    • this is similar to the existing tags
    • the first use of the interface are ustat() tests that are failing on Btrfs
      ever since the introduction of the filesystem
  • The test library gained support for version check when a tool is required to
    be installed on a system, e.g. .needs_cmds = {"mkfs.ext4 >= 1.43.0", NULL} will
    skip the test unless the mkfs.ext4 is present and the version is at least 1.43.0

  • The test library added .supported_archs field to the test_test structure
    which can be used to limit the test to a subset of CPU architectures

  • The test library added .skip_in_compat flag to skip tests in compat (-m32) mode

  • The shell library gained support boolean expressions on kernel .config
    variables

  • New environment variable KCONFIG_SKIP_CHECK was added that allows users to
    skip kernel config checks

  • New environment variable LTP_SINGLE_FS_TYPE was added that can be
    used to limit tests that run against all filesystem to a single one

  • The new library testcases now print environment variables in help (-h)

  • The test metadata are parsed during the build and installed by default now,
    which is another step towards making the test executor smarter.

  • The usual amount of fixes and cleanups

WHAT IS IN THE QUEUE

In-flight patchse include:

  • KVM test infrastructure that would allow us implement KVM regression tests
  • watchqueue (pipe based kernel notification) testsuite
  • futex_waitv tests
  • CGroup testcases and fixes
  • Test runtime API for the test library that would allow us to controll
    testrun runtime explicitly and fix a few tests that run into timeouts
    on older/slower hardware

Unfortunately the runltp-ng is still not included in LTP, we will try to work
on it during the next development cycle as well, but we can't promise it will
be rock stable to be included in the next release either.

NOTABLE CHANGES IN NETWORK TESTS

brought to you by Petr Vorel

  • NFS tests get support for emulating external server activity
  • fix: run exportfs at "server side" in LTP_NETNS case
  • new test: nfs07.sh - NFS directory listing regression

DOWNLOAD AND LINKS

The latest version of the test-suite contains 3000+ tests for the Linux
and can be downloaded at:

https://github.com/linux-test-project/ltp/releases/tag/20220121

The project pages as well as GIT repository are hosted on GitHub:

https://github.com/linux-test-project/ltp
http://linux-test-project.github.io/

If you ever wondered how to write a LTP testcase, don't miss our developer
documentation at:

https://github.com/linux-test-project/ltp/wiki/Test-Writing-Guidelines

https://github.com/linux-test-project/ltp/wiki/C-Test-API

https://github.com/linux-test-project/ltp/wiki/C-Test-Network-API

https://github.com/linux-test-project/ltp/wiki/Shell-Test-API

https://github.com/linux-test-project/ltp/wiki/C-Test-Case-Tutorial

https://github.com/linux-test-project/ltp/wiki/BuildSystem

Patches, new tests, bugs, comments or questions should go to to our mailing
list at [email protected].

CREDITS

Many thanks to the people contributing to this release:
git shortlog -s -e -n 20210927..

51  Petr Vorel <[email protected]>
47  Yang Xu <[email protected]>
31  Richard Palethorpe <[email protected]>
24  Joerg Vehlow <[email protected]>
17  Cyril Hrubis <[email protected]>
15  Andrea Cervesato <[email protected]>
14  tangmeng <[email protected]>
 9  Gabriel Krisman Bertazi <[email protected]>
 7  zhanglianjie <[email protected]>
 6  Dai Shili <[email protected]>
 6  Li Wang <[email protected]>
 6  Martin Doucha <[email protected]>
 4  Jan Stancek <[email protected]>
 3  Alex Henrie <[email protected]>
 3  Matthew Bobrowski <[email protected]>
 3  Zhao Gongyi <[email protected]>
 3  sujiaxun <[email protected]>
 2  Krzysztof Kozlowski <[email protected]>
 2  QI Fuli <[email protected]>
 2  Ralph Siemsen <[email protected]>
 2  YiLin.Li <[email protected]>
 2  wenyehai <[email protected]>
 1  Bogdan Lezhepekov <[email protected]>
 1  Egor Petrov <[email protected]>
 1  Fabian Vogt <[email protected]>
 1  Fabrice Fontaine <[email protected]>
 1  Masayoshi Mizuma <[email protected]>
 1  Nikita Yushchenko <[email protected]>
 1  Thadeu Lima de Souza Cascardo <[email protected]>
 1  Wang Kunfeng <[email protected]>
 1  chengweibin <[email protected]>
 1  sujiauxn <[email protected]>

And also thanks to patch reviewers:

git log 20210927.. | grep -Ei '(reviewed|acked)-by:' | sed 's/.*by: //' | sort | uniq -c | sort -n -r

154 Cyril Hrubis <[email protected]>
 71 Petr Vorel <[email protected]>
 29 Li Wang <[email protected]>
 24 Richard Palethorpe <[email protected]>
 12 Amir Goldstein <[email protected]>
 11 Yang Xu <[email protected]>
  9 Martin Doucha <[email protected]>
  3 Tim Bird <[email protected]>
  3 Matthew Bobrowski <[email protected]>
  3 Jan Stancek <[email protected]>
  3 Eric Biggers <[email protected]>
  3 Alexey Kodanev <[email protected]>
  2 Liu Xinpeng <[email protected]>
  2 Andrea Cervesato <[email protected]>
  1 Petr Vorel <[email protected]>
  1 Mimi Zohar <[email protected]>

LTP 20210927

27 Sep 14:51
Compare
Choose a tag to compare

Since the last release 483 patches by 40 authors were merged.

This is a record breaking release by the number of patches as well as by the
amount of newly implemented functionality. Many thanks to all contributors!

And even more thanks to the reviewers!

Patch review is what most of the projects struggle with and LTP is no
different. If you can spare some effort helping with the patch review is more
than welcomed.

NOTABLE CHANGES

  • New tests

    • epoll_ctl05 checks for ELOOP error for circular loop of epolls
    • epoll_ctl04 checks for EINVAL when epoll nesting is too deep
    • epoll_ctl02 checks for EPERM when epoll is not supported for fd
    • epoll_create01 checks that epoll create returns a valid fd
    • epoll_create1_02 checks for EINVAL when epoll_create1() is passed invalid flags
    • epoll_pwait02 test if events are reported properly
    • epoll_pwait03 tests if epoll_pwait/epoll_pwait2 timeouts correctly
    • epoll_pwait04 adds tests for zero timeout and invalid timespec values
    • shmget05 test for /proc/sys/kernel/shm_next_id
    • shmget06 test when shm_next_id is already in use
    • io_getevents02 checks for EINVAL errors via libaio
    • io_cancel02 checks for EFAULT errors via libaio
    • io_submit03 checks for invalid input via syscall
    • io_submit02 checks if correct operation via syscall
    • io_setup02 checks for invalid inputs via syscall
    • io_destroy02 checks for invalid inputs via syscall
    • cfs_bandwidth01 a multi-level cgroup cpu controller test
  • New regression tests

    • creat09 privilege escalation using setgid directory aka CVE-2018-13405
    • can_bcm01 race condition vulnerability in CAN BCM aka CVE-2021-3609
    • setsockopt08 out-of-bounds write corrupting aka CVE-2021-22555
    • perf_event_open03 kernel memory leak aka CVE-2020-25704
    • squashfs01 regression test for broken sanity checks
    • set_mempolicy05 information leak aka CVE-2017-7616
    • userns08 broken id mappings in nested namespaces CVE-2018-18955
    • tc01.sh regression test for tc qdisc command
    • fanotify19 added regression test for:
      a8b98c808eab ("fanotify: fix permission model of unprivileged group")
    • kill13 INT_MIN negation reproducer aka CVE-2018-10124
    • wait403 INT_MIN negation reproducer
    • vsock01 race condition reproducer aka CVE-2021-26708
    • icmp_rate_limit01 DNS cache poisoning attack aka CVE-2020-25705
  • Increased coverage

    • epoll_create02 checks for more EINVAL failures
    • epoll_ctl03 checks that the syscall works with all valid flags combinations
    • mbind01 more tests for MPOL_LOCAL
    • epoll_pwait01 adds test variants for epoll_pwait2()
  • 75 tests were rewritten to the new library

  • Removed tests

    • sched/stress as it was unmaintained and unused for years
    • stress_cd and stress_floppy since these scripts were broken and unmaintained for years
    • disktest as it was unmaintained and unused for years
  • The CI was moved from Travis to GitHub actions

  • 'make check' was introduced to the LTP build system

    • which is a tool for developers that runs various sanity checks on the source code
    • this includes:
      • checkpatch.pl, custom set of sparse rules for C
      • checkbashism.pl for shell
    • please make sure you run 'make check' or 'make check-testname' and fix the
      warnings before submitting patches
  • Subset of our library tests i.e. tests for the test library is now executed
    CI in github actions, this is ongoing effort to make sure that the test library
    used by the testcases is working as expected

  • The test library was fixed to print all messages to stderr

  • Testcases were fixed not to expect certain users and groups to be present on the system

    • some tests were expecting bin, daemon and similar groups and users to exist on the system
    • now LTP depends only on user 'nobody' and group 'nogroup'
  • New environment variable LTP_VIRT_OVERRIDE was added

  • Fixed (again) timeouts in shell test library

    • turns out you cannot make timeouts in shell race-free so the timeout logic
      is now implemented in a small C helper binary
  • Finally after the years we are slowly making tests limits-aware

    • cgropup tests and a few others are now aware of pid limits imposed by the system
    • next step would be doing rough estimates on the number of processes we can run
      based on the free system memory
  • There is ongoing effort to fix LTP cgroup tests, this release includes many
    small fixes and improvements in the cgroup tests

  • The aarch64 system call table was fixed not to include 32bit only syscall numbers

  • The TST_EXP_*() macros were improved and a few bugs were fixed

  • The test library developer documentation and tutorials were reorganized and improved

  • The more that the usual amount of fixes and cleanups

WHAT IS IN THE QUEUE

Next release will hopefully include runltp-ng which is new and improved LTP
testrunner. The current runltp script will be maintained alongside with the
new solution for some time but removed after a few releases.

You are more than welcome to try it and make sure that it works for you before
it becomes the official LTP testrunner.

See: https://github.com/metan-ucw/runltp-ng

NOTABLE CHANGES IN NETWORK TESTS

brought to you by Petr Vorel

  • C network library

  • Shell network library

    • Allow to skip initialization with TST_NET_SKIP_VARIABLE_INIT=1
    • Disable IPv6 Duplicate Address Detection on link-local addresses
  • Tests rewritten to the new library

    • getaddrinfo01
    • ssh-stress
  • Removed tests

    • broken_ip-totlen
  • More busybox and general fixes

DOWNLOAD AND LINKS

The latest version of the test-suite contains 3000+ tests for the Linux
and can be downloaded at:

https://github.com/linux-test-project/ltp/releases/tag/20210927

The project pages as well as GIT repository are hosted on GitHub:

https://github.com/linux-test-project/ltp
http://linux-test-project.github.io/

If you ever wondered how to write a LTP testcase, don't miss our developer
documentation at:

https://github.com/linux-test-project/ltp/wiki/Test-Writing-Guidelines

https://github.com/linux-test-project/ltp/wiki/C-Test-API

https://github.com/linux-test-project/ltp/wiki/C-Test-Network-API

https://github.com/linux-test-project/ltp/wiki/Shell-Test-API

https://github.com/linux-test-project/ltp/wiki/C-Test-Case-Tutorial

https://github.com/linux-test-project/ltp/wiki/BuildSystem

Patches, new tests, bugs, comments or questions should go to to our mailing
list at [email protected].

CREDITS

Many thanks to the people contributing to this release:

git shortlog -s -e -n 20210927..

87  Petr Vorel <[email protected]>
51  Xie Ziyao <[email protected]>
51  Richard Palethorpe <[email protected]>
50  Martin Doucha <[email protected]>
30  Krzysztof Kozlowski <[email protected]>
29  Cyril Hrubis <[email protected]>
28  Alexey Kodanev <[email protected]>
27  Yang Xu <[email protected]>
20  Li Wang <[email protected]>
18  zhanglianjie <[email protected]>
17  Joerg Vehlow <[email protected]>
12  Vinay Kumar <[email protected]>
 8  Xie Ziyao <[email protected]>
 7  sujiaxun <[email protected]>
 5  Bogdan Lezhepekov <[email protected]>
 5  Dai Shili <[email protected]>
 5  Jan Stancek <[email protected]>
 5  QI Fuli <[email protected]>
 4  Leo Liang <[email protected]>
 2  Alexander Egorenkov <[email protected]>
 2  Amir Goldstein <[email protected]>
 2  Shiyang Ruan <[email protected]>
 2  Thadeu Lima de Souza Cascardo <[email protected]>
 2  Zhao Gongyi <[email protected]>
 1  Alessio Balsini <[email protected]>
 1  Bogdan Lezhepekov via ltp <[email protected]>
 1  Cao jin <[email protected]>
 1  Egor Petrov <[email protected]>
 1  Ian May <[email protected]>
 1  John Stultz <[email protected]>
 1  Leo Yu-Chi Liang <[email protected]>
 1  Marius Hillenbrand <[email protected]>
 1  Naresh Kamboju <[email protected]>
 1  Radoslav Kolev <[email protected]>
 1  Wang Xin <[email protected]>
 1  Xiao Yang <[email protected]>
 1  Zou Wei <[email protected]>
 1  dongshijiang <[email protected]>

And also thanks to patch reviewers:

git log 20210927.. | grep -Ei '(reviewed|acked)-by:' | sed 's/.*by: //' | sort | uniq -c | sort -n -r

289 Cyril Hrubis <[email protected]>
113 Petr Vorel <[email protected]>
 75 Li Wang <[email protected]>
 25 Richard Palethorpe <[email protected]>
 16 Yang Xu <[email protected]>
 12 Alexey Kodanev <[email protected]>
  7 Jan Stancek <[email protected]>
  6 Richard Palethorpe <[email protected]>
  5 Xiao Yang <[email protected]>
  5 Martin Doucha <[email protected]>
  3 Joerg Vehlow <[email protected]>
  3 Enji Cooper <[email protected]>
  2 Krzysztof Kozlowski <[email protected]>
  1 Yang Xu <[email protected]
  1 Xie Ziyao <[email protected]>
  1 Stephen Kitt <[email protected]>
  1...
Read more

LTP 20210524

24 May 11:48
Compare
Choose a tag to compare

Since the last release 364 patches by 50 authors were merged.

NOTABLE CHANGES

  • New tests

    • fanotify17 - tests for fanotify() user limits
    • fanotify18 - tests for validating user permissions
    • fanotify19 - tests for unpriviledged events
    • brk02 - test that removes two VMAs on shrink
    • close_range{01,02} - basic close_range() tests
    • rtc02 - /dev/rtc timer tests
  • New regression tests

    • bpf_prog05 truncation on 32bit div/mod by zero aka CVE-2021-3444
    • writev03 regression test for d4690f1e1cda 'fix iov_iter_fault_in_readable()'
    • io_uring02 regression test for unsafe handling of the root directory aka CVE-2020-29373
  • Increased coverage

    • tmpfs was added for tests that loop over filesystems supported by the SUT
    • fanotify05 added more queue overflow tests and test for unlimited queue
  • 52 tests were rewritten to the new library

    • with that we reached important milestone where new library testcases
      outnumber the old library tests for the first time ever

    • Converted tests:

      • chdir01
      • chmod05
      • chown01, chown02, chown03
      • close01, close02
      • get_mempolicy01
      • getgid01, getgid03
      • getpid01, getpid02
      • getppid01, getppid02
      • io_cancel01, io_getevents01
      • mallopt01
      • mmap19
      • netns_netlink
      • pec
      • pidns13
      • reboot01, reboot02
      • sched_getparam01, sched_getparam02, sched_getparam03
      • semctl01, semctl02, semctl03, semctl04, semctl05, semctl07
      • sendfile03, sendfile04, sendfile05, sendfile07
      • setgid01, setgid02, setgid03
      • swapoff01, swapoff02, swapoff03
      • swapon01, swapon02, swapon03
      • swapoff01, swapoff02, swapoff03
      • swapon01, swapon02, swapon03
      • time01
      • times01
      • tkill01, tkill02
      • unlinkat01
      • unshare01, unshare02
      • wait01, wait02
      • CAN tests were cleaned up and converted to the new library
  • Integrity Measurement Architecture (IMA)

    • new SELinux measurement tests
    • fixes
  • Added new library for managing network interfaces over netlink

  • Added new library for cgroup discovery and management

    • this is a big leap forward for cgroup testing
    • greatly simplifies testscases as the library gracefully handles v1/v2
      split configurations that are unfortunatelly still common on recent systems
    • first few tests were converted to use the library
    • more tests are in the queue
  • Fixed timeouts in shell test library

    • ensure that all child processes are killed on timeout as well
    • runs a cleanup after timeout
  • The fuzzy sync library was fixed to yield() on single CPU systems

    • which fixed test timeouts on single CPU systems
    • self tests for the library where implemented where we check that races we
      crafted into the code are triggered correctly by the library even on single
      CPU systems
  • Fixed kernel module detection on BusyBox

  • Open Posix Testsuite now use $TMPDIR instead of previously hardcoded /tmp

  • LTP should now produce reproducible build after a few fixes to the buildsystem and libs

  • The documentation generated from the test sources was improved, you can check
    out the generated documentation pages for this release at:

    http://linux-test-project.github.io/metadata/metadata.asciidoctor.html

    Also have a look at a few nice test documentation examples:

    http://linux-test-project.github.io/metadata/metadata.asciidoctor.html#acct02
    http://linux-test-project.github.io/metadata/metadata.asciidoctor.html#bpf_prog05
    http://linux-test-project.github.io/metadata/metadata.asciidoctor.html#semctl09

  • We also wrote down a document about the oldest supported kernel and libc, see:
    https://github.com/linux-test-project/ltp/wiki/Supported-kernel,-libc,-toolchain-versions

  • The usual amount of fixes and cleanups

NOTABLE CHANGES IN NETWORK TESTS

brought to you by Petr Vorel

  • New tests: UDP encapsulation tests (FOU and GUE)

  • Tests converted to new API: CAN tests, multicast stress tests, route-change

  • Reduce false positive on tests using tst_netload

  • Other fixes

CREDITS

Many thanks to the people contributing to this release:

git shortlog -s -e -n 20210121..

84  Petr Vorel <[email protected]>
35  Zhao Gongyi <[email protected]>
35  Richard Palethorpe <[email protected]>
26  Xie Ziyao <[email protected]>
22  Martin Doucha <[email protected]>
20  Cyril Hrubis <[email protected]>
15  Joerg Vehlow <[email protected]>
13  Li Wang <[email protected]>
10  Xiao Yang <[email protected]>
 8  Amir Goldstein <[email protected]>
 7  QI Fuli <[email protected]>
 7  Yang Xu <[email protected]>
 6  Feiyu Zhu <[email protected]>
 5  Alexey Kodanev <[email protected]>
 5  Richard Purdie <[email protected]>
 5  Yang Xu <[email protected]>
 4  Jan Stancek <[email protected]>
 4  Shiyang Ruan <[email protected]>
 4  zhanglianjie <[email protected]>
 4  zhao gongyi <[email protected]>
 3  Cixi Geng <[email protected]>
 3  Kory Maincent <[email protected]>
 3  Lakshmi Ramasubramanian <[email protected]>
 3  Shiyang Ruan <[email protected]>
 3  Wang Xin <[email protected]>
 2  Palmer Dabbelt via ltp <[email protected]>
 2  Petr Vorel <[email protected]>
 2  Thadeu Lima de Souza Cascardo <[email protected]>
 2  Xiao Yang <[email protected]>
 2  Zenghui Gao <[email protected]>
 1  Alexander Egorenkov <[email protected]>
 1  Ankit Jain <[email protected]>
 1  Bogdan Lezhepekov <[email protected]>
 1  Colin Ian King <[email protected]>
 1  Cristian Marussi <[email protected]>
 1  He Zhe <[email protected]>
 1  Jinghui Huang <[email protected]>
 1  Jinhui Huang <[email protected]>
 1  Konstantin Aladyshev <[email protected]>
 1  Leo Yu-Chi Liang <[email protected]>
 1  Liam Howlett <[email protected]>
 1  QI Fuli <[email protected]>
 1  Sharan Turlapati <[email protected]>
 1  Tim Gates <[email protected]>
 1  Yann Sionneau via ltp <[email protected]>
 1  dongshijiang <[email protected]>
 1  ouyangciyan <[email protected]>
 1  sujiaxun <[email protected]>
 1  tianyu <[email protected]>
 1  Tree Davies <[email protected]>

And also thanks to patch reviewers:

git log 20210121.. | grep -Ei '(reviewed|acked)-by:' | sed 's/.*by: //' | sort | uniq -c | sort -n -r

151 Cyril Hrubis <[email protected]>
130 Petr Vorel <[email protected]>
 70 Li Wang <[email protected]>
  7 Yang Xu <[email protected]>
  7 Xiao Yang <[email protected]>
  6 Oliver Hartkopp <[email protected]>
  5 Alexey Kodanev <[email protected]>
  4 Yang Xu <[email protected]>
  4 Martin Doucha <[email protected]>
  4 Lakshmi Ramasubramanian <[email protected]>
  4 Jan Stancek <[email protected]>
  3 Xiao Yang <[email protected]>
  2 Viresh Kumar <[email protected]>
  2 Richard Palethorpe <[email protected]>
  2 Leo Yu-Chi Liang <[email protected]>
  2 Jan Kara <[email protected]>
  1 Liam R. Howlett <[email protected]>
  1 Jiri Slaby <[email protected]>
  1 Eric Biggers <[email protected]>

LTP 20210121

21 Jan 12:18
Compare
Choose a tag to compare

Since the last release 303 patches by 35 authors were merged.

NOTABLE CHANGES

  • New tests

    • finit_module()
    • init_module()
    • delete_module()
    • semctl09 for SEM_STAT_ANY flag
    • msgctl06 for MSG_STAT_ANY flag
    • shmctl04 for SHM_STAT_ANY flag
    • sendmmsg() failure tests
    • recvmmsg() failure tests
    • open_by_handle_at()
    • name_to_handle_at()
    • ptrace11 to check if we can trace PID 1
    • select04 failure tests
    • select04 to check if rfds/wfds flags are clered on empty/full fd
  • New regression tests

    • inotify10 added test for fecc4559780d (fsnotify: fix events reported to watching parent and child)
    • fanotify09 for 7372e79c9eb9 (fanotify: fix logic of reporting name info with watched parent)
    • ptrace10 bd14406b78e6 (perf/hw_breakpoint: Modify breakpoint even if the new attr has disabled set)
  • Increased coverage

    • fanotify09 added case with FAN_CLOSE_NOWRITE on a sibling non-dir child
  • Removed tests

    • sync01, sync02 these tests were useless so there was no point in keeping them
  • The metadata extraction patchset was merged. LTP now produces metadata.json
    with a metadata for new library testcases and also html test catalogue build
    from the extracted metadata.

    https://github.com/linux-test-project/ltp/blob/master/docparse/README.md

  • Kernel .config parser was rewritten to support proper boolean expressions

  • LTP now requires pkg-config > 0.23 (working version 0.24 was released in 2010)

  • Error handling in test library (mostly SAFE_MACROS()) was unified

  • High level test library overview was written:
    https://github.com/linux-test-project/ltp/blob/master/lib/README.md

  • IMA/EVM

    • fixed ima_tpm.sh for TPM 2.0 and for TPM 1.2 on kernel >= v5.8 (commit 6f1a1d103b48)
    • rewrote ima_boot_aggregate.c to new API
  • 16 testcases were converted to the new test library

  • The usual amount of fixes and cleanups.

NOTABLE CHANGES IN NETWORK TESTS

brought to you by Petr Vorel

  • New tests

    • wireguard tests
  • Fixes

    • fix various false-positive failures in tests using tst_netload
      (tests in net.features and net_stress.ipsec_* runtest files)
    • if-mtu-change.sh on s390x: fix max packet size for IPv4
  • Compatibility fixes:

    • ping and traceroute from BusyBox
    • MUSL (netstress)
    • traceroute6 from iputils
    • various other fixes and cleanup
  • Rewrite into new API

    • host01
    • netstat01.sh

CREDITS

Many thanks to the people contributing to this release:

git shortlog -s -e -n 20200930..

88  Petr Vorel <[email protected]>
52  Cyril Hrubis <[email protected]>
25  Martin Doucha <[email protected]>
19  Yang Xu <[email protected]>
18  Viresh Kumar <[email protected]>
10  Xiao Yang <[email protected]>
 8  Alexey Kodanev <[email protected]>
 8  Amir Goldstein <[email protected]>
 8  Feiyu Zhu <[email protected]>
 8  Kory Maincent <[email protected]>
 7  Radoslav Kolev <[email protected]>
 5  Richard Palethorpe <[email protected]>
 4  Cixi Geng <[email protected]>
 4  Krzysztof Dynowski <[email protected]>
 4  Li Wang <[email protected]>
 4  Po-Hsu Lin <[email protected]>
 4  Joerg Vehlow <[email protected]>
 3  Alexander Egorenkov <[email protected]>
 2  Khem Raj <[email protected]>
 2  Li Zhijian <[email protected]>
 2  Pengfei Xu <[email protected]>
 2  Tree Davies <[email protected]>
 2  Yang Xu <[email protected]>
 2  Bogdan Lezhepekov <[email protected]>
 2  Johannes Nixdorf <[email protected]>
 1  Alexander Egorenkov <[email protected]>
 1  Deepak Rawat <[email protected]>
 1  Filip Bozuta <[email protected]>
 1  Jan Stancek <[email protected]>
 1  Peter Bee <[email protected]>
 1  Petr Cervinka via ltp <[email protected]>
 1  Punit Agrawal <[email protected]>
 1  Radoslav Kolev via ltp <[email protected]>
 1  Xinpeng Liu <[email protected]>
 1  bhargavdas <[email protected]>

And also thanks to patch reviewers:

git log 20200930.. | grep -Ei '(reviewed|acked)-by:' | sed 's/.*by: //' | sort | uniq -c | sort -n -r

114 Cyril Hrubis <[email protected]>
 58 Petr Vorel <[email protected]>
 51 Li Wang <[email protected]>
 13 Yang Xu <[email protected]>
 11 Amir Goldstein <[email protected]>
 10 Alexey Kodanev <[email protected]>
  9 Jan Stancek <[email protected]>
  5 Xiao Yang <[email protected]>
  5 Jan Kara <[email protected]>
  3 Xiao Yang <[email protected]>
  5 Richard Palethorpe <[email protected]>
  3 Martin Doucha <[email protected]>
  2 Mimi Zohar <[email protected]>
  1 Kory Maincent <[email protected]>
  1 Joerg Vehlow <[email protected]>

LTP 20200930

30 Sep 15:53
Compare
Choose a tag to compare

Since the last release 357 patches by 38 authors were merged.

NOTABLE CHANGES

  • New tests

    • mmap17 for MAP_FIXED_NOREPLACE
    • semctl08 to verify the _time_high fields
    • shmctl06 to verify the _time_high fields
    • msgctl05 to verify the _time_high fields
    • clock_gettime04 to check consistency during successive timer readings
    • mincore03 test for anonymous mappings
    • io_uring01 basic test for asynchronous read()
    • ioctl09 test for BLKRRPART
    • mincore04 test for pages faulted in child
    • clock_settime03 test if timers works fine when clocks overflows 32bit timestamp
    • msgget04 for /proc/sys/kernel/msg_next_id
    • msgget05 for /proc/sys/kernel/msg_next_id
    • send02 for send() with MSG_MORE flag
    • msgrcv03 for MSG_COPY flag
    • msgrcv07 for MSG_COPY flag
    • fcntl38 for F_SETSIG and F_NOTIFY
    • shmctl03 for IPC_INFO flag
    • shmctl07 for SHM_LOCK and SHM_UNLOCK flags
    • shmctl08 for IPC_SET flag
    • mmap18 for MAP_GROWSDOWN flag
    • ima_keys.sh, ima_kexec.sh new IMA tests + examples of required policies
  • New regression tests

    • setsockopt07 race condition between packet_set_ring() and tp_reserve() aka CVE-2017-1000111
    • fanotify10 for 2f02fd3fa13e (fanotify: fix ignore mask logic for events on child and on dir)
    • thp04 Huge Dirty Cow aka CVE-2017-1000405
    • pty05 race between flush_tx_queue() and n_hdlc_send_frames() aka CVE-2017-2636
    • adjtimex03 4-byte kernel data leak via adjtimex CVE-2018-11508
    • af_alg07 use-after-free in sockfs_setattr() aka CVE-2019-8912
    • bpf_prog04 bug in 32bit eBFP verifier aka CVE-2018-18445
    • timer_settime03 overflow of posix timer overrun counter aka CVE-2018-12896
  • Increased coverage

    • ioctl_loop01 added LO_FLAGS_AUTOCLEAR flag coverage
    • timer_gettime01 added timer_gettime64() coverage
    • timer_settime{01,02} added timer_settime64() coverage
    • timerfd{01,04} added timerfd_gettime64() coverage
    • timerfd_gettime01 added timerfd_gettime64() coverage
    • timerfd_settime{01,02} added timerfd_gettime64() coverage
    • sched_rr_get_interval{01,02,03} added sched_rr_get_interval_time64() coverage
    • sched_rr_get_interval01 checks the return value against /proc/sys/kernel/sched_rr_timeslice_ms
    • io_pgetevents{01,02} added io_pgetevents_time64() coverage
    • ioctl_loop02 added LOOP_CONFIGURE test for LO_FLAGS_READ_ONLY
    • pidfd_open01 added check for CLOEXEC handling
    • rt_sigtimedwait01 added rt_sigtimedwait_time64() coverage
    • futex_cmp_requeue{01,02} added futex_time64() coverage
    • futex_wait{01,02,03,04} added futex_time64() coverage
    • futex_wait_bitset01 added futex_time64() coverage
    • mq_timedreceive01 added mq_timedreceive64() coverage
    • mq_timedsend01 added mq_timedsend64() coverage
    • sendmmsg01 added sys_recvmmsg64() coverage
    • ppoll01 added ppoll_time64 coverage
    • ioctl_loop06 added LOOP_CONFIGURE test for block_size
    • select04 added pselect6_time64() coverage
    • utimensat01 added utimensat_time64() coverage
    • msgsnd01 added check for msg_lspid and msg_stime
    • msgrcv01 added check for msg_lrpid and msg_rtime
    • msgrcv07 added more msgtyp tests
    • semop{01,02,03} added semtimedop() and semtimedop_time64() coverage
    • fanotify{14,16} added FAN_REPORT_DFID_NAME and FAN_REPORT_* coverage
    • fanotify09 added cases with subdirectory marks
    • fanotify10 added cets for FAN_REPORT_NAME and ignore mask
    • ioctl_loop07 added LOOP_CONFIGURE test for lo_sizelimit
  • As you can see this release got the rest of the the 64bit timestamp
    testcases, 64bit timestamp syscalls should be reasonably covered now

  • The quickhit runtest file was removed and replaced for quick integration
    tests with smoketest runtest file

  • Additional 26 tests were converted to the new test library, significant part
    of these were cleaned up and rewritten SystemV IPC testcases

  • LTP now includes VDSO parser and explicitly tests timer VDSO functions

  • The backing files for a loop devices are now created by fallocate() if
    possible, which speeds up loop device based tests quite a bit

  • The build system was tweaked to produce much cleaner output
    the verbose output could be enabled by setting an environment variable V=1

  • The usual amount of fixes and cleanups.

NOTABLE CHANGES IN NETWORK TESTS

brought to you by Petr Vorel

  • remove RSH support (for legacy tests use SSH by default in $LTP_RSH)

  • removed rsh, rcp, rlogin tests

  • NFS: detect disabled UDP, expect it being disabled on v5.6+
    (NFS_DISABLE_UDP_SUPPORT is default y)

  • TST_NET_RHOST_RUN_DEBUG=1 enables debugging

  • various fixes and updated docs

CREDITS

Many thanks to the people contributing to this release:

git shortlog -s -e -n 20200515..

70  Petr Vorel <[email protected]>
66  Viresh Kumar <[email protected]>
37  Cyril Hrubis <[email protected]>
35  Yang Xu <[email protected]>
33  Martin Doucha <[email protected]>
19  Li Wang <[email protected]>
13  Jan Stancek <[email protected]>
11  Amir Goldstein <[email protected]>
10  Xiao Yang <[email protected]>
 6  Richard Palethorpe <[email protected]>
 5  Alexey Kodanev <[email protected]>
 5  Feiyu Zhu <[email protected]>
 4  Filip Bozuta <[email protected]>
 4  Lachlan Sneff <[email protected]>
 4  Po-Hsu Lin <[email protected]>
 3  Erico Nunes <[email protected]>
 3  Petr Vorel <[email protected]>
 3  Yixin Zhang <[email protected]>
 2  Eric Biggers <[email protected]>
 2  Khem Raj <[email protected]>
 2  Michal Kowalczyk <[email protected]>
 2  Shwetha Subramanian <[email protected]>
 2  Vikas Kumar <[email protected]>
 2  Yuan Gao <[email protected]>
 1  Bird, Tim <[email protected]>
 1  Fabrice Fontaine <[email protected]>
 1  Harish <[email protected]>
 1  He Zhe <[email protected]>
 1  Kushal Chand <[email protected]>
 1  Nirav Parmar <[email protected]>
 1  Qais Yousef <[email protected]>
 1  Qian Cai <[email protected]>
 1  Stanislav Kholmanskikh <[email protected]>
 1  Tree Davies <[email protected]>
 1  Vishwajith-K <[email protected]>
 1  Vitaly Chikunov <[email protected]>
 1  aidengao <[email protected]>
 1  pravin <[email protected]>

And also thanks to patch reviewers:

git log 20200515.. | grep -Ei '(reviewed|acked)-by:' | sed 's/.*by: //' | sort | uniq -c | sort -n -r

136 Cyril Hrubis <[email protected]>
 72 Petr Vorel <[email protected]>
 48 Li Wang <[email protected]>
 22 Jan Stancek <[email protected]>
 11 Xiao Yang <[email protected]>
  9 Yang Xu <[email protected]>
  9 Alexey Kodanev <[email protected]>
  8 Martin Doucha <[email protected]>
  7 Mimi Zohar <[email protected]>
  5 Vijay Kumar B. <[email protected]>
  4 Viresh Kumar <[email protected]>
  4 Lakshmi Ramasubramanian <[email protected]>
  2 Tim Bird <[email protected]>
  2 Petr Vorel <[email protected]>
  2 Arnd Bergmann <[email protected]>
  2 Amir Goldstein <[email protected]>
  1 Richard Palethorpe <[email protected]>
  1 Jan Kara <[email protected]>
  1 Christian Brauner <[email protected]>

LTP 20200515

15 May 14:42
Compare
Choose a tag to compare

Since the last release 327 patches by 26 authors were merged.

NOTABLE CHANGES

  • New tests

    • fanotify16: FAN_MODIFY_DIR test
    • ioctl_loop01: LO_FLAGS_AUTOCLEAR and LO_FLAGS_PARTSCAN test
    • ioctl_loop02: LO_FLAGS_READ_ONLY and LOOP_CHANGE_FD test
    • ioctl_loop03: LOOP_CHANGE_FD test with WR mode
    • ioctl_loop04: LOOP_SET_CAPACITY ioctl test
    • ioctl_loop05: LOOP_SET_DIRECT_IO ioctl test
    • ioctl_loop06: LOOP_SET_BLOCK_SIZE error test
    • ioctl_loop07: LOOP_SET/GET_STATUS64 sizelimit field test
    • pipe2_02: test for pipe2 O_CLOEXEC flag
    • pipe2_04: test for pipe2 with/without O_NONBLOCK mode
    • timerfd04: time namespace test
    • timens01: time namespace test
    • clock_gettime03: time namespace test
    • clock_nanosleep03: time namespace test
    • sysinfo03: time namespace test
    • clone301, clone301: clone3() syscall tests
    • bind04: Connection tests for stream-oriented sockets (SOCK_STREAM and SOCK_SEQPACKET)
    • bind05: Connection tests for datagram-oriented sockets (SOCK_DGRAM)
    • fcntl37: add error test for fcntl with F_SETPIPE_SZ
    • openat201, openat202, openat203: openat2() syscall tests
    • open_tree01, open_tree02: open_tree() syscall tests
    • fspick01, fspick02: fspick() syscall tests
    • move_mount01, move_mount02: move_mount() syscall tests
    • fsmount01, fsmount02: fsmount() syscall tests
    • fsconfig01, fsconfig02: fsconfig() syscall tests
    • fsopen01, fsopen02: fsopen() syscall tests
    • pty04: Test data transmission with SLIP line discipline
    • fallocate06: test for misaligned fallocate()
    • io_pgetevents01, io_pgetevents02: io_pgetevents() syscall tests
    • pidfd_open01, pidfd_open02, pidfd_open03: pidfd_open() syscall tests
    • vmsplice04: vmsplice() test with SPLICE_F_NONBLOCK
    • pipe12: add new test for pipe when write bytes > pipe size
  • New regression tests

    • pty04: Added SLCAN ldisc and check for CVE-2020-11494
    • setsockopt05: Test for CVE-2017-1000112
    • ptrace09: Test for CVE-2018-8897
    • snd_seq01: Test for CVE-2018-7566
    • bind06: Test for CVE-2018-18559
    • ptrace08: Test for CVE-2018-1000199
    • ioctl_sg01: Test for CVE-2018-1000204
    • sendmsg03: Test for CVE-2017-17712
    • timerfd_settime02: Test for CVE-2017-10661
    • connect02: Test for CVE 2018-9568
      and also for setsockopt(IP_ADDRFORM) kernel bug
      (82c9ae440857 ipv6: fix restrict IPV6_ADDRFORM operation)
    • fanotify15: Add a test case for inode marks
      (f367a62a7cad fanotify: merge duplicate events on parent and child)
    • fanotify09: Check merging of events on directories
      (55bf882c7f13 fanotify: fix merging marks masks with FAN_ONDIR)
    • add_key05: add maxbytes/maxkeys test under unprivileged user
      (a08bf91ce28e "KEYS: allow reaching the keys quotas exactly")
    • pipe13: test for pipe to wake up all readers
      (6551d5c56eb0 "pipe: make sure to wake up everybody when the last reader/writer closes")
    • quotactl07: test for Q_XQTUOTARM
      (3dd4d40b4208 "xfs: Sanity check flags of Q_XQUOTARM call")
    • pty03: test for slip/slcan data race
      (0ace17d568241 "can, slip: Protect tty->disc_data in write_wakeup and close with RCU")
  • Increased coverage

    • readv01: new test cases added to the test
    • add_key02: add the "big_key" key type
  • First half of time64 tests for 64bit timer syscalls has landed in this
    relese, second half is going to be part of the next one

  • Additional 12 tests were converted to the new test library

  • Removed tests

    • epoll2: these depended on Portable Coroutine Library and were not even
      compiled by default for a long time
  • Fixes for gcc-10 that enables -fno-common by default

  • LTP now supports ARC CPUs

  • Skip oversleep checks in timer tests under VM

  • The usual amount of fixes and cleanups.

NOTABLE CHANGES IN NETWORK TESTS

brought to you by Petr Vorel

  • New netlink based route change tests

  • Fixes

    • nfs: detect disabled UDP
    • rpc: cleanup unused tests
    • detect libtirpc with pkg-config
  • Rewrite to new API

    • bind02, socketcall0[2-4], test_1_to_1_initmsg_connect (SCTP)
    • rpcinfo01.sh, rpc01.sh, sendfile01.sh, xinetd_tests.sh

CREDITS

Many thanks to the people contributing to this release:

git shortlog -s -e -n 20200120..
105 Petr Vorel [email protected]
49 Yang Xu [email protected]
38 Viresh Kumar [email protected]
35 Martin Doucha [email protected]
33 Cyril Hrubis [email protected]
11 Richard Palethorpe [email protected]
10 Jan Stancek [email protected]
6 Li Wang [email protected]
6 Petr Vorel [email protected]
5 Amir Goldstein [email protected]
4 Jorik Cronenberg [email protected]
4 Zou Wei [email protected]
3 Joerg Vehlow [email protected]
3 Po-Hsu Lin [email protected]
2 Alexey Kodanev [email protected]
2 Jozef Pupava [email protected]
2 Xiao Yang [email protected]
1 Anibal Limon [email protected]
1 Chen Li [email protected]
1 Jozef Pupava [email protected]
1 Khem Raj [email protected]
1 Ronald Monthero [email protected]
1 Sean T Allen [email protected]
1 Vikas Kumar [email protected]
1 Vineet Gupta [email protected]
1 Zorro Lang [email protected]

And also thanks to patch reviewers:

git log 20200120.. | grep -Ei '(reviewed|acked)-by:' | sed 's/.*by: //' | sort | uniq -c | sort -n -r
137 Cyril Hrubis [email protected]
62 Petr Vorel [email protected]
56 Li Wang [email protected]
26 Jan Stancek [email protected]
17 Yang Xu [email protected]
12 Alexey Kodanev [email protected]
8 Xiao Yang [email protected]
4 Martin Doucha [email protected]
4 Jan Kara [email protected]
3 Richard Palethorpe [email protected]
3 Matthew Bobrowski [email protected]
2 Xiao Yang [email protected]
2 Viresh Kumar [email protected]
1 Yang Xu [email protected]
1 Desnes A. Nunes do Rosario [email protected]

LTP 20200120

20 Jan 16:36
Compare
Choose a tag to compare

Since the last release 195 patches by 31 authors were merged.

NOTABLE CHANGES

  • New tests

    • vmsplice03 (splicing pipe to user memory)
    • prctl08, prctl09 (PR_{SET,GET}_TIMERSLACK)
  • New regression tests

    • bpf_prog03
  • Increased coverage

    • quotactl tests were rewritten and coverage was increased
  • Additional 19 tests were converted to the new test library

  • Removed tests

  • Our Travis now includes native ppc64le and s390x builds

  • Improved musl support, build with musl in Travis CI using Alpine Linux
    (broken tests are documented in Travis build script travis/alpine.sh)

  • Regression tests now print possibly missing kernel commits:

    --------------------------------------------------------------------------
    snd_timer01.c:134: FAIL: kernel seems vulnerable

    HINT: You _MAY_ be missing kernel fixes, see:

    https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/commit/?id=d11662f4f798
    https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/commit/?id=ba3021b2c79b

    HINT: You _MAY_ be vulnerable to CVE(s), see:

    https://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2017-1000380

    Summary:
    passed   0
    failed   1
    skipped  0
    warnings 0
    --------------------------------------------------------------------------
  • The usual amount of fixes and cleanups.

METADATA EXTRACTION & TEST CATALOGUE

There is an ongoing experiment that attempts to extract metadata from the
testcases, we also have a proof of concept web page that renders the json
metadata into a browseable test documentation. There is not much there yet,
but we are hoping, among other things, to build a nice, searchable and
browseable test catalogue based on these efforts.

https://github.com/metan-ucw/ltp/tree/master/docparse
http://metan.ucw.cz/outgoing/metadata.html
http://metan.ucw.cz/outgoing/metadata.html?test=abort01
http://metan.ucw.cz/outgoing/metadata.html?test=pcrypt_aead01

NOTABLE CHANGES IN NETWORK TESTS

brought to you by Petr Vorel

  • iptables: add new test for iptables-translate and nft, add IPv6 support
  • route: rewrite route change destination, gateway and interface tests into new API

CREDITS

Many thanks to the people contributing to this release:

git shortlog -s -e -n 20190930..
45 Petr Vorel [email protected]
22 Jan Stancek [email protected]
22 Yang Xu [email protected]
13 Cyril Hrubis [email protected]
13 Petr Vorel [email protected]
11 Li Wang [email protected]
10 Joerg Vehlow [email protected]
10 Martin Doucha [email protected]
7 Alexey Kodanev [email protected]
6 Clemens Famulla-Conrad [email protected]
5 Xiao Yang [email protected]
3 Feiyu Zhu [email protected]
2 Jorik Cronenberg [email protected]
2 Pengfei Xu [email protected]
2 Ping Fang [email protected]
2 Richard Palethorpe [email protected]
1 Cai Zhenglong [email protected]
1 Dylan Chung [email protected]
1 Eric Lin [email protected]
1 Fabrice Fontaine [email protected]
1 He Zhe [email protected]
1 Ivan Hu [email protected]
1 Ma Feng [email protected]
1 Mathias Fiedler [email protected]
1 Rachel Sibley [email protected]
1 Song Jian [email protected]
1 Sultan Alsawaf [email protected]
1 Xiang Li [email protected]
1 Yi Zhao [email protected]
1 Yongxin Liu [email protected]
1 Zou Wei [email protected]

git log 20190930.. | grep -Ei '(reviewed|acked)-by:' | sed 's/.*by: //' | sort | uniq -c | sort -n -r
76 Cyril Hrubis [email protected]
46 Petr Vorel [email protected]
28 Li Wang [email protected]
19 Jan Stancek [email protected]
9 Alexey Kodanev [email protected]
5 Clemens Famulla-Conrad [email protected]
4 Richard Palethorpe [email protected]
3 Yang Xu [email protected]
1 Thadeu Lima de Souza Cascardo [email protected]
1 Sumit Garg [email protected]
1 Steve Dickson [email protected]
1 Petr Vorel [email protected]
1 Joerg Vehlow [email protected]
1 Amir Goldstein [email protected]

LTP 20190930

30 Sep 12:27
Compare
Choose a tag to compare

Since the last release 267 patches by 41 authors were merged.

NOTABLE CHANGES

  • New tests

    • Basic eBPF map and program load tests
    • Netlink uevent socket tests
    • Basic ioprio() tests
    • Basic sendmmsg() test
    • mbind() tests
    • Memory protection (pkey) tests
    • prctl() with PR_CAP_AMBIENT
    • prctl() with PR_{GET,SET}_NO_NEW_PRIVS
    • prctl() with PR_{SET,GET}_NAME
    • prctl() with PR_{SET,GET}_SECCOMP
    • futext_cmp_requeue() tests
    • fanotify FAN_REPORT_FID tests
    • fanotify overlayfs tests
    • pidfd_send_signal() tests
    • IMA overlay tests
    • acct() tests
    • preadv2() RWF_NOWAIT tests
  • New tests variants for

    • clock_getres()
  • New regression tests

    • bpf_prog02: regression test for 3612af783cf52c (bpf: fix sanitation rewrite in case of non-pointers)
    • timer_create() aka CVE-2017-18344
    • alsa timer race aka CVE-2017-1000380
    • accept02 aka CVE-2017-8890
    • setsockopt04 aka CVE-2016-9793
    • move_pages12: regression tests for:
      e66f17ff7177 (mm/hugetlb: take page table lock in follow_huge_pmd())
      c9d398fa2378 (mm, hugetlb: use pte_present() instead of pmd_present() in follow_huge_pmd())
      4643d67e8cb0 (hugetlbfs: fix hugetlb page migration/fault race causing SIGBUS)
    • crypto_user02: regression test for 21d4120ec6f5 ("crypto: user - prevent operating on larval algorithms")
    • sysctl02: regression test for 32a5ad9c2285 ("sysctl: handle overflow for file-max")
  • Increased coverage

    • copy_file_range()
      • tests for cross device copy
      • tests for invalid files (swapfile, pipe, ...)
    • intel PT tests
    • sync_file_range()
      • added partial range sync
  • Added syscall tables for MIPS

  • Guarded buffers, which are pages followed by a PROT_NONE and preceeded by a
    canary were introduced and 8 tests were changed to make use of the new
    feature. Also newly implemented tests are using the same buffers as well.

  • Additional 36 tests were converted to the new test library

NOTABLE CHANGES IN NETWORK TESTS

brought to you by Petr Vorel

  • New net features:

    • introduce TST_GET_UNUSED_PORT() macro into C API
  • Rewritten to new API:

    • tst_get_unused_port
    • bind01
    • setdomainname
    • sethostname
  • The usuall amount of fixes and cleanups.

CREDITS

Many thanks to the people contributing to this release:

git shortlog -s -e -n 20190517..

68  Petr Vorel <[email protected]>
45  Cyril Hrubis <[email protected]>
27  Yang Xu <[email protected]>
19  Christian Amann <[email protected]>
17  Jan Stancek <[email protected]>
 9  Richard Palethorpe <[email protected]>
 8  Li Wang <[email protected]>
 7  Murphy Zhou <[email protected]>
 6  Jinhui huang <[email protected]>
 5  Amir Goldstein <[email protected]>
 5  Po-Hsu Lin <[email protected]>
 5  Sandeep Patil <[email protected]>
 5  Yixin Zhang <[email protected]>
 4  Joerg Vehlow <[email protected]>
 4  Xiao Yang <[email protected]>
 3  He Zhe <[email protected]>
 3  Matthew Bobrowski <[email protected]>
 2  Caspar Zhang <[email protected]>
 2  Eric Biggers <[email protected]>
 2  Steve Muckle <[email protected]>
 1  Alexey Kodanev <[email protected]>
 1  Ammy Yi <[email protected]>
 1  Hongzhi.Song <[email protected]>
 1  Khem Raj <[email protected]>
 1  Linus Walleij <[email protected]>
 1  Martin Doucha <[email protected]>
 1  Mathias Fiedler <[email protected]>
 1  Michael Moese <[email protected]>
 1  Murphy Zhou <[email protected]>
 1  Petr Cervinka <[email protected]>
 1  Ping Fang <[email protected]>
 1  Piotr Gawel <[email protected]>
 1  Steven Price <[email protected]>
 1  Sultan Alsawaf <[email protected]>
 1  Sumit Garg <[email protected]>
 1  Thadeu Lima de Souza Cascardo <[email protected]>
 1  Tobias Jordan <[email protected]>
 1  Wu,Haiqiang <[email protected]>
 1  Yann Sionneau <[email protected]>
 1  Yi Zhao <[email protected]>
 1  Yu,Siliang <[email protected]>

And also thanks to patch reviewers:

git log 20190517.. | grep -Ei '(reviewed|acked)-by:' | sed 's/.*by: //' | sort | uniq -c | sort -n -r

 94 Cyril Hrubis <[email protected]>
 42 Li Wang <[email protected]>
 16 Amir Goldstein <[email protected]>
 13 Jan Stancek <[email protected]>
 11 Richard Palethorpe <[email protected]>
  7 Petr Vorel <[email protected]>
  6 Xiao Yang <[email protected]>
  6 Clemens Famulla-Conrad <[email protected]>
  5 Yang Xu <[email protected]>
  4 Mimi Zohar <[email protected]>
  4 Alexey Kodanev <[email protected]>
  3 Sumit Garg <[email protected]>
  2 Murphy Zhou <[email protected]>
  2 Ignaz Forster <[email protected]>
  1 Sandeep Patil <[email protected]>
  1 Richard Palethorpe <[email protected]>
  1 Enji Cooper <[email protected]>
  1 Christian Amann <[email protected]>

LTP 20190517

17 May 12:09
Compare
Choose a tag to compare

Since the last release 293 patches by 49 authors were merged.

NOTABLE CHANGES

  • New tests

    • ioctl_ns{01-07}: Tests for NS_GET_* ioctls
    • clock_adjtim{01,02}: New tests
    • userfaultfd01: New test
    • ioctl08: Test for FIDEDUPERANGE on Btrfs
    • sigpending02: New test for sigpending/rt_sigpending
    • pivot_root01: New test
    • tgkill{01-03}: New tests
    • set_mempolicy{01-04}: New tests
    • rt_tgsigqueueinfo01: New test
    • binfmt_misc02.sh: New functionality test
    • pwritev2{01-02}: New tests
    • rt_sigpending02: New test
    • fanotify12: New test for FAN_OPEN_EXEC event mask
    • clock_gettime{01,02}: New tests
    • fdatasync03: New test
    • fsync04: New test
    • sync03: New test
    • syncfs01: New test
    • setrlimit06: Add new test for RLIMIT_CPU
    • statx07: Add test for AT_STATX_DONT_SYNC and AT_STATX_FORCE_SYNC
    • clock_settime{01,02}: New tests
  • New regression tests

    • af_alg06: malformed authenc key 8f9c46934848
    • af_alg05: skcipher_walk error bug 8088d3dd4d7c
    • af_alg04: vmac race conditions bb2964810233
    • af_alg03: rfc7539 hash alg validation e57121d08c38
    • af_alg02: salsa20 empty message bug ecaaab564978 aka CVE-2017-17805
    • af_alg01: hmac nesting bug af3ff8045bbf aka CVE-2017-17806
    • binfmt_misc01.sh: 5cc41e099504 ("fs/binfmt_misc.c: do not allow offset overflow)
  • Increased coverage

    • fanotify01: add FAN_REPORT_FID test cases
    • fanotify10: increase test coverage to support FAN_OPEN_EXEC mask
    • fanotify03: add FAN_OPEN_EXEC_PERM
  • New test variants API

    • The LTP test library gained support for test variants, with that we can
      test family of similar syscalls (i.e. different select syscalls) in a
      single test.

    • stime: Test 3 variants

    • sigpending: Test 3 variants

    • select04: Test 4 variants

  • Various fixes for Android Bionic libc (both build and runtime) and musl libc
    are included in this release

  • Additional 22 tests were converted to the new test library

NOTABLE CHANGES IN NETWORK TESTS

brought to you by Petr Vorel

  • New testcases

    • ipsec: test also randomized message length
    • features: new checksum testcases
    • virt: add mode l3s in ipvlan test
    • netstress: support SO_REUSEPORT, MSG_ZEROCOPY
  • Various tests converted into new API

    • (arping01, broken_ip, clockdiff01, ip_tests.sh, ping0{1|0}, tracepath, traceroute)
  • Various small fixes and enhancements, most notable ones:

    • dhcp: correct prefix for expected IPv6 address)
    • lower down packet size to minimum, which still be high enough to require
      fragmentation. This is critical for performance tests, which compare
      virtual devices with the real ones.
    • netstress: various fixes to avoid false-positives
    • dhcp: AppArmor and SELinux fixes, fix paths for non-RHEL distros

CREDITS

Many thanks to the people contributing to this release:

git shortlog -s -e -n 20190115..

40  Petr Vorel <[email protected]>
39  Enji Cooper <[email protected]>
28  Cyril Hrubis <[email protected]>
17  Alexey Kodanev <[email protected]>
15  Petr Vorel <[email protected]>
15  Xiao Yang <[email protected]>
14  Rafael David Tinoco <[email protected]>
12  Matthias Maennich <[email protected]>
11  Sumit Garg <[email protected]>
 9  Eric Biggers <[email protected]>
 7  Jan Stancek <[email protected]>
 7  Jinhui huang <[email protected]>
 7  Li Wang <[email protected]>
 7  Steve Muckle <[email protected]>
 6  Jia Zhang <[email protected]>
 6  Yang Xu <[email protected]>
 5  Matthew Bobrowski <[email protected]>
 4  Shile Zhang <[email protected]>
 3  Christian Amann <[email protected]>
 3  Cristian Marussi <[email protected]>
 3  Greg Hackmann <[email protected]>
 3  Sandeep Patil <[email protected]>
 2  Federico Bonfiglio <[email protected]>
 2  Jason Xing <[email protected]>
 2  Michael Holzheu <[email protected]>
 2  Paul Lawrence <[email protected]>
 2  Zhengwang Ruan <[email protected]>
 1  Alistair Strachan <[email protected]>
 1  Amir Goldstein <[email protected]>
 1  Balamuruhan S <[email protected]>
 1  Daniel Diaz <[email protected]>
 1  Daniel Mentz <[email protected]>
 1  Elif Aslan <[email protected]>
 1  Esteban Flores <[email protected]>
 1  Guangwen Feng <[email protected]>
 1  He Zhe <[email protected]>
 1  Jan Baier <[email protected]>
 1  Michael Holzheu <[email protected]>
 1  Pengfei Xu <[email protected]>
 1  Ramon Pantin <[email protected]>
 1  Richard Palethorpe <[email protected]>
 1  Roman Kalashnikov <[email protected]>
 1  Sandeep Patil <[email protected]>
 1  Saravana Kannan <[email protected]>
 1  Tommi Rantala <[email protected]>
 1  Vaishnavi <[email protected]>
 1  Xiao Liang <[email protected]>
 1  Yixin Zhang <[email protected]>
 1  supersojo <[email protected]>

And also thanks to patch reviewers:

git log 20190115.. | grep -Ei '(reviewed|acked)-by:' | sed 's/.*by: //' | sort | uniq -c | sort -n -r

 73 Cyril Hrubis <[email protected]>
 20 Petr Vorel <[email protected]>
 20 Jan Stancek <[email protected]>
 11 Xiao Yang <[email protected]>
 11 Alexey Kodanev <[email protected]>
  9 Steve Muckle <[email protected]>
  7 Li Wang <[email protected]>
  7 Amir Goldstein <[email protected]>
  5 Mimi Zohar <[email protected]>
  5 Enji Cooper <[email protected]>
  3 Sandeep Patil <[email protected]>
  2 Sumit Garg <[email protected]>
  1 Xiong Zhou <[email protected]>
  1 Sandeep Patil <[email protected]>
  1 Michael Holzheu <[email protected]>
  1 Hendrik Brueckner <[email protected]>
  1 Eric Biggers <[email protected]>
  1 Enji Cooper <[email protected]
  1 Cyril Hrubis <[email protected]>
  1 Cristian Marussi <[email protected]>
  1 Alessio Balsini <[email protected]>

LTP 20190115

15 Jan 14:55
Compare
Choose a tag to compare

Since the last release 246 patches by 40 authors were merged.

NOTABLE CHANGES

  • New tests

    • fanotify11 - test for FAN_REPORT_TID
    • fanotify01, fanotify03, fanotify10
      • added coverage for FAN_MARK_FILESYSTEM
    • fanotify03
      • added coverage for mountpoint mark
    • getrlimit03 - test if getrlimit syscalls return consistent data
    • increased coverage for readahead and posix_fadvise on overlayfs
    • execveat01 - functional tests
    • execveat02 - invalid inputs tests
    • statx06 - checks for correct statx timestamps
    • lremovexattr01 - functional tests
    • fremovexattr01 - functional tests
    • fremovexattr02 - invalid inputs tests
    • pt_test - Intel PT full trace test
    • membarier01 - functional tests
    • preadv201 - functional tests
    • preadv202 - invalid inputs tests
    • new open posix conformance tests for strchr, strcpy, strncpy,
  • New regression tests

    • crypto_user01 aka CVE-2018-19854 (previously known as CVE-2013-2547)
    • fanout01 aka CVE-2017-15649
    • fanotify09
      • added coverage for merging events on child subdir
        fixed in b469e7e47c8a "fanotify: fix handling of events on child sub-directory"
    • fanotify10 - test for mount ignore mask
      fixed in 9bdda4e9cf2d fsnotify: fix ignore mask logic in fsnotify()
    • getxattr05
      fixed in 82c9a927bc5d ("getxattr: use correct xattr length")
  • Additional 37 tests were converted to the new test library; with that about
    30% of the LTP syscall testcases have been converted so far

  • The travis build-testing is now done using docker ensuring that latest LTP
    git HEAD builds smoothly on major distributions and architectures

  • The fzsync library intended to trigger kernel races has been rewritten again,
    the code is simpler now and at the same time the probability to hit races
    has increased.

NOTABLE CHANGES IN NETWORK TESTS

brought to you by Petr Vorel

New features/tests:

  • tests for SIT tunnel
  • tests for MPLS labels
  • netstress: add support for SO_BINDTODEVICE
  • added tst_net_run() shell API function
  • nfs tests were rewritten to new API
  • various fixes in dhcp, ipsec, rpc and virt tests
  • removed ftp and ssh tests

CREDITS

Many thanks to the people contributing to this release:

git shortlog -s -e -n 20180926..
41 Petr Vorel [email protected]
28 Amir Goldstein [email protected]
25 Alexey Kodanev [email protected]
25 Xiao Yang [email protected]
16 Jan Stancek [email protected]
13 Cyril Hrubis [email protected]
8 Enji Cooper [email protected]
8 Stanislav Kholmanskikh [email protected]
7 Clemens Famulla-Conrad [email protected]
6 Cristian Marussi [email protected]
6 Greg Hackmann [email protected]
6 Rafael David Tinoco [email protected]
6 Richard Palethorpe [email protected]
6 Steve Muckle [email protected]
4 Jinhui huang [email protected]
4 Mandri, Padmashree [email protected]
4 Sandeep Patil [email protected]
3 Eric Biggers [email protected]
3 Yixin Zhang [email protected]
2 Jason Xing [email protected]
2 Li Wang [email protected]
2 Subash Ganesan [email protected]
1 Allen, John [email protected]
1 Ammy Yi [email protected]
1 Hongzhi.Song [email protected]
1 Kai Kang [email protected]
1 Keita Suzuki [email protected]
1 Kenneth Magic [email protected]
1 Khem Raj [email protected]
1 Lei Yang [email protected]
1 Masayoshi Mizuma [email protected]
1 Michael Moese [email protected]
1 Myungho Jung [email protected]
1 Po-Hsu Lin [email protected]
1 Shaoting Lei [email protected]
1 Sun Lianwen [email protected]
1 Thadeu Lima de Souza Cascardo [email protected]
1 Tommi Rantala [email protected]
1 nixiaoming [email protected]
1 yangj [email protected]

And also thanks to patch reviewers:
git log 20180926.. | grep -Ei '(reviewed|acked)-by:' | sed 's/.*by: //' | sort | uniq -c | sort -n -r
86 Cyril Hrubis [email protected]
20 Petr Vorel [email protected]
13 Li Wang [email protected]
10 Jan Stancek [email protected]
7 Alexey Kodanev [email protected]
4 Xiao Yang [email protected]
3 Richard Palethorpe [email protected]
1 Steve Muckle [email protected]
1 Richard Palethorpe [email protected]
1 Jan Kara [email protected]
1 Amir Goldstein [email protected]