[ANNOUNCE] The Linux Test Project has been released for MAY 2021

From: Cyril Hrubis
Date: Mon May 24 2021 - 07:51:56 EST


Good news everyone,

the Linux Test Project test suite stable release for *May 2021* has been
released.

Since the last release 364 patches by 50 authors were merged.

NOTABLE CHANGES
===============

* New tests
- fanotify17 - tests for fanotify() user limits
- fanotify18 - tests for validating user permissions
- fanotify19 - tests for unpriviledged events
- brk02 - test that removes two VMAs on shrink
- close_range{01,02} - basic close_range() tests
- rtc02 - /dev/rtc timer tests

* New regression tests
- bpf_prog05 truncation on 32bit div/mod by zero aka CVE-2021-3444
- writev03 regression test for d4690f1e1cda 'fix iov_iter_fault_in_readable()'
- io_uring02 regression test for unsafe handling of the root directory aka CVE-2020-29373

* Increased coverage
- tmpfs was added for tests that loop over filesystems supported by the SUT
- fanotify05 added more queue overflow tests and test for unlimited queue

* 52 tests were rewritten to the new library

- with that we reached important milestone where new library testcases
outnumber the old library tests for the first time ever

- Converted tests:
- chdir01
- chmod05
- chown01, chown02, chown03
- close01, close02
- get_mempolicy01
- getgid01, getgid03
- getpid01, getpid02
- getppid01, getppid02
- io_cancel01, io_getevents01
- mallopt01
- mmap19
- netns_netlink
- pec
- pidns13
- reboot01, reboot02
- sched_getparam01, sched_getparam02, sched_getparam03
- semctl01, semctl02, semctl03, semctl04, semctl05, semctl07
- sendfile03, sendfile04, sendfile05, sendfile07
- setgid01, setgid02, setgid03
- swapoff01, swapoff02, swapoff03
- swapon01, swapon02, swapon03
- time01
- times01
- tkill01, tkill02
- unlinkat01
- unshare01, unshare02
- wait01, wait02
+ CAN tests were cleaned up and converted to the new library

* Integrity Measurement Architecture (IMA)
- new SELinux measurement tests
+ fixes

* Added new library for managing network interfaces over netlink

* Added new library for cgroup discovery and management
- this is a big leap forward for cgroup testing
- greatly simplifies testscases as the library gracefully handles v1/v2
split configurations that are unfortunatelly still common on recent systems
- first few tests were converted to use the library
- more tests are in the queue

* Fixed timeouts in shell test library
- ensure that all child processes are killed on timeout as well
- runs a cleanup after timeout

* The fuzzy sync library was fixed to yield() on single CPU systems
- which fixed test timeouts on single CPU systems
- self tests for the library where implemented where we check that races we
crafted into the code are triggered correctly by the library even on single
CPU systems

* Fixed kernel module detection on BusyBox

* Open Posix Testsuite now use $TMPDIR instead of previously hardcoded /tmp

* LTP should now produce reproducible build after a few fixes to the buildsystem and libs

* The documentation generated from the test sources was improved, you can check
out the generated documentation pages for this release at:

http://linux-test-project.github.io/metadata/metadata.asciidoctor.html

Also have a look at a few nice test documentation examples:

http://linux-test-project.github.io/metadata/metadata.asciidoctor.html#acct02
http://linux-test-project.github.io/metadata/metadata.asciidoctor.html#bpf_prog05
http://linux-test-project.github.io/metadata/metadata.asciidoctor.html#semctl09

* We also wrote down a document about the oldest supported kernel and libc, see:
https://github.com/linux-test-project/ltp/wiki/Supported-kernel,-libc,-toolchain-versions

+ The usual amount of fixes and cleanups

NOTABLE CHANGES IN NETWORK TESTS
================================
brought to you by Petr Vorel

* New tests: UDP encapsulation tests (FOU and GUE)

* Tests converted to new API: CAN tests, multicast stress tests, route-change

* Reduce false positive on tests using tst_netload

+ Other fixes

DOWNLOAD AND LINKS
==================

The latest version of the test-suite contains 3000+ tests for the Linux
and can be downloaded at:

https://github.com/linux-test-project/ltp/releases/tag/20210524

The project pages as well as GIT repository are hosted on GitHub:

https://github.com/linux-test-project/ltp
http://linux-test-project.github.io/

If you ever wondered how to write a LTP testcase, don't miss our developer
documentation at:

https://github.com/linux-test-project/ltp/wiki/C-Test-Case-Tutorial
https://github.com/linux-test-project/ltp/wiki/Test-Writing-Guidelines
https://github.com/linux-test-project/ltp/wiki/BuildSystem

Patches, new tests, bugs, comments or questions should go to to our mailing
list at ltp@xxxxxxxxxxxxxx.

CREDITS
=======

Many thanks to the people contributing to this release:

git shortlog -s -e -n 20210121..

84 Petr Vorel <pvorel@xxxxxxx>
35 Zhao Gongyi <zhaogongyi@xxxxxxxxxx>
35 Richard Palethorpe <rpalethorpe@xxxxxxxx>
26 Xie Ziyao <xieziyao@xxxxxxxxxx>
22 Martin Doucha <mdoucha@xxxxxxx>
20 Cyril Hrubis <chrubis@xxxxxxx>
15 Joerg Vehlow <joerg.vehlow@xxxxxxxxxxx>
13 Li Wang <liwang@xxxxxxxxxx>
10 Xiao Yang <yangx.jy@xxxxxxxxxxxxxx>
8 Amir Goldstein <amir73il@xxxxxxxxx>
7 QI Fuli <qi.fuli@xxxxxxxxxxx>
7 Yang Xu <xuyang2018.jy@xxxxxxxxxxx>
6 Feiyu Zhu <zhufy.jy@xxxxxxxxxxxxxx>
5 Alexey Kodanev <alexey.kodanev@xxxxxxxxxx>
5 Richard Purdie <richard.purdie@xxxxxxxxxxxxxxxxxxx>
5 Yang Xu <xuyang2018.jy@xxxxxxxxxxxxxx>
4 Jan Stancek <jstancek@xxxxxxxxxx>
4 Shiyang Ruan <ruansy.fnst@xxxxxxxxxxxxxx>
4 zhanglianjie <zhanglianjie@xxxxxxxxxxxxx>
4 zhao gongyi <zhaogongyi@xxxxxxxxxx>
3 Cixi Geng <cixi.geng1@xxxxxxxxxx>
3 Kory Maincent <kory.maincent@xxxxxxxxxxx>
3 Lakshmi Ramasubramanian <nramas@xxxxxxxxxxxxxxxxxxx>
3 Shiyang Ruan <ruansy.fnst@xxxxxxxxxxx>
3 Wang Xin <wangxin410@xxxxxxxxxx>
2 Palmer Dabbelt via ltp <ltp@xxxxxxxxxxxxxx>
2 Petr Vorel <petr.vorel@xxxxxxxxx>
2 Thadeu Lima de Souza Cascardo <cascardo@xxxxxxxxxxxxx>
2 Xiao Yang <yangx.jy@xxxxxxxxxxx>
2 Zenghui Gao <gaozh.jy@xxxxxxxxxxx>
1 Alexander Egorenkov <egorenar@xxxxxxxxxxxxx>
1 Ankit Jain <ankitja@xxxxxxxxxx>
1 Bogdan Lezhepekov <bogdan.lezhepekov@xxxxxxxx>
1 Colin Ian King <colin.king@xxxxxxxxxxxxx>
1 Cristian Marussi <cristian.marussi@xxxxxxx>
1 He Zhe <zhe.he@xxxxxxxxxxxxx>
1 Jinghui Huang <huangjh.jy@xxxxxxxxxxxxxx>
1 Jinhui Huang <huangjh.jy@xxxxxxxxxxxxxx>
1 Konstantin Aladyshev <aladyshev22@xxxxxxxxx>
1 Leo Yu-Chi Liang <ycliang@xxxxxxxxxxxxx>
1 Liam Howlett <liam.howlett@xxxxxxxxxx>
1 QI Fuli <fukuri.sai@xxxxxxxxx>
1 Sharan Turlapati <sturlapati@xxxxxxxxxx>
1 Tim Gates <tim.gates@xxxxxxxxx>
1 Tree Davies <tdavies@xxxxxxxxxxxxxxx>
1 Yann Sionneau via ltp <ltp@xxxxxxxxxxxxxx>
1 dongshijiang <dongshijiang@xxxxxxxxxx>
1 ouyangciyan <zintown@xxxxxx>
1 sujiaxun <sujiaxun@xxxxxxxxxxxxx>
1 tianyu <tianyu@xxxxxxxxxx>

And also thanks to patch reviewers:

git log 20210121.. | grep -Ei '(reviewed|acked)-by:' | sed 's/.*by: //' | sort | uniq -c | sort -n -r

151 Cyril Hrubis <chrubis@xxxxxxx>
130 Petr Vorel <pvorel@xxxxxxx>
70 Li Wang <liwang@xxxxxxxxxx>
7 Yang Xu <xuyang2018.jy@xxxxxxxxxxx>
7 Xiao Yang <yangx.jy@xxxxxxxxxxxxxx>
6 Oliver Hartkopp <socketcan@xxxxxxxxxxxx>
5 Alexey Kodanev <alexey.kodanev@xxxxxxxxxx>
4 Yang Xu <xuyang2018.jy@xxxxxxxxxxxxxx>
4 Martin Doucha <mdoucha@xxxxxxx>
4 Lakshmi Ramasubramanian <nramas@xxxxxxxxxxxxxxxxxxx>
4 Jan Stancek <jstancek@xxxxxxxxxx>
3 Xiao Yang <yangx.jy@xxxxxxxxxxx>
2 Viresh Kumar <viresh.kumar@xxxxxxxxxx>
2 Richard Palethorpe <rpalethorpe@xxxxxxxx>
2 Leo Yu-Chi Liang <ycliang@xxxxxxxxxxxxx>
2 Jan Kara <jack@xxxxxxx>
1 Liam R. Howlett <Liam.Howlett@xxxxxxxxxx>
1 Jiri Slaby <jirislaby@xxxxxxxxxx>
1 Eric Biggers <ebiggers@xxxxxxxxxx>
--
Cyril Hrubis
chrubis@xxxxxxx