indimail-mta Release 2.13, daemontools 1.1, ucspi-tcp 1.1

[mbhangui]

Date: Saturday 17 July 2021 06:53:15 PM IST
Announcing Release 2.13 of indimail-mta.

Release Highlights

indimail-mta

• qmail-direct for delivering local mails directly to a user without using the queue.
• new function set_environment() to load environment variables from $HOME/.defaultqueue and sysconfdir/control/defaultqueue
• Configurable directory split
• qmail-send ability to rate limit. New service slowq-send
• qmta-send - self sufficient daemon based on qmail-send+qmail-lspawn+qmail-lspawn code replacing separate separate qmail-send, qmail-lspawn, qmail-rspawn and qmail-clean processes.
• split qmail-multi into qmail-multi and qmail-spamfilter
• complete rewrite of qmail-showctl.
• moved date822fmt, pathexec_run, pathexec_env, envdir, makeargs, mktempfile cdbmss, token822, openreadclose, prot_uid, prot_gid functions to libqmail
• qmail-local.c: add S=message_size in filename for faster quota calculations by dovecot, courier-imap
• qmail-local.c: move maildir delivery code to maildir_deliver.c
• maildirdeliver: complete rewrite using maildir_deliver() function.
• prioq.c: added feature to get prioq list in both descending and ascending order
• log current delivery rate and configured delivery rate in qmail-send logs
• document all indimail-mta environment variable in indimail-env man page
• use glibc wrappers for qgetpwent, setpwent, endpwent, qgetpwent_r, qgetpwnam, qgetpwuid, qgetpwnam_r, qgetpwuid_r, qgetgrent, qsetgrent, qendgrent, qgetgrnam, qgetgrgid, qgetgrnam_r, qgetgrgid_r
• ability of qmta-send to process messages queued by clients with any split value

daemontools

• svscan: run log supervise process with parent directory as argv2, allow supervise processes to run with three arguments
• systemd.override.conf: added systemd override unit file for systems and added systemd-time-wait-sync.service in After= without battery backed RTC
• supervise.c: indicate service name (instead of just the pid) in logs when supervised service exits/crashes
• added RestartSec & PrivateTmp to main unit file and override.conf
• svscan_rc: implemented additional rc commands for FreeBSD
• envdir: ability to link additional directories files for environment variables using .envdir, .envfile
• envdir: complete re-code. Added -c option to clear, -i option to ignore unreadable files and -w option to treat temporary errors as warning
• svscan: run log supervise process with parent directory as argv2, allow supervise processes to run with three arguments
• systemd.override.conf: added systemd override unit file for systems and added systemd-time-wait-sync.service in After= without battery backed RTC
• supervise.c: indicate service name (instead of just the pid) in logs when supervised service exits/crashes
• added RestartSec & PrivateTmp to main unit file and override.conf
• svscan_rc: implemented additional rc commands for FreeBSD
• envdir: ability to link additional directories files for environment variables using .envdir, .envfile
• envdir: complete re-code. Added -c option to clear, -i option to ignore unreadable files and -w option to treat temporary errors as warning

ucspi-tcp

• added SSL/TLS support in tcpclient
• added STARTTLS support in tcpclient for POP3s
• dotls transparent SSL/TLS wrapper for tcpserver

ChangeLog

indimail-mta

Release 2.13 Start 14/02/2021

• 26/02/2021

1. svctool: added options to set, unset, remove env variables for supervised services

• 27/02/2021

2. install: save all variables using svctool --save-variables --force
3. svctool: use TMPDIR env variable for temp directory
4. updated svctool man page
5. svctool: moved --inittab option to --config
6. svctool: use common function dump_run_header to generate header for all run scripts
7. changed error to warning for missing MySQL libs

• 28/02/2021

8. svctool: use common function dump_log_header to create all multilog logger scripts
9. svctool: fixed updation of control files mysql_lib and libindimail
10. post install: save variables

• 01/03/2021

11. svctool: updated courier variables (removed IMAP_ENHANCEDVARIABLE for courier-imap-5.0.12)

• 02/03/2021

12. svctool: fixed dir variable getting clobbered by export_variables()
13. svctool: added back IMAP_ENHANCEDIDLE for courier-imap-5.0.14
14. smtpd.c: renamed TLSCIPHERS to TLS_CIPHER_LIST
15. sslerator.c: renamed SSL_CIPHER to TLS_CIPHER_LIST
16. indimail.spec: fixed rpmlint percent in pretrans, post

• 09/03/2021

18. svctool: added timeout parameter for indisrvr

• 17/03/2021

19. Open Build Service integration with github using action scripts

• 22/03/2021

20. svctool: removed IMAP_ENHANCEDIDLE variable for courier-imap-5.1.1

• 29/03/2021

21. qmail-send.c, qmail-todo.c: make internal functions, variables static
22. qmail-send.c: refactored job functions (author Rolf Eike Beer - @notqmail)

• 15/04/2021

23. svctool: use /run filesystem for service directory when enabling/disabling service

• 16/04/2021

24. svctool: added checks when enabling, disabling service

• 18/04/2021

25. date822fmt() moved to libqmail

• 20/04/2021

26. svctool - make output less verbose with --silent parameter
27. minisvc - honour --silent in export variables

• 22/04/2021

28. svctool - fixed check_libmysqlclient_lib function

• 28/04/2021

29. svctool - allow --force to override norefreshsvc flag for a service

• 29/04/2021

30. binm1.sh: removed setting of PATH env variable
31. replaced QMAIL with QMAILHOME in scripts and man pages
32. qmail-inject: use 'n' option in QMAILINJECT env variable to print message rather than queue
33. debian/indimail-mini: corrected package file list

• 30/04/2021

34. rennamed qmail-deliver to qmail-direct
35. remove zero bytes package_name-stat.override file
36. fixed syntax error getting HOSTNAME

• 01/05/2021

37. qmail-direct.c: removed uidinit() and auto_uids to run on a minimal system.
38. qmail-direct.c: use modified Maildir as the queue directory and eliminate requirement of setuid
39. qmail-direct.c: use standard Maildir for queue operation
40. qmail-direct.c: removed control file direct_mail_users
41. qmail-direct.c: fixed mess, intd filenames

• 03/05/2021

42. do systemctl daemon-reload after installing/removing svscan service

• 06/05/2021

43. svctool: removed mix usage of space and tab
44. indimail-mini.preinst: removed adduser of alias user
45. indimail-mini-postinst, indimail-mini-prerm: removed unused variables
46. indimail-mini-preinst: added missing 'upgrade' case

• 12/05/2021

47. inotify.c: added IN_MOVE_SELF, IN_MOVED_FROm, IN_MOVED_TO events
48. removed pathexec_run.c, pathexec_env.c, pathexec.h and moved functions to libqmail
49. renamed envdir_set() to envdir() and moved it to libqmail
50. new function set_environment() to set environment variables from $HOME/.defaultqueue and sysconfdir/control/defaultqueue

• 16/05/2021

51. maildir.c: include strerr.h explicitly
52. qmail-clean.c, qmail-qread.c, qmail-queue.c, qmail-rm.c, qmail-send.c, qmail-showctl.c, qmail-todo.c, queue-fix.c: have auto_split as the max limit for conf_split
53. svctool: create env variables in service directory as links to defaultqueue
54. svctool: fixed TMPDIR creation
55. qmail-local.c: add S=message_size in filename
56. qmail-local.c: move maildir delivery code to maildir_deliver.c
57. maildirdeliver: complete rewrite using maildir_deliver() function.

• 17/05/2021

58. svctool: make qmail-send service wait for pwdlookup service

• 24/05/2021

59. spawn-filter.c: move report() to report.c
60. spawn-filter.c: move rate functions to get_rate.c
61. wildmat.h: header for wildmat_internal()

• 26/05/2021

62. drate: refactored code and added test mode
63. spawn-filter: moved getDomainToken() to getDomainToken.c
64. get_rate.c: made DELIMITER configurable
65. get_rate.c: return email count, configure rate and current rate in is_rate_ok()
66. qmail-popbull.c, tls.c: replaced strerror() with error_str()
67. etrn.c hier.c load_mysql.c plugtest.c qmail-cdb.c qmail-daemon.c qmail-dk.c qmail-dkim.c qmail-qread.c qmail-remote.c qmail-rm.c qmail-tcpok.c qmail-tcpto.c set_environment.c smtpd.c spawn-filter.c starttls.c surblfilter.c sys-checkpwd.c tcpopen.c: handle access() error other than ENOENT
68. nowutc.c: replaced libc stdio with substdio
69. get_rate.c, drate.c: added option to force update

• 29/05/2021

70. added rate limit feature in qmaii-send, slowq-send

• 03/06/2021

71. prioq.c: added feature to get prioq list in both descending and ascending order
72. delivey_rate.c: log email/curr_rate/conf_rate in logs

• 09/06/2021

73. split qmail-multi into qmail-multi and qmail-spamfilter

• 10/06/2021

74. fixed uninitialized variables in do_test()
75. fixed compiler warning for containsutf8()
76. moved makeargs.c, mktempfile.c to libqmail
77. svctool: replace qmail-multi with qmail-spamfilter for spam filter

• 11/06/2021

78. remove dependency on auto_qmail, auto_control for locating files

• 13/06/2021

79. svctool: simplified generation of clamav, freshclam config
80. fixed debian scripts for indimail-mini

• 15/06/2021

81. moved cdbmss.[c,h], token822.[c,h] to libqmail
82. pidopen.c: added tmpdir argument

• 16/06/2021

83. inotify.c: fixed erroneous check for errno
84. load_mysql.h: use MYSQL_RES for non-libmariadb setup

• 23/06/2021

85. qmail-send.c, slowq-send.c: moved log_stat function to qsutil.c
86. qmail-todo.c: display bytes in log_stat

• 27/06/2021

87. uidnit new argument to disable/enable error on missing uids in qmail-start.c spawn.c slowq-start.c queue-fix.c qscanq.c qmail-showctl.c qmail-queue.c qhpsi.c instcheck.c get_uid.c cleanq.c
88. qmail-send.c, slowq-send.c: moved conf_split variable to fmtqfn.c
89. qmail-send.c, slowq-send.c: fixed error handling in injectbounce
90. qmail-send.c, slowq-send.c: moved conf_split variable to fmtqfn.c
91. qmail-send.c, slowq-send.c: fixed error handling in injectbounce
92. qmail-send.c: moved log lock functionality to qsutil.c
93. qmail-todo.c qmail-qread.c qmail-clean.c fmtqfn.c: moved conf_split variable to fmtqfn.c
94. qsutil.c qsutil.h: added loglock_open function
95. svctool.in qlocal_upgrade.in: renamed LOCK_LOGS env variable to LOGLOCK
96. rpmattr.c: removed call to uidinit

• 28/06/2021

97. standalone MTA - qmta-send

• 01/07/2021

98. renamed maildirwatch to qmaildirwatch to avoid clash with courier-imap

• 03/07/2021

99. moved prot.c, prot.h to libqmail
100. smtpd.c: checkrecipient_pwd: replace getwent() with in-built function to check for user in /etc/passwd

• 04/07/2021

101. qmail-showctl.c: complete rewrite
102. get_uid.c: use qgetpwent, qgetgrent from libqmail's qgepwgr.c
103. svctool: added BASE_PATH env variable for defaultqueue
104. run qmail-dk, qmail-dkim with qmail group to access domainkeys dir
105. qmta-send: run as qmailq if running without qmail-clean
106. indimail-mta.spec, debian/qmta.postinst: create qmta queue with qmta mode (queue-fix -m)
107. queue-fix: added -m option for qmta-send where dirs are owned by qmailq
108. set_environment.c: skip $HOME/.defaultqueue if running as root

• 05/07/2021

109. qmail-showctl.c: complete rewrite
110. get_uid.c: use qgetpwent, qgetgrent from libqmail's qgetpwgr.c
111. sys-checkpwd.c qmail-getpw.c qmail-direct.c maildirsize.c serialcmd.c: use getpw, getgr functions from libqmail getpwgr.c
112. maildirserial.c new-inject.c process_queue.c qmail-inject.c qmail-showctl.c queue-fix.c: allow $HOME/.defaultqueue for root

• 07/07/2021

113. added indimail-env man page
114. svctool: added --print-variable option

• 09/07/2021

115. fmtqfn.c: initialize conf_split
116. added mini-smtpd for qmta, indimail-mini package
117. BUG: get_uid.c: fixed wrong uid/gid allocation
118. hier.c: set setgid bit for qmail-dk, qmail-dkim to access private key

• 10/07/2021

119. fixed cronlist.q

• 12/07/2021

120. svctool: use control/global_vars for common environment variables across svscan services

• 13/07/2021

130. indimail-mta.spec: removed /sbin/chkconfig from Requires
131. indimail-mta.spec: insserv-compat removed from Tumbleweed

• 14/07/2021

132. set_environment.c: envdir function now requires additional parameters.

• 15/07/2021

133. qmail-inject.c: removed unused function die_chdir
134. qmta-send.c: block sigchild to avoid waitpid surprise when doing qmail_close.
135. qmta-send.c: added missing bounce related control files
136. slowq-send.c, qmail-send.c: organize bounce related control files together.
137. qmail-send.c, slowq-send.c, qmta-send.c: corrected data type of comm_pos to int (changed to char from int in 1.74 qmail-send.c by mistake).
138. qmail-todo: fixed first digit missing for bytes in qmail-send logs

• 16/07/2021

139. Fixed missing first digit of bytes display in qmail-send logs
140. svctool: added --print-all-variables option

• 17/07/2021

141. svctool: added option to specify qmailqueue and qmail-smtpd binaries
142. svctool: added option to set envdir options used for loading service environment variables
143. qmail- todo.c, qmail-send.c, slowq-send.c: skip processing of for messages queued with wrong split dir
144. qmta-send.c: fix split dir of messages queued with wrong split value
145. qsutil.[c,h]: add fix_split function to generate file name for any split value

daemontools

• 27/02/2021

1. minisvc: added options to set, unset, remove env variables for supervised services
2. minisvc: added --dumpconfig option
3. updated minisvc man page

• 28/02/2021

4. minisvc: use common functions dump_run_header, dump_log_header for generating run, log/run
5. post install: save variables to .variables

• 07/04/2021

6. svscan: run log supervise process with parent directory as argv2
7. supervise: allow supervise for log process to run with three arguments

• 15/04/2021

8. minisvc: take into account /run filesystem when enabling, disabling service

• 16/04/2021

9. svscan: disable service in /run filesystem when service is disabled in /service
10. minisvc: added checks when enabling, disabling service
11. updated svscan man page

• 20/04/2021

12. minisvc - make output less verbose with --silent parameter
13. minisvc - honour --silent in export variables

• 27/04/2021

14. supervise: do not treat error_exist as error for mkdir

• 28/04/2021

15. systemd.override.conf: added systemd override unit file for systems without battery backed RTC
16. minisvc - allow --force to override norefreshsvc flag for a service

• 30/04/2021

17. remove zero bytes package_name-stat.override file

• 03/05/2021

18. do systemctl daemon-reload after installing/removing svscan service
19. timestamp.h: fix function prototype for timestamp()

• 06/05/2021

20. minisvc: removed mixed use of space and tab

• 12/05/2021

21. moved pathexec_run, pathexec_env to libqmail

• 16/05/2021

22. minisvc: fixed TMPDIR creation

• 17/05/2021

23. systemd.override.conf: added systemd-time-wait-sync.service in After=

• 06/06/2021

24. supervise.c: indicate service name in logs, instead of just the pid when supervised service exits/crashes

• 22/06/2021

25. added RestartSec & PrivateTmp to main unit file and override.conf

• 30/05/2021

26. svscan_rc: implemented addtional rc commands
27. envdir: handle new error code for recursive loops
28. envdir: -c option to clear existing environment variables

• 03/07/2021

29. moved prot.c, prot.h to libqmail

• 07/07/2021

30. minisvc: added --print-variable option

• 12/07/2021

30. envdir: added feature to process .envfile and .envdir as a file containing list of directories

• 13/07/2021

31. daemontools.spec: removed /sbin/chkconfig from Requires

• 14/07/2021

32. envdir.c: added options i, w to ignore read errors and warn instead of exit on error
33. Makefile: use openreadclose from libqmail.
34. removed openreadclose.[c,h]

• 16/07/2021

35. minisvc: added --print-all-variables option

ucspi-tcp

• 02/03/2021

1. tcpserver.c renamed SSL_CIPHER to TLS_CIPHER_LIST

• 03/03/2021

2. tcpclient.c: added SSL/TLS support
3. tcpclient.c: added client mode feature making prog optional

• 04/03/2021

4. tls.c: added option to match host with common name
5. tcpclient.c, tcpserver.c: Use CERTDIR env variable to specify custom certificate location
6. tcpclient.c: added -m option to match host with common name

• 06/03/2021

7. dotls.c: SSL/TLS client / server wrapper for SSL/TLS and opportunistic TLS
8. tcpclient.c: added opportunistic TLS (STARTLS) capability.

• 07/03/2021

9. tcpclient.c: added starttls for pop3

• 09/03/2021

10. tls.c: check for SSL_ERROR_WANT_READ to retry SSL_read() when using non-blocking io
11. tls.c, tcpclient.c: retry read. write on errno == EAGAIN to fix blocking IO problem with SSL_read()
12. tls.c: made translate() generic. Replaced SSL with fd parameter
13. doit.c, tcpclient.c: use new translate() from tls.c

• 10/03/2021

14. tls.c, tcpclient.c: use set_essential_fd() to avoid deadlock

• 30/04/2021

15. remove zero bytes package_name-stat.override file

• 12/05/2021

16. define arguments as array subscripts to fix gcc 11 warnings
17. renamed pathexec functions as upathexec to avoid clash with libqmail

• 03/05/2021

18. moved prot.c, prot.h to libqmail
19. dlnamespace.[c,h], tcpserver_plugin.c, load_shared.c use Lmid_t data type for id instead of unsigned long

---

This discussion was created from the release indimail-mta Release 2.13, daemontools 1.1, ucspi-tcp 1.1.