Hi all, We are pleased to announce the release of DNS-STATS Compactor version 1.2.1. Full changelog since 1.2.0 ----------------------------------- * Updates: * New `sampling mode` option available when `compactor` is overloaded * Sampling of captured packets can be enabled at a specified rate for a specified time when packet drops exceed a specified threshold (see config options for more details). This option is disabled by default. * The behaviour of the internal sniffer channel is improved when `compactor` is overloaded to provide better reporting and management of dropped/sampled of packets * This fixes a bug where the `Total Packets processed` statistic did not include any packets dropped during overload and so under reported load * Add new statistics to C-DNS: sniffer drops, matcher drops and sampling discards, and 3 libpcap stats. The libpcap stats should not be considered reliable and provided for information only. * Bump the private version because C-DNS schema extended with new statistics. * The behaviour of `compactor` is changed when an interrupt (SIGINT, SIGTERM) is received e.g. when the service is restarted or a user enters ^C. Previously all of the in progress C-DNS compression was aborted and all of the in progress output files (compressed and uncompressed) were removed. Now the `.raw` uncompressed output file is left on disk so it can be manually recovered (i.e. renamed and compressed). Users will now need to choose how to managed these uncompressed files. Behaviour on SIGHUP (re-reading of config file without affecting any in progress compression) is unchanged. * Logging: * New `log-file-handing` option to log low level details of file processing on file rotation and compression. This aids with debugging of file processing problems and measurement of C-DNS file compression times. * New `-D` option (`relaxed-mode`). With this option a warning (not an error) is issued for unrecognized command line and config file options. * Additional default logging is added when file rotation occurs, when compression is aborted, and to report the specific interrupt received by `compactor`. * Improve `log-interval` statistics output and add additional statistics. * Minor updates/bug fixes: * Modify the format output by the debug option `--debug-qr` to be more human readable (`--debug-dns` output is left unchanged). * Fix file durations for files with more than one C-DNS block in them so high traffic rates can be correctly calculated from the statistics. * Constrain size of matcher queue to reduce memory consumption when dropping/sampling. * Fix 2 minor bugs where an incorrect start time could be written to the CDNS file, resulting in a negative file duration. * Fix build issue when using `configure --disable-pseudo-anonymisation`. Thanks Sean Burford for reporting this. * Add example docker image as a submodule in `contrib/dns-stats-docker`. Thanks to Sean Burford for providing this. * Documentation: * Minor documentation update to address https://github.com/dns-stats/compactor/issues/80 * Text added in the documentation to clarify time patterns are needed in file output patterns for filename based file rotation to occur (based on the `rotation-period` option). * Correct the dependency list. For more information, please see the project wiki: https://github.com/dns-stats/compactor/wiki. Packages available from: ppa:dns-stats/compactor Source code available at: https://github.com/dns-stats/compactor Documentation: https://github.com/dns-stats/compactor/wiki/user-guide-1.2.1.pdf Sara Dickinson.