* Implemented brnad new PassiveDNS data service and pluggable module for Hawat.
* Implemented support for HTML snippet endpoints.
* Implemented basic framework for asynchronous fetching additional data for IP addresses in IDEA event detail view.
* Implemented fetching of additional data for IP addresses.

(Redmine issue: #5278)

(Redmine issue: #3387)

This new feature will be used to enhance various event views. (Redmine issue: #5067)

This patch contains following features:

* Mentat service for accessing NERD database via RESTfull API.
* Prototype of pluggable for Hawat providing simple demonstrational view for searching NERD database and context search action menu item for searching IP addressess.
*

(Redmine issue: #5067)

Some users may prefer viewing IDEA messages in YAML format, because it contains much less funny characters.

Up to this point it was necessary to submit the authentication token with POST method and 'api_token' parameter. There is now a second option, that takes precedence, which is the use of HTTP`s 'Authorization' header.

(Redmine issue: #4486)

Because of odd behavior of time select widget on events page and nonstandard nature of link, the link from web report was changed to csag dropdown. May be changed again in future (Redmine issue: #5068)

(Redmine issue: #4486)

(Redmine issue: #3387)

(Redmine issue: #4500)

(Redmine issue: #3361)

(Redmine issue: #4500)

(Redmine issue: #4500)

I have merged work done by my coleague to main development branch for testing and deployment.

Chart toplists for dashboards are now calculated in the frontend in Javacript instead of in background in Python. This approach will enable users to access the full information, which is necessary in some use cases. (Redmine issue: #4486)

(Redmine issue: #3387)

Added more readable From: header instead of default root. Added extended email headers X-Mentat-Report-Class and X-Mentat-Report-Type to enable automated report processing. Changed the log directory to default /var/mentat/log. (Redmine issue: #5101)

The database sanity check scripts now produce better output, log the output aside to log files for later use and are easier to configure. The usage documentation was revised as well. (Redmine issue: #5101)

(Redmine issue: #5101)

(Redmine issue: #3387)

Fix: Fixed the format of datetime values for generated URLs to processing and reporting dashboards from informant reports.

Also added the links to TXT version of the reports. (Redmine issue: #5101)

(Redmine issue: #5101,#1017)

(Redmine issue: #5101)

(Redmine issue: #5101)

(Redmine issue: #5101,#1017)

(Redmine issue: #3387)

(Redmine issue: #5101)

(Redmine issue: #4216)

Included simple benchmark file for measuring performance of statistical calculations for IDEA messages.

Current version is a very simple script with a huge room for improvements. (Redmine issue: #3443,#1017)

System administrator now has an ability to view the numbers of sent report emails and target email addressess in reporting dashboard and informant emails. This new feature can hopefully enable him/her to spot problems with email reportingmore quickly. (Redmine issue: #5101)

The previous description was not exactly correct, I have found some issues after deployment to test server. (Redmine issue: #5101)

Configuration files and documentation regarding regular event reporting now clearly describe the steps necessary to enable sending emails to real world abuse contacts. (Redmine issue: #5101)