Report module

[pieterdp]

Currently, Datahub::Factory spews all its errors to STDERR/STDOUT. We would like to generate a log file (per run) where on every line we get the following information for every failed record:

identifier
error message
action (e.g. import failed, or conversion failed, or conversion failed, import succeeded)

This report/log file must be sent by e-mail to a configurable maintainer, but it must also be possible to switch off emailing alltogether.

[pieterdp]

See f59fab0: added support for configurable log levels and output.

[netsensei]

Todo

• Improve logging to a log file
• Log should be able to mail a digest once the entire process has been completed
• Log should be able to log to a database (mongo,...) for monitoring purposes.
• Log data to elastic for Kibana support (https://www.elastic.co/products/kibana) (optional)