A background precalculation mechanism for in-depth analytics
Some analytics transactions take a long time to finish because of the
amount of data that must be processed. Such queries cannot run in real
time as both the wait time for the user and the additional load from
repeated execution would be unbearably high. A reasonable method to do
this is to create MATERIALIZED VIEW
representing the desired output,
which can be read instantly. Such an approach then needs an update
mechanism, to recalculate the views in the background during low load
times and frequently enough for the provided data to be useful. There
might also be need for further additional processing outside the
database engine, so the tool must support such use case also.
Author: Radko Krkoš krkos@cesnet.cz