process.conf

This file controls the behavior of data.process.station and data.process.mail. It is located in $DB/etc/$STATION/process.$STATION.conf or in the default location $DB/etc/process.conf. If the station specific file does not exist then the default one is used.

Lines beginning with '#' are treated as comments. The format consists of a CSV separated list of key and optional value pairs. Keys are case insensitive.

The valid keys are listed below.

Add a handler to be invoked during normal data processing. Handlers are called within a temporary directory containing all the extracted data files. An example would be data.process.new.printspanchecks. The string “${STATION}” in the command is replaced with the current station.

Add a handler to be invoked during normal data processing. This works like a normal invoke handler except that any resulting output is placed near the top of the email instead of in the processing log.

Add a handler to be invoked after normal data processing. This runs in a temporary directory after all data for the run has been added.

Add a handler to be invoked after normal data processing. This works like a normal invoke after handler except that any resulting output is placed near the top of the email instead of in the processing log.

Add a handler to be invoked during normal data processing, even if there is no new data. Note that unlike the data processing handlers, these might not be run in the temporary data directory. The string “${STATION}” in the command is replaced with the current station.

Add a handler to be invoked during normal data processing, even if there is no new data. Note that unlike the data processing handlers, these might not be run in the temporary data directory. This works like a normal invoke handler except that any resulting output is placed near the top of the email instead of in the processing log.

Add a handler to be invoked when generating the email report. Output from the handler is captured. The string “${STATION}” in the command is replaced with the current station.

Add a handler to be invoked when generating the email report, but only when the report would otherwise not be empty. That is, these handlers will only be run when the mail would be sent anyway, but may not if it would not be. Output from the handler is captured. The string “${STATION}” in the command is replaced with the current station.

Add a directory to check for new incoming data files in. The value “${STATION}” is replaced with the lower case station ID being processed.

Add a directory to check for new incoming data files in that contains an archive (read only) of some number of prior files. This exists to support the rsynced awftp server. The value “${STATION}” is replaced with the lower case station ID being processed.

The minimum age in seconds that a new incoming file must not have been modified for before it will be processed. Defaults to five minutes.

Add a pattern to match for incoming files to be grabbed. Any files matching any of the grabbed patterns are moved to $DB/stn/$STATION/incoming/ . The pattern can be any Perl regular expression, but must match the entire base file name (that is, the file name without any path information).

The maximum time in seconds from the last seen data before a message it output in the email about data loss. If this key is absent or non-positive that message is never put in the email. See data.process.mail.notifyloss.