data.aggregate.station

data.aggregate.station calls the handlers defined by aggregate.conf for a given station. It is used to (re)generate aggregated data or update various external products as needed. In its normal mode of operation it determines the times it must process based only on the times in the internal update notification system. It can also be given a time range to explicitly process in addition to any found in the internal system. There are two sets of programs defined by separate configuration files: the normal mode in aggregate.conf and the slow mode in aggregate.slow.conf. Slow mode is intended for jobs that take much longer to run (possibly multiple days for extended periods of time). They are normally run over the weekend.

data.aggregate.station [--slow] station [start end] [archives]

The time specifiers for interval to force an update for. Start is inclusive while end is exclusive. Any convertible time format is accepted.

The station identifier code. For example 'brw'. Case insensitive.

List of archives to process updates for, separated by “,”, “:”, or “;”. Defaulting to all archives.

Invoke slow mode handlers instead of the normal ones. Used for long running jobs that may potentially take multiple days.

All handlers are called as set in the configuration file, but with four additional arguments added on to the end of their command line. These are, in order, the station code, the start of this segment, then end of the segment, and the archive.

For example, a handler listed as “do.stuff –arg1 –arg2” in the configuration file might be called like: “do.stuff –arg1 –arg2 brw 1175558400 1175644800 raw”.

Additionally the environment variables STATION, START, END, and ARCHIVE are set before calling the handler. These may be expanded in the handler's command line if they are present there. That is a handler of “do.stuff –start=$START” would have the second argument expanded as “–start=1175558400”.

data.aggregate.station bnd

data.aggregate.station bnd 2008 2009