data.aggregate.upload

data.aggregate.upload generates data to be uploaded to remote archives. It takes a type argument that specifies the exact configuration file to load: upload.$TYPE.conf.

It is intended to be called as part one of the aggregators invoked by data.aggregate.station.

Specific archives may impose time upload restrictions, for example the NILU NRT archive specifies that data is uploaded aligned on the hour, so the aggregator configuration should be set to reflect this (1 hour interval and 1 hour alignment). The NILU WDCA archive imposes one year intervals.

If any files fail to upload, they are queued to be retried by data.process.upload.

data.aggregate.upload [--dryrun[=DIR]] type station start end

If present then the operation is converted into a dry run and will not actually upload any data. If a directory is given, then files are output in that directory, otherwise they are placed in the current directory. Additionally this will not compress files if that compression was specified as part of the upload sequence.

A type code that determines what is uploaded.

The time specifiers for the data to be retrieved. Start is inclusive while end is exclusive, so all data contained within the half open interval [start,end) will be returned. Any convertible time format is accepted.

The station identifier code. For example 'brw'. Case insensitive.

data.aggregate.upload nilu_nrt bnd 2008-05-06T01:00:00Z 2008-05-06T02:00:00Z