data.edit.contamfilter

data.edit.contamfilter removes any data that is flagged as being contaminated by any source from the data stream.

There are three modes of operation, the first is the fully automatic mode used from within the environment set up by data.edit.get. The second is as a filter and wrapper to data.get. The third is as a simple filter on standard input.

By default uses contaminate.conf to determine which variables to remove when contamination is flagged.

When as a wrapper to data.get:

data.edit.contamfilter [--cpx] [--contam-match=X1,X2...] 
                       station records start end [source]

From within data.edit.get or as a simple filter:

data.edit.contamfilter [--contam-match=X1,X2...]

The time specifiers for the data to be retrieved. Start is inclusive while end is exclusive, so all data contained within the half open interval [start,end) will be returned. Any convertible time format is accepted.

The station identifier code. For example 'brw'. Case insensitive.

The cpd2 record type to be retrieved. For example: 'S11a'. Case sensitive. Multiple record types may be separated by “,”, “;” or “:”. The results will be interwoven in time. Note that this is a single argument and that spaces are not allowed.

Set source archive to request data from, defaulting to raw.

Pass –cpx to data.get in wrapper mode.

List of Perl regular expressions to match against variables instead of what is loaded from contaminate.conf. If this option is present then the patterns contained in it are applied for all time.

data.edit.contamfilter brw S11a,A11a 2009:307 2009:308